I think you should AScan the $members array for the existance of $Folder.Name .
If it is not in the Array, you want to delete it.
I presume this code will work better...
Maybe you can test it on your folder with test directories
Code:

	If AScan($Members, $folder.name) = -1
		$folder.delete
	EndIf