The advantage of NOT installing via GPO is that the folder "C:\MSOCache" is created. This folder contains the installation source.
Via GPO, you don't get this cache folder. You should always keep your installation files in their original location.