I agree with William on this one. There is no difference when install GP on a 32-bit compared to a 64-bit. If you notice that when you do get the install to go through it is actually installing GP to the 32-bit program files this is because GP is a true 32-bit application.
To me it sounds like you are using an installation package file and not the install media.