In my experience, generally, you can either change the registry directly, or use group policy and get the same results. I suspect that simply changing the registry does not update some meta data for the group policy editor somewhere. Once you delete a file, it does not vanish into thin...
