I had this same problem until I created another policy just for the agent to check in every 60 minutes. I think it downloads the policy at this 60 minute interval, then applies it, then checks back. The whole process seemed to take hours for my clients as well.
So far I have 2 policies per workstation, one for the antivirus and one for the agent. All good so far.
Good luck,
-Mark