Trouble setting up RAP policies

Hi

I have read many documents about setting up RAPs however in RDS 2012 I am having trouble setting up RAPs using  security groups other than the default domain users. If I create my RAP with the group Domain Users I can successfully restrict the computers that this group can connect to. My problem is that once I use another AD security group the users in this group are blocked. What I am trying to setup is as follows

AD group called remote_users that access the RD Gateway and RD Gateway session host
AD group called trimagic_users that access the RD Gateway and trimagic server
AD group called sysAdmin that can access all network resources

Any help would be appreciated.

Thanks

Laurie