To add more contacts in your groups of contacts :
You can uncheck your contacts to remove them from the group.
Note: To see all the contacts in your group , click on the “small eye” next to your group.