Yellow Jackets back blip

I was was cleaning up the flowerbeds this morning and noticed bees buzzing all around me. More than usual. I looked around to see if I could find the source and spotted them going in the roof above the front door. So many coming and going. I showed hubby and we decided they had to go as they seemed annoyed at us now that we had discovered them. Sugar was going crazy trying to jump and catch them. We need a plan. I also picked up walnuts and hubby cut a fallen tree out of the hay field.