Wasps most likely.
Wait for sunset, when they are all inside and spray the hole with auto brake cleanner. They die in seconds.
This. We had a bunch of yellow jackets make a nest in our backyard. I got stung once in my lat and even with two shirts on it hurt like a bitch! Yellow jackets don't die when they sting so they are motivated to attack. A bee will die because its body is ripped in half when it tries to withdraw its stinger.
Spraying water at yellow jackets won't do shit and they will attack and follow you even from your property lol! So I dressed up in winter clothing and went out at 2 am with wasp killer.
I set up a LED flashlight covered in plastic right by their nest. Then I sprayed a little wasp killer at the entrance of the nest. They came flying out in droves attacking the LED light.
It looked like a WW2 movie with those pilots attacking ships. I started spraying them from about 6 feet away as they sat down on the LED light. I must have killed about 50 the first night. I had to repeat it the second night. The key is to do it at night because they can't see well in the dark and will attack a light source. My strategy won't work in the daytime. I tried that first and they attacked me as I was spraying the nest with wasp killer. The night strategy decimated them!