Big Wasp Nest

Opening the pump house door disturbed a wasp nest and elicited a very angry response from them. I was able to escape without stings, but only because I am so fleet of foot, and had good luck. In the evening I went out with a can of wasp spray and let them have it while they were settled in for the night. The next morning I opened the door, found one lingering wasp, sprayed it, and pulled the nest down. I laid the nest on a bench under the oak and forgot it. A few days later I noticed the nest was torn all apart. I wondered if squirrels were after the larvae in the nest, or if their motive was not food, but revenge. Or could it have been those chipmunks?