I've had single bees chase me for a quarter of a mile, in a rise and divebomb fashion. So, no they all aren't so passive. I've also been terrorised by horseflies on occassion. They have this erratic circling pattern and love to buzz by your head like a bullet- a hairy ugly toungestabby blooddrinky bullet.
FUCK horseflies. Yellow Jackets are pretty awesome though. I used to let them eat jelly off my hands when I was a kid.