Car sways side to side when hitting bumps on the road?

I can manage corners fine, but the back end does feel like it swings out some. When I hit a decent sized bump in the road the rear end wags back and forth. I'm guessing something with the sway bar?