Just to follow up, I jacked the car up and checked things out. Noticed the rear axle was pulled out of the differential. After a little searching it looks like this is a common problem. To fix it I just pounded on the wheel hub side of the axle shaft until the axle was locked back into the retaining clip inside the diff. Has me nervous as to why it came out in the first place though. Hopefully it stays put now.