Why do you think it's the power steering pump? Are you having trouble steering (more than normal) in the morning?
My guess is that it's the idler pulley. If it goes away after a little bit, that sounds like exactly what problem I had, and at least 3 of my friends have had. relatively cheap fix.