Do you get a CEL when this happens? If so, pull the codes.
I had a problem kind of like that once and it was because I had a loose vacuum line to the MAP sensor. Under heavy boost it was coming loose at the sensor. Tie strapped it and never had it happen again.