I would check the waste gate actuator. They're a known common problem. They will stick, sometimes open, in your case closed, and it hinders or completely eliminates its ability to hold a constant boost. If I let my car sit for more than a couple weeks, it will do real screwy things when I take it for a drive, as mine tends to stick as well. Sometimes lubricating it will help, otherwise it's like $400 for a new OEM one, or $600 for a new turbo entirely. This is just off of my own brief research, someone else might be able to chime in with better advice.