since you say it would "downshift" on it's own, I'm assuming an automatic. Were you driving along on the highway and then the rpms went up, but speed went down? felt like no power, like the engine was running faster than it should for the speed you were going, almost like driving on ice? If you shut off the engine and restart, does it go away? Does it do this when it is hot, or when you hit the highway after a long stop-an-go city drive? If so, sounds like the same issue I had with a torque convert clutch slipping caused by a worn valve body in the tranny. Definitely worse when hot and fairly intermittent. It could also be "limp-mode" from a variety of reasons, hard to tell from your description. CoolAirVW is the guru on this. He rebuilt my VB 30K ago and no issues since.
To have him rebuild the VB it needs to be shipped to him, so it needs to come out of the tranny. easy access, a little tricky to remove the electronics ribbon cable. A good mechanic should be able to handle this if you aren't mech-inclined. He has a good write-up on his website (search Kansas City TDI). I have no personal experience with any other VB rebuilders or sellers, but the feedback on this forum strongly points to CoolairVW.