in my experience, a good free flowing exhaust is always good, but with a turbocharger there is a limit to how big you can go, to see any gains... it has to do with the size of the turbo, as that is the big restrictive force in the system. you can keep going to 4" if you like, but it isn't going to gain you anything else from the exhaust system until you start swapping out turbos...
keep in mind, there is a big difference in 'back-pressure', and 'restriction'
a slight back-pressure isn't going to bother one on the power end... i've heard (though all of this info is voodoo, imho) that turbos like a touch of back-pressure as it gives the turbo something to push against. and evens out the spool up.
now this is all from V8 racing style turbo guys and the set-ups i watched/helped put together.... no converters, no CELs to worry about... carbed and fuel injected...
in turbocharged engines, you are looking to eliminate 'overlap' or the small amount of time the exhaust and intake valves are open at the same time... the cams they were using in these engines were very mild. not much overlap, and not much lift compared to what we were running as roller-cams in our N/A cars. if you put a radical high lift turbo cam in a boosted V8, and you better have had a good cooling system, ignition timing had to be dead on, and you ran AV gas in it. they also ran low compression pistons, and forged or billet EVERYTHING.
intake timing on heavy boosted cars is critical as well, as the boost coming back from the exhaust side can blow your incoming charge back through the intake! one can only imagine what that could be like (i did see what a nasty intake backfire could do to a turbine). a N/A engine, the goal is to keep the air moving through the combustion chamber, using the exhaust exit to keep the intake charge headed into the cylinder..... in a turbo engine, the goal is to isolate the intake from the exhaust side, to keep from losing boost pressure, as well as keeping the exhaust heading in one direction.....