I'll take a stab at this one. Not a transmission expert.
Sound like a synchro issue, and it is my understanding that eevery gear has its own synchro so you prob have only the one that is going bad. Transmissions are extremely complicated (at least to me) and there could be any of a number of other more mechanical problems. The problem is you may have to get some one to drop the trans and open it up to properly diagnose it, and that is going ot be expensive. I know that the guys that race the 8 (seriously, not casually) have had big problems with the 3-4 gear changes, but maybe this is related. Not much help, and sounds expensive. Hope this all works out well. Post your results, experience as you find a solution so others can learn from this. Obviously this stuff is not common knowlege. Good luck!