I didn't find the Superior Temple of Baa particularly difficult, but I've never played the game the way you're doing it, so I've never done it at a low level. In fact, I've probably never done it at an intermediate level, either.

The two places in MM6 whose layout I never completely learned were the Temple of Varn and the Hall of the Fire Lord. But learning Castle Darkmoor was a struggle, I have to say. I could never remember where the switch was that gave access to the last hall, and I used to blunder around until I found it. It took ages before I learned the route up that narrow incline along the wall, and how to get to it.