Are you sure you aren't just hitting a part of the game where you are meeting a lot of opponents who can weaken & feeblemind? There are a few areas like this. Do you have Supplies, which allow resting/healing?
Feeblemind (ie no ability to cast spells) really messes you up in MMX due to the turn-based nature (no healing, buffing etc), and you can't run up to opponents & bash away in real time to get to a safe location. At some point you need to start carrying around large numbers of Feeblemind cures to survive