Only a few of the golems attacked me on my first visit to Bracada. No attacks on later visits, even after the area reset.