"I Could Never Take the Place of Your Man" is a great cover. But my favorite live song is and always will be, yes, "Brave Little Soldier". It's so spirited and positive. It's one of E's best songs.
I have a great live recording if anyone hasn't heard it yet. I can share it later today.