Margaret Thatcher always felt like an outsider in her party.