As a Protestant growing up in Catholic Ireland, Graham Norton sometimes felt that he and his family were made to feel like foreigners in their own country.