Groups with finite outer automizers