“men who themselves in their youth left this country in order to find their fortunes in our possessions abroad.”