Trend for smaller families prompts concern among locals who are outnumbered 9 to 1 by migrant population