One in seven primary school pupils do not have English as their first language.
The increased figure has prompted Tory immigration spokesman Damian Green to demand an annual limit on immigration.
He said the increase is making life difficult for teachers and parents. The Government said it is trying to "bring students weak in English up to speed".
According to reports, figures uncovered by Mr Green show 565,888 primary school children do not use English as their first language - an increase of more than 25% since 2004 (452,388).
In some areas, more than 70% of four to 11-year-olds do not have English as their first language.
And in secondary schools, 10.6% of pupils normally speak a foreign language - up from 8.8% in 2004.
Mr Green said: "The shocking figures show why we need an annual limit on immigration.
"The number of pupils with English as a second language makes life difficult for teachers, parents and pupils."
The Department for Children, Schools and Families (DCSF) said a "comprehensive support package" was available for new arrivals.
A DCSF spokesman said: "The language of instruction in English schools is and always has been English. We have listened to concerns of headteachers and are increasing funding in the Ethnic Minority Achievement Grant to £206 million by 2010 to bring students weak in English up to speed."
