Absolutely. It's enraging. It's probably the biggest issue we're facing as a nation at the moment(population increase, low paid work, saturated job market) and we're doing nothing about it.
That said, if we had a debate, the result wouldn't matter because our agreement with the EU stops us from controlling our own country.
I quite like the open borders within Europe although I think maybe freedom of movement should be subject to more criteria whereby each country is grouped with others and freedom of movement exists for citizens between those groups of countries. The groupings can be based on geographical or economic reasons so the Belgians who work in France can still do so, the Dutch who work in Belgium etc. But that beyond that immediate area there will be criteria based immigration, not complete freedom of movement. It'll be far laxer than going to the US to work but it won't be as easy as pitching up to go to live in nation whom your country has a specific open border agreement with.
Countries would have overlapping agreements too.
Example:
Group 1: Germany, France, Belgium, Holland, UK
Group 2: Germany, France, Holland, Belgium, Italy
...so all the Germans, French, Belgians and Dutch can move around and live wherever they like, including the UK and Italy and British and Italian citizens can live in Germany, France, Holland and Belgium but there would be tighter regulations when it came to Italians moving to the UK or visa versa.