Police began to clear out the migrants at around 6.30am with buses lined up to away most of the migrants to a temporary transit centre outside the capital.
Later on Tuesday morning French police also cleared out two migrant camps in Calais that were located close to the Eurotunnel terminal, where many of the refugees try to board trains to the UK.
The camp in Paris, which had been set up underneath the overground Metro between the stations of Barbès and La Chapelle, was set up around eight months ago.
But in recent weeks the migrants, who were mostly men but included several women and children, were living in squalid conditions with authorities concerned about hygiene and the possible outbreak of diseases.
Authorities had put up signs over the weekend ordering the migrants to leave the camp within 48 hours and early on Tuesday morning police surrounded the site and blocked nearby traffic.
One Sudanese migrant, who asked not to be named, said that had spent Monday night at another migrant camp near the Gare du Lyon on the other side of town, and wasn't aware that this camp would be dismantled.
Police have cordoned off the entire area under the overgrown metro as they evict 350 migrants in Paris. pic.twitter.com/8EhykfpPZi— The Local France (@TheLocalFrance) June 2, 2015
The refugees, most of them from Sudan, Eritrea and Ethiopia waited to board nearby buses to be taken to various shelters in the Paris area. Around 60 of them will be fast-tracked through the asylum process, reports say.
"The camps are a risk, in terms of outbreaks of diseases and health conditions, above all for those who live there," said France's Health Minister Marisol Touraine.
"France will welcome migrants, but it must also implement policies that will allow migrants to stay in the home countries and not end up in squalid camps," she added. "France will not close its eyes. It will assume its responsibilities."
Migrants were refused entry to the camp, even to reclaim their belongings before being moved on.The makeshift campsite is now empty, except for the empty tents and litter. #lachappelle pic.twitter.com/CIEG1lqJxR
— The Local France (@TheLocalFrance) June 2, 2015
According to a survey conducted at the site last week by city authorities and refugee associations, 160 people at the camp wanted to stay in France while 200 intended to continue to other destinations, mostly the United Kingdom and Nordic countries.
“I have tried three times to get on a train to Calais, but each time the police caught me and threw me off,” 21-year-old Amanuel, from Eritrea told The Local previously.
“We try to hide in the toilets, but it's difficult. We'll try again. That's our life for the moment,” he said.
“But we hope it will get better once we reach the UK.”
So far this year, more than 40,000 migrants -- many of them fleeing conflict and poverty in countries like Libya and Eritrea -- have arrived on Italian shores and some 1,770 have perished on the hazardous journey that's often undertaken on rickety and overcrowded craft.