The agents had removed his handcuffs and were about to take him onto a plane when he took off running.
Port Authority police could not immediately provide a description of the suspect.
Ireland expels Russian diplomat
Russia's Ambassador to Ireland Yury Filatov has been told one of his staff must "leave the jurisdiction". Russian Federation denies responsibility and has vowed a "tough response" to the expulsions.
The report said that these deportations have not been getting much attention because Trump's immigration focus has been on building a wall with Mexico and deporting Latin American immigrants.
Mbacke was last spotted wearing a black or purple shirt, jeans, and sneakers. He is 6 feet 3 inches and weighs about 190 pounds. Mbacke ran away from the ICE agents escorting him at Terminal 4, Gate B23.
He has previous criminal convictions for multiple weapons and firearms offenses.
Officials say they caught the man on surveillance video climbing into a taxi. ICE along with state, federal and local authorities are now actively seeking his whereabouts.