Leaders of the Visegrad group countries — Hungary, Poland, Slovkia and the Czech Republic — will not attend the EU summit organized by EU Commission President Jean-Claude Juncker to discuss migration policy, Hungarian Prime Minister Viktor Orban said Thursday.

"We aren't going," he said after a Visegrad group summit in Budapest.

All four Visegrad countries fiercely oppose the EU scheme from 2015 to redistribute asylum seekers across the bloc.

"We understand some countries have inner-political problems, but that must not lead to a European-wide panic," Orban said, referring to pressure German Chancellor Angela Merkel faces over asylum policy.

Polish Prime Minister Mateusz Morawiecki described Sunday's migration summit as "unacceptable", following a meeting of the Visegrad states.

"We are not going to attend, they want to re-heat a proposal that we've already rejected," he said.

Orban spoke at a meeting of the Visegrad Four along with Austrian Chancellor Sebastian Kurz, who heads an anti-immigrant government like the other four countries.