Brandon Lewis has refused to say when the Tories’ European election campaign will launch, saying his priority is not to have to fight them at all.
The UK is due to elect new MEPs on 23 May, after Brexit was delayed amid continuing parliamentary deadlock.
Several parties have launched their campaigns already but Conservative chair Mr Lewis told the BBC his focus was on next week’s local elections.
This means the UK must now hold European Parliament elections on 23 May if it wants to avoid leaving the EU without a deal.
The UK is due to leave the EU on 31 October, or sooner if a deal is agreed.
But if agreement can be reached among MPs before 22 May, the UK could cancel its participation in the elections.
The Lib Dems launched their campaign on Friday with a pledge to do what they can to stop Brexit altogether.
Nigel Farage’s Brexit Party and pro-Remain party Change UK’s have also launched their European election campaigns.
Labour’s NEC is due to meet on Tuesday to decide on its manifesto for the campaign.
But asked about Conservative campaign plans on BBC One’s Andrew Marr Show, Mr Lewis said: “As a government, our first priority is to not have to fight the EU elections.
“I think we should be doing everything we can to respect that 2016 referendum, if and when we are at the point where we are definitely fighting those EU elections then we will take some decisions about that.”
He said there was “still time” for the UK Parliament to approve the withdrawal agreement – which it has so far rejected three times – in time so the UK could leave the EU and would not have to take part in the elections at all.
“They have to be legislated because of the timetable, but there is still the possibility for parliament to approve the Withdrawal Agreement so we don’t have to have those EU elections.”
But on Sky News, Labour frontbencher Rebecca Long-Bailey said the government was still refusing to move on “any of their red lines” in cross-party talks aimed at reaching an agreement on Brexit.
She said: “Honestly I think the discussions so far have been productive, they’ve gone into a lot of detail, there seems to be a willingness on both sides to move towards some form of consensus.
“But as yet we haven’t seen the government move on any of their red lines, we’re having further discussions this week and hopefully we’ll see some movement.”
At the end of March, Prime Minister Theresa May said the public would find it “unacceptable” to have to elect a new group of 73 MEPs almost three years after they voted to leave the EU.
But earlier this month, she agreed a Brexit delay to 31 October with the EU, with the option of leaving earlier if her withdrawal agreement is approved by Parliament.