David Seymour's refusing to apologise for a comment about blowing up the Ministry for Pacific Peoples - saying he makes jokes like that all the time.
But Newshub can reveal one person found it so offensive, they referred him to Police.
David Seymour is not a sorry man.
"People shouldn't have to apologise for having a laugh," he said.
The ACT leader loves having a laugh at himself and about blowing up ministries.
"It's a joke I've made many times about many government departments," he said.
His latest joke's about the Ministry for Pacific Peoples. On Thursday Seymour told Newstalk ZB he would abolish it, partly because it spent $40,000 on a farewell party.
"In my fantasy, we'd send a guy called Guy Fawkes in there and it'd be all over, but we'll probably have to have a more formal approach than that," he said.
"He should be apologising for a lot of things - this is just one of many things he should apologise for," said Labour MP Carmel Sepuloni.
"I don't find it funny. This sort of joke is unacceptable. He should apologise to the Ministry for Pacific Peoples and he should apologise to Pacific communities," added Green Party MP Teanau Tuiono.
But Seymour said: "You're politicising comments I've made about many different departments many times and no one's ever noticed before."
Newshub can reveal someone was so concerned about his comment they reported Seymour to the police.
Police told us they assessed the comments, but did not identify any offence, and are not taking the matter further.
"No harm was intended, no harm was done. We don't want to live in a country where you have to walk on eggshells because people politicise a joke," Seymour said.
Seymour himself though has called for an apology over a joke made by Te Pati Māori co-leader Rawiri Waititi and his necklace poison berries.
"When David Seymour's not looking I'm going to go like this into his water. I'll tell you what, reindigenise yourself with some native seeds," Waititi said.
Seymour told Stuff: "I'm genuinely concerned the next step is that some slightly more radical person doesn't think it's a joke."
"My offence was at the racial overtones where he said indigenise yourself. The comments I made were about a government department wasting money hand over fist," Seymour told Newshub.
ACT has been driving the prosecution against the Ministry for Pacific Peoples' spending, like its $40,000 leaving bash for its former chief executive.
On Thursday morning - before Seymour joked about blowing it up - two men went into the ministry and tried to film staff while asking them about how much the ministry was spending. Police were called.
"He is the leader of a political party and there are people on the far right who look to him for leadership so it is important that he sends the right signals to his followers and in particular those far right followers, that his comments were unacceptable," Tuiono said.
"Usually they provoke laughter but in the current world they're provoking a media beat-up but I think people will see that for what it is," Seymour said.
But clearly not everyone sees the funny side.
