One of Australia's most prominent Indigenous political figures has criticised opposition leader Peter Dutton's view that the current model of the Voice to Parliament will be elitist.

Ken Wyatt, the first Aboriginal man to be elected to the house of representatives, said that the Voice to Parliament is a grassroots endeavour, and Mr Dutton's comments were "far from the truth."

"If you read the report that Tom (Calma) and Marcia (Langton) did, if you read all the other reports, it is about local community designing their regional Voice," Mr Wyatt told ABC's 730 programme.

"…then the regional Voice selecting people they want to represent them in Canberra."

"It's not a Canberra voice. It is not elites. It is people from the grassroots…the late, great leader Mr Yunupingu…was one of my colleagues in shaping the discussions around the Voice and how Aboriginal people could become involved in this country, this economy, and in our future."

Mr Wyatt, who was speaking to the media for the first time since resigning his membership from the Liberal Party due to their opposition to the Voice, said there would be a "very limited" number of MPs in Canberra who had "sat down in the dirt" with First Nations communities.

"(These) communities themselves would say which federal members have been to see them and not see them. So, they're not being heard," he said.

Some conservative commentators have argued that there already is Indigenous representation to parliament due to several MP's identifying as First nations people, but Wyatt said this was a false analogy.

"They (Aboriginal people) cannot be represented by the 11 Indigenous people because constitutionally if you are a member of the House of Reps, you have a seat to represent. It's not just the Indigenous people of Australia."

Asked if the Liberal leadership, and particularly Peter Dutton, would have been satisfied by any wording since they also opposed the term 'May make representations,' Mr Wyatt replied "no, I don't think so."

"…from my perspective…it is the striking out of that second section of that chapter that then precludes, by practice, any Indigenous input into legislation."

Mr Dutton has previously expressed concerns about allowing the Voice to advise the executive government, but Mr Wyatt said it was imperative that the Indigenous body could speak directly to the government, likening it to the various stakeholders that lobby ministers during policy development.

"It's too late after a party room (meeting), it's too late after it's been tabled in the parliament," Mr Wyatt said.

He also attacked commentators who have said that "race" shouldn't be in the constitution.

"The Constitution has two race-based components in it. One is Section 25, the other one is Section 51.26. Section 1.27 was removed in a (1967) referendum," he said.

"So, race is in there so don't be deluded by what you're hearing, that you don't want to introduce a race-based component because it's wrong. It's a lie."

As Minister for Indigenous Australians under Scott Morrison, Ken Wyatt advocated for introducing the Voice through legislation, rather than inserting it in the constitution via a referendum. Asked if he now regretted that "pragmatism," Mr Wyatt replied: "I do, in hindsight."

He said that if the Voice failed, he would be "deeply saddened," if Australian's chose not to attempt changing the status quo of Indigenous Australians.

"I…have seen the impact of policies, programs and services, the side-lining of people, the use of Indigenous Australians to build the industries, particularly the pastoral industry of this country and farming, agriculture..."

"... because that contribution that built the foundation of our economy, our country and our way of life should be acknowledged by reciprocating and saying, yeah, we want to give you the opportunity to sit at the tables and express your views."