Updated at 1:44 pm ET

The White House is defending President Trump's choice to head the Department of Veterans Affairs, even as questions swirl around the nominee, White House physician Dr. Ronny Jackson.

"Dr. Jackson deserves a fair hearing and we are not going to write him off in any way before his hearing, and quite frankly neither should members of Congress," White House spokesman Hogan Gidley told Rachel Martin on NPR's Morning Edition Wednesday.

Gidley said the FBI background investigation into Jackson "was clean and there are no issues in the background check whatsoever."

His confirmation hearing, originally scheduled for Wednesday, was indefinitely postponed. And even as Trump defended his nominee, he suggested Jackson might prefer to withdraw.

"What do you need it for?" Trump said he told Jackson Tuesday. "I don't want to put a man through a process like this. It's too ugly and too disgusting."

Jackson, a Navy admiral who has served as personal physician to both Trump and former President Obama, was already facing tough questions about whether he had the managerial experience to lead the VA.

Then, late last week, complaints surfaced about Jackson being drunk on duty during foreign trips, improperly dispensing prescription medication, and overseeing a hostile work environment in the White House medical unit, according to Sen. John Tester, D-Mont., the ranking Democrat on the Senate Committee on Veterans' Affairs.

The complaints came from 20 active duty and retired military personnel who had worked for Jackson, Tester said.

"There's a lot of smoke there," Tester told All Things Considered about the as-yet-unsubstantiated allegations.

Sen. Mazie Hirono, D-Hawaii and another Veterans Committee member told Steve Inskeep on Morning Edition that "what's concerning for this committee is the kind of information that has come forward and we need to find out more about his ability to handle the second largest agency in the entire government."

Sen. Jerry Moran, a Kansas Republican on the Veterans' Affairs Committee, has said Jackson denied ever having a drink while on duty. Reporters caught up with Jackson on Capitol Hill Tuesday on his way to Moran's office.

"I was looking forward to the hearing," Jackson said in video captured by MSNBC. "Kind of disappointed that it's been postponed, but I'm looking forward to getting it rescheduled and answering everybody's questions."

Asked whether he "categorically denied" the allegations against him, he said, "I'm looking forward to the hearings, so we can sit down and I can explain everything to everyone and answer all the senators' questions."

Veterans' Affairs Committee Chairman Johnny Isakson, R-Ga., and Tester sent a letter to Trump on Tuesday requesting additional documentation related to Jackson's tenure as the president's doctor and his role leading the White House medical team.

The letter requested information about rumored Pentagon inspector general reports said to detail allegations into Jackson's conduct.

The White House says Jackson has never been the subject of an Inspector General's report, and pointed to glowing performance reviews he received from both Trump and Obama.

"Ronny's positive impact cannot be overstated," Obama wrote in 2015. "He is a tremendous asset to the entire White House team."

Trump echoed that sentiment last year, writing "Dr. Jackson is a great doctor + leader — 2 star material," in bold sharpie.

Jackson has served in the medical unit since 2006, caring for three presidents. He specializes in emergency medicine and served with a battlefield surgical unit in Iraq.

An administration official suggested the complaints may be fallout from Jackson's rivalry with another doctor in the White House Medical Unit dating back to 2012.

The rivalry between Jackson and Dr. Jeffrey Kuhlman prompted a "command climate assessment" of the medical unit that year, which found low morale.

"The staff characterized the working environment as being caught between parents going through a bitter divorce with one parent undermining and talking bad about the other," according to a report of the findings.

The White House says it was Jackson who requested that assessment and hinted Kuhlman is behind the more recent complaints. Jackson "will certainly not be railroaded by a bitter ex-colleague who was removed from his job," said a White House statement.

Trump caught many observers off guard when he picked Jackson to replace ousted VA Secretary David Shulkin. Unlike Shulkin, who had managed a large medical organization before joining the VA, Jackson has never overseen more than 75 people.

"I know there's an experience problem because of lack of experience," Trump admitted Tuesday. "But he is a man who has just been an extraordinary person. His family, extraordinary success. Great doctor. Great everything."

Administration spokesman Gidley said "the question is does anyone ever have management experience for an organization this size."

Jackson is also a blank slate on one of the key policy questions facing the VA: what role the private sector should play in providing veterans health care. Many of the large veterans service organizations are wary of what they see as a push towards privatization. Shulkin complained that he was fired, in part, for resisting that push.

Trump insisted he would stand behind his nominee, even as he suggested the political battle might not be worth it.

"I wouldn't do it," Trump also said Tuesday. " What does he need it for? To be abused by a bunch of politicians that aren't thinking nicely about our country? I really don't think, personally, he should do it. But it's totally his — I would stand behind him — totally his decision."

The president met Tuesday in the Oval Office with Jackson, a White House official confirmed to NPR.

The official, who declined to speak on the record, said Jackson wants to keep fighting and that Trump supports his decision.

Former Obama administration staffers also defended Jackson's character, even as they questioned whether he is the right choice for the VA job. One former Obama staffer who spent a lot of time around Jackson on official trips said he had never seen evidence that Jackson drank while on duty. The former staffer confirmed that Jackson and other White House doctors provided Ambien, a sleep medication, when staffers requested them while on overnight flights to Europe and Asia.

Copyright 2018 NPR. To see more, visit http://www.npr.org/.