WATCH: Biden administration officials slam their own treatment of migrants at the border

On Tuesday, Vice President Kamala Harris condemned the actions of the Border Patrol Agents, calling it "horrible," adding that the United States needs to step up to assist the nation of Haiti with basic needs.

"What I saw depicted about those individuals on horseback treating human beings the way they were is horrible. I fully support what is happening right now, which is a thorough investigation into what exactly is going on there," said Harris.

"Human beings should never be treated that way, and I am deeply troubled about it," Harris added.

Harris noted that "the whole point is that we have to understand Haiti. I mean, talk about a country that has just experienced so much tragedy that has bene about natural disasters."

"And we really have to do a lot more to recognize that as a member of the Western Hemisphere, we’ve got to support some very basic needs that the people of Haiti have to get back up," Harris added.

In an interview with CBS Tuesday morning, White House press secretary Jen Psaki said she agreed with Secretary of the Department of Homeland Security Alejandro Mayorkas, who said he was "horrified" by what he saw.

She also answered questions from reporters about the incident on Monday.

"He also felt they were horrific and horrible. I don't know anyone who could watch that video and not have that emotion," said Psaki. "Last night our Secretary of Homeland Security put out a statement conveying there'd be an investigation, that he’s going to send additional personnel. I think it's important for people to know, this is not who we are, that's not who the Biden/Harris administration is, and we're gonna absolutely pursue that investigation and get to the bottom of what happened here."

In an interview with CNN Tuesday morning, DHS Secretary Mayorkas condemned the actions of the Border Patrol agents, saying that an investigation is being conducted into their actions.

"Any mistreatment or abuse of a migrant is unacceptable, is against Border Patrol policy training and our departments values," Mayorkas told CNN. "Indeed, we have a directed investigation. That investigation is underway and it will be conducted swiftly and the public needs and deserves to know its results. I also have directed that the Office of Professional Responsibility be on site in Del Rio full time. We will not tolerate any mistreatment of an individual."

"We are very troubled by what we have seen, we are going to let the investigation unfold very, very quickly, determine the facts, and then we will take the action that is appropriate based on those facts," Mayorkas continued. "The facts will drive the conduct that we employ to hold anyone accountable for a violation of our policies."

CNN's Brianna Keilar pressed Mayorkas, stating "Okay, so I hear you saying that a horse charging near a child is not necessarily mistreatment."

"Oh, that is not at all what I have said, one cannot weaponize a horse to aggressively attack a child. That is unacceptable. That is not what our policies and our training require. Please understand, let me be quite clear. That is not acceptable. We will not tolerate mistreatment and we will address it with full force based on the facts that we learn," Mayorkas said.

This comes after many officials mistakenly tweeted that the agents were using whips on the migrants, tweeting photos of the horse riding Border Patrol agents using what actually appears to be split reins, a common feature in western horse tack.