"We don't have any plans to release terrorists," Holder testified at a Senate hearing on the administration's budget for the Justice Department.
But he also said some of the detainees at the Guantanamo Bay, Cuba, facility will be let go as the administration believes some held there are not terrorists.
Holder faced repeated questions about his plans for closing Guantanamo. President Barack Obama has ordered the center shuttered by January 2010.
Republicans critical of Obama's plan claim Guantanamo detainees cannot legally be brought to the United States because federal law bars entry to anyone who has received terrorist training.
Sen. Richard Shelby, R-Ala., pressed Holder to say whether he believed he had the authority to release someone with terrorist training into the United States. The attorney general did not directly answer Shelby's question, but said the government doesn't have any plans to release terrorists.
"With regard to those who you would describe as terrorists, we would not bring them into this country and release them, anyone we would consider to be a terrorist," Holder said.
He added the government has no plans to release anyone considered a terrorist in a foreign country, either.
Last week in Europe, Holder said about 30 Guantanamo detainees have been approved for release. He has been asking European countries to take some, but that may be difficult if the United States doesn't also take some.
Republicans in Congress are fighting any such move, saying the presence of detainees would endanger communities that receive them.
The Democrat chairing the subcommittee hearing, Sen. Barbara Mikulski of Maryland, also voiced misgivings, saying local and state elected officials should be told if they are going to receive detainees.
Mikulski said she and other lawmakers "would be very concerned" about not being consulted on what the plans are for detainees brought to the U.S.
Holder assured her they would be consulted, but added that "determinations have not been made yet" about where to send any of the remaining Guantanamo detainees.
There are currently 241 people held at the detention center at the U.S. military base in Cuba. Holder said some will be released, some will be put on trial, and some "are going to be detained on a fairly extended basis."
Attorney General Eric Holder says the United States will not release anyone considered a terrorist into the country