The alleged attack happened Thursday and the girl's mother reported it to authorities Sunday, Acworth police Capt. Wayne Dennard said.
The girl said the boys lured her into the woods behind her Acworth apartment complex, reports Rebekka Schramm of CBS affiliate WGCL-TV in Atlanta.
"And they said, let me see your breasts and I said no," the girl told Schramm. "And they said you better do it. And they had this kind of like a rope thing and he was hitting me with it and it hurt really bad."
The girl said the little boys raped her against her will.
"I feel very mad what they did to me, because I wish they didn't do this to me," the girl said.
The three boys were charged with rape, kidnapping, false imprisonment and sexual assault, Dennard said. Their names were being withheld because of their age.
Prosecutors have not decided whether to try the suspects as adults.
"They do need to be taught a lesson because if they do it to her, they could do it to somebody else," the girl's mother said. "And who knows when they become teenagers what they can do to other girls."
The father of one of the boys said his son is being accused of luring the girl into the woods.
"He's only 45 inches, 40 pounds in the third grade," the boy's father said. "This girl's in the fifth grade, she's 11 years old, 2 foot taller than him. How can my boy with a broken wrist be accused of any kidnapping charge?"
The boy's father said he believes she made up the story to cover up her promiscuity.
"She's trying to cover her own butt by getting everyone else in more serious trouble," the boy's father said. "I guess we're just going to have to see how this is going to unfold."
Acworth is 28 miles north of Atlanta in the city's fast-growing outer suburbs.