Updated at 3:15 p.m. ET
CLEVELAND In the years after his friend's daughter vanished while walking home from school, Ariel Castro handed out fliers with the 14-year-old's photo and performed music at a fundraiser held in her honor.
When neighbors gathered for a candlelight vigil just a year ago to remember the girl, Castro was there too, comforting the girl's mother.
Castro, just like everyone else in the tight-knit, mostly Puerto Rican neighborhood, seemed shaken by the 2004 disappearance of Gina DeJesus and another teenager who went missing the year before.
Now he and his brothers are in custody after a frantic 911 call led police to his run-down house, where authorities say DeJesus and two other women missing for about a decade were held captive.
Authorities have until Wednesday evening to bring charges against the men.
Two separate sources on the investigation told CBS News Wednesday that Ariel Castro is the focus of the investigation.
While the investigation remains ongoing, there doesn't appear to be any evidence at this time that Castro's brothers - Pedro Castro, 54, and Onil Castro, 50 - were involved in the abuse or abduction of the three victims, the sources told CBS News.
Those women - Amanda Berry, 27, Michelle Knight, 32, and DeJesus, 23 - never left the house the entire time they were held captive, the sources said.
On "CBS This Morning" Wednesday, CBS News correspondent Dean Reynolds reports that a clearer picture has emerged of what went on inside the house.
Police Chief Michael McGrath told Reynolds that the three victims spent much of their captivity on the second floor of Castro's house and that ropes, chains and padlocks were found on the premises.
Sources told CBS News that the women were all restrained for at least part of their decade-long captivity.
CBS Cleveland affiliate WOIO-TV reports that one woman told police she had gotten pregnant more than once but her captor beat her and she ended up losing the babies.
Ariel Castro's son, Anthony Castro, said in an interview with London's Daily Mail newspaper that he now speaks with his father just a few times a year and seldom visited his house. He said on his last visit, two weeks ago, his father wouldn't let him inside.
"The house was always locked," he said. "There were places we could never go. There were locks on the basement. Locks on the attic. Locks on the garage."
The women had apparently been held captive in the house since their teens or early 20s, police said.
Berry went to her sister's home Wednesday morning. Shortly after, her sister Beth Serrano thanked everyone for their effort and support over the years, adding "please respect our privacy until we are ready to make our statement, and thank you."
As word of Berry's homecoming spread, a large crowd swelled in the street outside the home decorated with dozens of balloons, and homemade signs, one reading "We Never Lost Hope Mandy."
DeJesus, who disappeared in 2004, also arrived home Wednesday afternoon to chants of "Gina! Gina!" Wearing a bright hooded shirt, DeJesus was escorted into her home by a woman with her arm around her.
A Cleveland hospital says Knight is now in good condition. On Tuesday, Metro Health Medical Center had said Knight had been released. On Wednesday, a hospital spokeswoman said Knight was in good condition at the hospital. It's not clear whether Knight was readmitted or if she actually never left the hospital.
A 6-year-old girl believed to be Berry's daughter also was found in the home Monday, police Deputy Chief Ed Tomba said. He wouldn't say who the father was.
About a week ago, Castro took the 6-year-old girl to a nearby park, where they played in the grass, said Israel Lugo, a neighbor who lives down the street. "I asked him whose kid was it, and he told me his girlfriend's daughter," Lugo said.
The women were reunited with joyous family members Tuesday. They were rescued after Berry kicked out the bottom portion of a locked screen door and used a neighbor's telephone to call 911. An officer showed up minutes later and Berry ran out and threw her arms around the officer, a neighbor said.
Police identified the other two suspects as the 52-year-old Castro's brothers. Calls to the jail went unanswered, and there was no response to interview requests sent to police, the jail and city officials.
A relative of the three brothers said their family was "totally shocked" after hearing about the missing women being found at the home.
Juan Alicea said the arrests of his wife's brothers had left relatives "as blindsided as anyone else" in their community. He said he hadn't been to the home of his brother-in-law Ariel Castro since the early 1990s but had eaten dinner with Castro at a different brother's house shortly before the arrests were made Monday.
Police would not say how the women were taken captive or whether they were sexually assaulted.
McGrath told NBC's "Today" show on Wednesday that the women were restrained and "released out in the back yard once in a while."
McGrath said he was "absolutely" sure police did everything they could to find the women over the years. He disputed claims by neighbors that officers had been called to the house before for suspicious circumstances. "We have no record of those calls coming in over the past 10 years," he said.
Investigators also are talking with relatives of at least one other missing woman from the neighborhood.
The aunt of a 14-year-old girl who disappeared in 2007 near the house where the missing women were found says the girl's mother has spoken with the FBI about her niece.
"We're hoping for our miracle too," said Debra Summers, who described her niece, Ashley Summers, as not the type of girl who would leave without coming back.
Ariel Castro owned the home where the three girls were found in a neighborhood dotted with boarded-up houses just south of downtown.
Anthony Castro, who lives in Columbus, also wrote an article for a community newspaper in Cleveland about the disappearance of Gina DeJesus just weeks after she went missing, when he was a college journalism student.
"That I wrote about this nearly 10 years ago to find out that it is now so close to my family it's unspeakable," he told The Plain Dealer newspaper.
Most everyone in the neighborhood knew Ariel Castro.
Neighbors say he played bass guitar in salsa and merengue bands and gave neighborhood children rides on his motorcycle.
Tito DeJesus, an uncle of Gina DeJesus, played in bands with Castro over the last 20 years. He recalled visiting Castro's house but never noticing anything out of the ordinary.
Juan Perez, who lives two doors down from the house, said Castro was always happy and respectful. "He gained trust with the kids and with the parents. You can only do that if you're nice," Perez said.
Castro also worked until recently as a school bus driver.