Lawyers for Kevin Federline reportedly are building a custody case against Spears over their two young boys.
Rudolph told E! News anchor Ryan Seacrest about his dilemma via BlackBerry messages over the weekend.
Rudolph claims he's also been avoiding the tabloids and would not divulge his whereabouts except to say he was in Maui with his children recently.
Meanwhile, Spears was pulled over by the California Highway Patrol for speeding early Sunday morning, according to X-17 online. She was let off with a warning.
Also, the SPCA dropped its investigation into the treatment of one of Spears' dogs after a vet assured authorities that the dog was treated for a mild fracture after someone stepped on the pooch accidentally.