The graffiti, which was discovered by an aide in the early morning, was placed directly over Scott's name. It included racial slurs and read, "Death to all Marxists! Foreign and domestic!"
The Democratic Georgia congressman, who is black, suggested that the swastika did not come from any of his constituents. He said he has received racist mail in recent days and is working with local and national law enforcement.
Smyrna Police Det. C. McDuffie told the Atlanta-Journal Constitution that the act will most likely be treated as a hate crime.
"We can't let racism and hate win," he said.