Paul Earnest Howard Jr., 50, was taken into custody Wednesday morning, the department said in a statement.
Police released Howard's photograph on Tuesday after officials were unable to find the man, whom they had a warrant to arrest on charges including attempted rape, first-degree assault and theft.
The charges were related to an incident on Saturday when a man pushed a 98-year-old woman to the ground and attempted to rape her in her Rodgers Forge home, police said.
Tips from the public led officials to the suspect in Baltimore City, according to the statement.
"The Baltimore County Police Department would like to thank the media, the residents of Rodgers Forge and all of the other the citizens who helped us spread the word about Mr. Howard and bring him to justice," police said.
According to police, Howard has been questioned and is slated for a bail hearing sometime Wednesday.