In New Mexico, De Baca County police are hunting for vandals who broke into the Fort Sumner Museum where Billy the Kid's remains are kept.
Three antique rifles and a shotgun were stolen from the museum, reported KOB-TV News.
Billy the Kid's tombstone was also vandalized, causing $2,000 worth of damage.
Police are offering a $1,000 reward for any information leading the arrest of the thieves and the safe return of the stole property.
Several other graves at the cemetery and museum were also vandalized by the thieves, reported the Daily Mail.
Born in New York City in 1859, Billy the Kid fell in love with the daughter of a Mexican-American landowner.
As he was being chased down by a Sheriff Pat Garret, he refused to leave his girlfriend's side. Garret gunned down the Billy the Kid when he was only 21-years-old.