According to the documents, investigators also say Anthony Saxon, 34, sent a warning text message to his wife shortly after being arrested by military police on post Tuesday. His wife told law enforcement that her husband's message advised her to remove firearms from their home.
ATF investigators revealed Saxon was convicted of grand theft in Seminole County, Fla., on May 9, 1996, in a case that involved the same weapon found in his bedroom, according to court documents.
He is accused of transporting the stolen rifle from Florida to Keysville, which is a federal offense, according to the documents.
A Grovetown business owner told investigators he believed Saxon stole the silencer from his store, Blakenship Custom Firearm, late last year. Paul Blakenship reported the silencer stolen Jan. 13. He said he recalls seeing Saxon inside his store in late 2009.
During the search of Saxon's home, investigators also uncovered a .12-gauge shotgun and .22-caliber pistol, along with 54 rounds of .22-caliber ammunition in the wooded area behind the home, agents said. Five training grenades also were found in the home, agents said.
Saxon was arrested Tuesday after military police found a bag in his vehicle containing stun grenades, a land mine and an infrared laser sight.
Authorities said a tipster recognized his vehicle from a theft of military equipment in April, which led to officers searching his car.
It is still unclear whether the former Army National Guardsman worked at the fort.
Federal agents transferred Saxon on Thursday from the Richmond County Jail to the Jefferson County Jail in Louisville, Ga.