Drew Peterson turned himself in shortly after the warrant was issued.
The gun was one of 11 seized during a search of Peterson's home after Stacy Peterson disappeared in October, said his attorney, Joel Brodsky. He said police claim the rifle barrel was too short under Illinois law.
Brodsky said Peterson was still a police officer when the weapon was seized and officers are exempt from the length provision of the law. Peterson retired from the force after Stacy Peterson's disappearance.
Police are also investigating the death of his third wife, Kathleen Savio. She was found dead in a bathtub in 2004. Her death was initially ruled an accident.
After Stacy Peterson disappeared, Savio's body was exhumed and an autopsy determined she was the victim of a homicide.