Burke County Coroner Lee Webster identified the woman as Amy Nicole Brown. She was pronounced dead at 4:40 p.m. at Burke County Hospital.
Sheriff Greg Coursey said county deputies and the Georgia Bureau of Investigation were trying to determine whether the death was accidental, as Brown's husband and his father told officers.
Coursey said Brown went with her husband to visit his father at his home on Greiner Circle in Burke County.
Her husband told officers he was handling a .40-caliber handgun when it discharged and shot the woman.
She was shot in her lower abdomen, the sheriff said.
Her husband's father called police between 4 and 4:30 p.m., Coursey said.
Both men were taken to the Burke County jail for questioning.
Coursey said the GBI was investigating the "very, very small room" where the shooting occurred to determine whether the evidence fits the explanation given by the two men.
Late Tuesday, Burke County Sgt. Detrick Smith said the father-in-law of the victim was released, but the victim's husband remained at the jail after telling police he was on probation for felony marijuana charges.
Coursey said Brown's body will be sent to the GBI crime lab today for an autopsy.