James Alvin Burke, 55, of Lynda Drive in Millen, was charged with misdemeanor sexual battery, according to a jail official at the Jenkins County Sheriff's Office where he was booked about 10:30 a.m.
Mr. Burke bonded out of jail about an hour later with a $1,000 property bond, the jailer said.
Millen Police Chief Dwayne Herrington said the case was still under investigation and he could not release details until possibly next week.
"We just don't want to make any mistakes," he said.
Pete Mills, the hospital's chief executive officer, confirmed this afternoon that Mr. Burke resigned as hospital administrator, effective Thursday.
Mr. Mills also said he was limited in the what he could say, but said the incident involved a female employee.
Mr. Burke was second-in-command at the 25-bed, critical-access hospital and reported to Mr. Mills.
Mr. Burke has been employed at the hospital for at least 10 years, Mr. Mills said.
The hospital is located at 931 East Winthrop Ave. in Millen.