I'm guessing you are talking about the old mill that used to be right off I-85 in Hart County Ga. It was located on the side of a large creek named Shoal Creek. It's been gone for many years but I remember it well.
I was too young to remember but that sounds like it - we have family all over between Atlanta and Greenville - most living in Okonee County, SC. We get together every once and awhile at Lake Lainer ... when it has enough water.