Fishing spots in Atlanta?

I recently stopped in to Thompson Park in Cobb county and noticed it had a catch and release pond. Reminded me that fishing is a childhood joy of mine. Now, I'd like to introduce my kids to it as well. But I grew up in South Florida and I don't know jack about fishing in Georgia. Let alone any ideal places to try.

Do you have any fishing spot recommendations for the metro area, especially on the east side of town? Doesn't need to be anything fancy or the world's greatest spot. Just a spot to have some good ol fishing fun.