The hall is scheduled to open in the fall of 2014 in Centennial Olympic Park.
The National Football Foundation, which runs the Hall of Fame, announced this week's groundbreaking in December.
The new site in Centennial Olympic Park is near the Georgia Dome and World Congress Center. The College Football Hall of Fame was located in South Bend, Ind., near the campus of Notre Dame, for 17 years. It closed last year.
The NFF announced three years ago that the hall was moving from Indiana, but fundraising issues forced several delays in the project.