Three venues PROMINENTLY mentioned in the the thread are the Rose Bowl stadium, the old Orange Bowl stadium (long gone) in Miami, and Fenway Park.
The worst CFB stadium I ever went to was probably the "old Cotton Bowl" stadium here in Dallas for our game against Texas Tech in January 2006. It opened in 1930, I had to park miles from where I was going in for the game, and on top of that, the inside of a sardine can would have been more comfortable. Scott Field (at MSU) was a high school stadium with cowbells though, as I noted earlier, Davis-Wade is a much more respectable venue.
Btw.....my first Tide game was the 1995 Ole Miss game in Vaught-Hemingway, and let me say this - it is a MASSIVELY overrated "pregame atmosphere," and the stadium itself.....well, I'm seated at the five-yard line about halfway up, and the seats point almost straight ahead so good luck seeing anything beyond the forty in the opposite direction.
The worst venue across sports that I've seen a contest in was, quite frankly, Fenway Park. Yeah, it's history. If you're a baseball fan, you have to go once and stop to realize exactly who all has played in this site - including Red Sox pitcher Babe Ruth before he was a famous slugger or famous Yankee. Remember that this stadium opened five years before President Kennedy was even born (his father-in-law threw out the first ball for the first game - he was mayor), two years before World War ONE.
And it feels about like it. There are some seats there that point in the wrong direction (center field), so you have to look sorta sideways to see home plate. And they're expensive, too, for a stadium that twice drew fewer than 500 fans to games in September 1965. It's fun to go - once.
BAD VENUE NOTES
Oakland-Alameda County Coliseum - one of those cookie cutter stadiums from the 60s for both football and baseball; better built for football.
Atlanta Fulton County Stadium - will always have a place in my heart because my grandfather and Dad took me to my first ballgame there. But despite all the 1991 efforts at upgrading, the thing always smelled like someone wizzed everywhere. It also felt "far away" from the action.
Jerry World - is like being in a cavernous tin can far from the action where you're expected to watch TV after paying a month's salary just to park your vehicle. The bands for both Alabama and Michigan sounded like I was listening to a Christmas parade nine blocks over.
Amon Carter (TCU) - has probably improved after the upgrades but was a high school stadium with no wind resistance for the Armed Forces Bowls I attended there.