The "college experience", however, won't be available anymore when you're no longer of a similar age as your peers there. I wouldn't have wanted to miss out on that.
Lots of people start college 2-3 years after finishing high school. That age difference is no big deal. I think many people actually benefit from taking a year or two away from school before jumping in for another 3-5 years.