Amazon'll still come after you for the balance, including collections. It's possible to set up billing alerts in CloudWatch - set them up at 50%, 100%, 150% and 200% of average monthly spend and it's hard to get too shocking of a surprise.