My local, neighborhood locksmith who I see at my corner bar says there is a real danger of those guys coming back and breaking into your place, now that they know everything about your locks.
This guy took 2+ hours to open the door, so I'm not really worried about him specifically. That said, I did change out locks myself later on, although I'm sure if someone wants in, they'll just bust the window...