It's my understanding that it's not possible to opt out of all VS Code telemetry. There are some kinds exposed in the settings page that can be disable.

> I doubt it slows down builds

But we don't really know, do we? Speculation isn't helpful.