If the problem with SICP (with both authors teaching it) was that too many people were failing out, I would expect they would have mentioned that.

The Harvard course welcomes non-majors and is part of a liberal education, it's not comparable to an introductory course for majors at a competitive engineering school.