The "low audio quality after/during conference" problem as I understand it is because of the SCO codec used for Bluetooth microphone stuff (which is lower bandwidth but allows you to speak and listen at the same time). It takes a few seconds for the AirPods to switch back to their usual codec.
Is there a way to fix this without ditching Bluetooth?
Get a headset that has Faststream or bidirectional APTX-LL A2DP vendor codec, and use it with BT stack that implements these codecs (e.g. Linux/Pipewire). Such devices are very hard to find, and aptx-ll in most devices is not bidirectional. I know only some headsets by Avantree that have it.
Or, wait for a few years for Bluetooth 5.2 LE Audio be available in consumer devices.
I have the same issue with Samsung earbuds on Linux. My solution was to get a nice webcam with a solid camera, or to use an external mic. Win-win -- good quality sound, video, and mic.
Is there a way to fix this without ditching Bluetooth?