The column images can be tagged with samples from an onboard gyro and compass. The stitcher does not need to rely only on the pixels themselves. Normally the next pass will be pointing a little higher or lower, so such annotations will be essential.
Gyro? Relying on just angular velocities doesn't provide any good tags. You probably mean accelerometer or a combination of these referred to as IMU.
And even then, the raw data of these sensors are extremely noisy, so you need something like an EKF to get a more reliable attitude of the drone. THIS can actually be used to tag photos.
If "onboard gyro and compass" means something to you substantially different from an IMU+EKF system, it makes me wonder what century you are talking about.
My comment was about tagging pixel column data with non-optical measurements. Spewing alphabet soup fails to add clarity, and does not even make you look smarter.
Given adequate bandwidth, EKF can be better applied at the receiver, where more computational power is available.
Alphabet soup? Sorry, but nothing that you say makes any sense and I politely corrected you regarding the extremely stupid idea to tag any raw sensor informations. Your new proposal of streaming this kind of data to an offboard processor just proves that you have zero dot zero zero experience about what you are talking about.
