To me, they key to the next generation of models needs to be neurons that fire together wire together. I think spiking neural networks offer an exciting alternative approach.