The inability to do this before was the lack of self-correcting sentences in the...

		petesergeant 4 months ago \| parent \| context \| favorite \| on: Why do LLMs freak out over the seahorse emoji? The inability to do this before was the lack of self-correcting sentences in the training data. Presumably new training corpuses add many more examples of self-correcting sentences / paragraphs?