I think of the context as short-term memory. If there were a way to update the weights based on the context, such that the outcomes of future queries would be influenced, things would get interesting in a hurry.