A service keeps no session data in its own memory between requests, so any instance can serve any request. State lives in a database or cache.
You have done this if
You moved conversation history out of the server process into Redis so you could run more than one instance.
Say it in a review
API instances are stateless; conversation state lives in the memory store, keyed by session.
On the AI Application map API Gateway, Memory
Read Four kinds of agent state, and only one of them is memory