When using an EVI with a custom language model there is no way the limit the chat history. Long conversation sessions result message payloads that overwhelm AWS API Gateway max message size for websocket.

It should be possible to specify a maximum chat history length. We manage history ourselves in our custom LLM, so we would set this max length value to 0. The expectation is that it would only send the latest user input with each new message.