During a conversation we want to update the System Prompt to guide the conversation more specifically. We do that using the session_settings Message.

After a new System Prompt is active we need a way to interrupt the model gracefully so it starts responding in the context of the new System Prompt. We can trigger a new response using a User Input message with little or no content, but this will not clean up the current generation and playback gracefully.

Suggestion: One way could be to have a flag in the session_settings message that signals EVI2 to gracefully clear generation and respond like a reconnect happened.

Workaround: Reconnect manually with new System Prompt and Chat Resume feature