Allow backend API to send session_settings messages to keep prompts confidential
R
Roman Kupkovic
Currently, only being able to update the settings of a live session/connection over the frontend client means making the prompts used visible to the user.
If we have sensitive business logic related prompts and actions we use for steering the hume conversation we might want to apply those without the user client knowing.
This could be solved with some form of hook or proxy, I am not sure. But it would greatly benefit bigger production projects that rely on their business logic being not easy to instantly copy.
R
Roman Kupkovic
UPDATE:
This can be made possible by having the session_settings message type accept an object (to reference a stored Hume prompt ID) for the system prompt (instead of just a string), same as with the config definition.