Skip to content

Sessions

Sessions

Sessions are where you define model selection logic and model dispatch logic.

Model selection logic

Selection logic defines how to select the correct model for a given request using metadata and business rules.

Model dispatch logic

Dispatch logic defines how to actually execute prompts on the selected model or models.