Model Registry

The Model Registry keeps track of all the ModelSpecifications you want your Sessions to use along with metadata that you can use in your selection logic to find the right model for a given request.

Registering a model

Use the register-model command to register a ModelSpecification contained in a json file against a key.

$ roli register-model my-service -k my-key -m /path/to/my/model-file.json

getModel

Use the getModel("my-key") function within a Session method to get the registered ModelSpecification at runtime.

Unregistering a model

Use the unregister-model command to delete a ModelSpecification registration by its key.

$ roli unregister-model my-service -k my-key

List available models

Use the list-models command to see what ModelSpecifications and keys have been registered for a given service.

$ roli list-models my-service

Inspect a model registration

Use the get-model command to see the contents of a ModelSpecification registered with a given key.

$ roli get-model my-service -k my-key