Skip to content

OllamaModelSettings

Constructors

new OllamaModelSettings(undefined)

new OllamaModelSettings(): OllamaModelSettings

Returns

OllamaModelSettings

Properties

f16_kv?

f16_kv?: boolean


frequency_penalty?

frequency_penalty?: number


kind

kind: "ollama"

Required. Indicates the kind of Generate AI API you’re calling.


low_vram?

low_vram?: boolean


main_gpu?

main_gpu?: number


min_p?

min_p?: number


mirostat?

mirostat?: number


mirostat_eta?

mirostat_eta?: number


mirostat_tau?

mirostat_tau?: number


num_batch?

num_batch?: number


num_ctx?

num_ctx?: number


num_gpu?

num_gpu?: number


num_keep?

num_keep?: number


num_predict?

num_predict?: number


num_thread?

num_thread?: number


numa?

numa?: boolean


penalize_newline?

penalize_newline?: boolean


presence_penalty?

presence_penalty?: number


repeat_last_n?

repeat_last_n?: number


repeat_penalty?

repeat_penalty?: number


seed?

seed?: number


stop?

stop?: string[]


temperature?

temperature?: number


tfs_z?

tfs_z?: number


top_k?

top_k?: number


top_p?

top_p?: number


typical_p?

typical_p?: number


use_mlock?

use_mlock?: boolean


use_mmap?

use_mmap?: boolean


vocab_only?

vocab_only?: boolean


Generated using typedoc-plugin-markdown and TypeDoc