Default options

[cduk]

Is there a way to set default options for a given model e.g. temperature, max tokens, etc. so you don't need to supply them each time (yet have this overrideable with the -o command line option)?

[edshamis]

+1

[Muguett-DBY]

This is now built in: llm models options was added in 0.24.

llm models options set gpt-4.1 temperature 0.2
llm models options set gpt-4.1 max_tokens 1024

llm -m gpt-4.1 'Hello'
llm -m gpt-4.1 'Hello' -o temperature 0.8

The last command uses 0.8 for that call; the saved default stays 0.2. Replace gpt-4.1 with your model ID and use options it supports.

To inspect or remove a setting:

llm models options show gpt-4.1
llm models options clear gpt-4.1 temperature

These are CLI settings, used by both prompt and chat commands. Python model.prompt() calls need their own options. See Setting default options for models.