Skip to content

Model matching and costing with litellm proxy #587

Description

@zv-i

Issue

There is this issue already logged for aider: Aider-AI#3323

When having multiple models from different providers sitting on a litellm proxy we have to use the openai api. At the moment with cecli (and aider) I have to maintain a .cecli.model.settings.yml and .cecli.model.metadata.json file in order to map the names of the models because of the need for an openai prefix.

For example with gemini I have to do this in that model settings file:
"openai/gemini/gemini-3.5-flash": {
"max_tokens": 65535,
"max_input_tokens": 1048576,
...
}

Is there some feature in cecli that can resolve this automatically? Is there scope for looking into a code contribution to help with this?
Ideally this should be in upstream, but there seems to be no appetite for it, leading to cecli's existence. While I could use a script to do this, in a team setup it creates an extra point of friction.

Version and model info

cecli 0.100.8
various models: gemini, anthropic

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions