Skip to content

idea: cortex runs with model alias #1008

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
louis-menlo opened this issue Aug 11, 2024 · 1 comment
Closed

idea: cortex runs with model alias #1008

louis-menlo opened this issue Aug 11, 2024 · 1 comment
Labels
category: model management Model pull, yaml, model state P2: enhancement low impact on functionality type: feature request A new feature

Comments

@louis-menlo
Copy link
Contributor

louis-menlo commented Aug 11, 2024

Problem
I like using Cortex to run LM models on different engines, and there are also remote engines that boost my daily work. The problem is that I have to reconfigure the models from 3rd applications, that's quite tough.

I'm using Llama 3.1 as an alternative to Copilot with my IDE setup, but sometimes I want to switch to remote endpoints like Claude 3.5 Sonnet, for example. I have to go to my IDE plugin to update the model parameter, which is very unproductive.

What I want is that:
I can configure my IDE plugin with the model name copilot, then I go to Cortex and run cortex run llama3.1 copilot. Then, I can switch to another model without reconfiguring the IDE plugin by running cortex run claude-3-5-sonnet copilot, which would be very helpful.

Success Criteria
cortex run supports model aliases.

@louis-menlo louis-menlo added the type: feature request A new feature label Aug 11, 2024
@imtuyethan imtuyethan moved this to Planning in Menlo Sep 2, 2024
@freelerobot freelerobot added the P2: enhancement low impact on functionality label Sep 6, 2024
@dan-menlo dan-menlo moved this from Planning to Icebox in Menlo Sep 6, 2024
@freelerobot freelerobot added the category: model management Model pull, yaml, model state label Sep 6, 2024
@dan-menlo dan-menlo changed the title feat: cortex runs with model alias idea: cortex runs with model alias Sep 8, 2024
@louis-menlo
Copy link
Contributor Author

It's outdated. It is supported on the latest version (via import)

@github-project-automation github-project-automation bot moved this from Icebox to Review + QA in Menlo Oct 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: model management Model pull, yaml, model state P2: enhancement low impact on functionality type: feature request A new feature
Projects
Archived in project
Development

No branches or pull requests

2 participants