Skip to content

roadmap: Engines are dylibs and are self-contained #1732

Closed
@freelerobot

Description

@freelerobot

Goal

  • Engines are modular and 3rd parties can add engines
  • Engine loading needs to be moved to engine repo (e.g. llamacpp-engine)
  • Engines can be registered dynamically, declaratively (e.g. .cortexrc)
  • Engines have clear and consistent interface

Tasklist

  • Refactor Engine Loading out of Cortex to engine extensions
  • .cortexrc can define engines
  • docs: how to build an Engine #1731
    • How to add a third party engine to Cortex (and Jan - optionally)
    • How to register an new engine for official distribution

PRs

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    Completed

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions