Plugins and addons

[carelesswhisp]

Hi there guys, wanted to ask if vllm has a plugin or addon repository m? Coming from oogabooga, where there's plugins for various things like deep memory and websearching to add thoae functions. I see the page for plugins on vllm but can't find anything. Is there a list? Am i also misunderstanding vllms use? Thanks.

[hmellor]

I don't know if you've seen https://docs.vllm.ai/en/latest/design/plugin_system.html, but it explains that the vLLM plugins are mainly for supporting custom models and custom devices.

They could technically be used to add capabilities like you mention, but today I am not aware of any that do.