Determine what backends are going to be loaded at runtime #12821
Answered
by
slaren
CommanderLake
asked this question in
Q&A
-
I have a situation where the backend may or may not be CUDA and the host OS may not have CUDA available so when my C++ DLL which uses llama.cpp gets loaded the program may crash so i need to somehow determine what backend is about to be loaded and stop it loading if it cant be used, how do i do solve this? |
Beta Was this translation helpful? Give feedback.
Answered by
slaren
Apr 9, 2025
Replies: 1 comment
-
You can build with |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
CommanderLake
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
You can build with
GGML_BACKEND_DL
to make the backends dynamically loadable. Useggml_backend_load
orggml_backend_load_all
to load the backends at runtime.