check out my Medium article on how to use vLLM to serve a finetuned model(with llamafactory) via vLLM

[sepehreghdami]

hi. I published an article on how to use llamafactory, mlflow and vllm to train, monitor and deploy LLMs.

Medium link:
https://medium.com/@sep.eghdami/fine-tuning-monitoring-and-serving-a-llama-8b-instruct-llm-with-a-custom-dataset-using-5a24d6a96d18