Revamp Inference Providers doc #1652
Conversation
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
| | User Tier | Included monthly credits | | ||
| | ------------------------ | ---------------------------------- | | ||
| | Free Users | subject to change, less than $0.10 | | ||
| | PRO and Enterprise Users | $2.00 | |
There was a problem hiding this comment.
it would be great to have a third column with an estimation on how much I can generate (might be hard)
There was a problem hiding this comment.
deleted since duplicate of chat-completion.md
docs/api-inference/index.md
Outdated
|
|
||
| **Instant Access to thousands of ML Models for Fast Prototyping** | ||
| The Hugging Face Inference Providers API revolutionizes how developers access and run machine learning models by offering a unified, flexible interface to multiple serverless inference providers. This new approach extends our previous Serverless Inference API, providing more models, increased performances and better reliability thanks to our awesome partners. |
There was a problem hiding this comment.
add nice visual of all providers
There was a problem hiding this comment.
yes @ChunTeLee did something nice
Co-authored-by: Julien Chaumond <[email protected]>
Co-authored-by: Julien Chaumond <[email protected]>
Co-authored-by: Julien Chaumond <[email protected]>
…ingface/hub-docs into refacto-for-inference-providers-doc
Co-authored-by: Julien Chaumond <[email protected]>
…uggingface/hub-docs into refacto-for-inference-providers-doc
|
Valuable feedback, thanks for taking the time Ben! ❤️ |
Co-authored-by: burtenshaw <[email protected]>
| print(response.json()["choices"][0]["message"]) | ||
| ``` | ||
|
|
||
| For convenience, the Python library `huggingface_hub` provides an [`InferenceClient`](https://huggingface.co/docs/huggingface_hub/guides/inference) that handles inference for you. Make sure to install it with `pip install huggingface_hub`. |
There was a problem hiding this comment.
would it make sense to add an openai snippet too or is it a hassle because of the mapping thingy?
A lot of people use the openai package would be great to figure out a way to showcase that.
There was a problem hiding this comment.
there will be openai snippets for both Python and JS in individual tasks page (e.g. in chat-completion). This is done in a separate PR: #1643
There was a problem hiding this comment.
but I don't think we'll feature it on the landing page, there are already many snippets on that page
Co-authored-by: Pierric Cistac <[email protected]>
Co-authored-by: Victor Muštar <[email protected]>
Co-authored-by: Victor Muštar <[email protected]>
|
Thanks for the reviews! I just merged it and created #1662 to list remaining items :) |
Main pages to look at:
TODO list: