Skip to content

Commit 4a799d6

Browse files
committed
fix
1 parent ebd7d9e commit 4a799d6

File tree

7 files changed

+40
-62
lines changed

7 files changed

+40
-62
lines changed

Diff for: imgs/01/02/03/aifoundry_home.png

2.81 MB
Loading

Diff for: md/01.Introduction/01/01.AISafety.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -46,15 +46,15 @@ Developers should apply responsible AI best practices and are responsible for en
4646

4747
After fine-tuning a model, we highly recommend leveraging [Azure AI Content Safety](https://learn.microsoft.com/azure/ai-services/content-safety/overview) measures to monitor the content generated by the models, identify and block potential risks, threats, and quality issues.
4848

49-
![Phi3AISafety](../../../imgs/01/01.phi3aisafety.png)
49+
![Phi3AISafety](../../../imgs/01/01/01.phi3aisafety.png)
5050

5151
[Azure AI Content Safety](https://learn.microsoft.com/azure/ai-services/content-safety/overview) supports both text and image content. It can be deployed in the cloud, disconnected containers, and on edge/embedded devices.
5252

5353
## Overview of Azure AI Content Safety
5454

5555
Azure AI Content Safety is not a one-size-fits-all solution; it can be customized to align with businesses’ specific policies. Additionally, its multi-lingual models enable it to understand multiple languages simultaneously.
5656

57-
![AIContentSafety](../../../imgs/01/01.AIcontentsafety.png)
57+
![AIContentSafety](../../../imgs/01/01/01.AIcontentsafety.png)
5858

5959
- **Azure AI Content Safety**
6060
- **Microsoft Developer**

Diff for: md/02.Application/01.TextAndChat/Phi3/E2E_Phi-3-Evaluation_AIFoundry.md

+4-4
Original file line numberDiff line numberDiff line change
@@ -165,11 +165,11 @@ You need to create a Hub before creating the Project. A Hub acts like a Resource
165165

166166
1. Select **+ New project** from the navigation menu.
167167

168-
![Select new project.](../../../../imgs/03/Evaluation-AIFoundry/select-new-project.png)
168+
![Select new project.](../../../../imgs/03/AIFoundry/select-new-project.png)
169169

170170
1. Enter **Project name**. It must be a unique value.
171171

172-
![Create project.](../../../../imgs/03/Evaluation-AIFoundry/create-project.png)
172+
![Create project.](../../../../imgs/03/AIFoundry/create-project.png)
173173

174174
1. Select **Create a project**.
175175

@@ -369,7 +369,7 @@ You need to integrate the fine-tuned Phi-3 / Phi-3.5 model into a Prompt flow. H
369369

370370
1. Select **Validate and parse input** to renew parameters.
371371

372-
![Validate input.](../../../../imgs/03/Evaluation-AIFoundry/validate-input.png)
372+
![Validate input.](../../../../imgs/02/Evaluation-AIFoundry/validate-input.png)
373373

374374
1. Select the **Value** of the **connection** to the custom connection you created. For example, *connection*.
375375

@@ -395,7 +395,7 @@ To evaluate the Phi-3 / Phi-3.5 model in Azure AI Foundry, you need to deploy an
395395

396396
1. Navigate to the Azure AI Foundry project that you created.
397397

398-
![Select Project.](../../../../imgs/03/Evaluation-AIFoundry/select-project-created.png)
398+
![Select Project.](../../../../imgs/02/Evaluation-AIFoundry/select-project-created.png)
399399

400400
1. In the Project that you created, select **Deployments** from the left side tab.
401401

Diff for: md/02.Application/01.TextAndChat/Phi3/E2E_Phi-3-FineTuning_PromptFlow_Integration_AIFoundry.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -425,7 +425,7 @@ In this exercise, you will:
425425

426426
1. Select **Fine-tune** from the navigation menu.
427427

428-
![Select fine tune.](../../../../imgs/03/FineTuning-PromptFlow-AIFoundry/06-06-select-fine-tune.png)
428+
![Select fine tune.](../../../../imgs/02/FineTuning-PromptFlow-AIFoundry/06-06-select-fine-tune.png)
429429

430430
1. Perform the following tasks:
431431

Diff for: md/02.QuickStart/AzureAIFoundry_QuickStart.md

+25-47
Original file line numberDiff line numberDiff line change
@@ -2,79 +2,64 @@
22

33
With the development of Generative AI, we hope to use a unified platform to manage different LLM and SLM, enterprise data integration, fine-tuning/RAG operations, and the evaluation of different enterprise businesses after integrating LLM and SLM, etc., so that generative AI can Smart applications are better implemented. [Azure AI Foundry](https://ai.azure.com) is an enterprise-level generative AI application platform.
44

5-
![aistudo](../../imgs/02/AIStudio/ai-studio-home.png)
5+
![aistudo](../../imgs/01/02/03/aifoundry_home.png)
66

77
With Azure AI Foundry, you can evaluate large language model (LLM) responses and orchestrate prompt application components with prompt flow for better performance. The platform facilitates scalability for transforming proof of concepts into full-fledged production with ease. Continuous monitoring and refinement support long-term success.
88

99
We can quickly deploy the Phi-3 model on Azure AI Foundry through simple steps, and then use Azure AI Foundry to complete Phi-3 related Playground/Chat, Fine-tuning, evaluation and other related work.
1010

1111
## **1. Preparation**
1212

13-
## [AZD AI Foundry Starter Template](https://azure.github.io/awesome-azd/?name=AI+Studio)
14-
15-
### Azure AI Foundry Starter
16-
17-
This is Bicep template that deploys everything you need to get started with Azure AI Foundry. Includes AI Hub with dependent resources, AI project, AI Services and an online endpoint
18-
19-
### Quick Use
20-
2113
If you already have the [Azure Developer CLI](https://learn.microsoft.com/azure/developer/azure-developer-cli/overview?WT.mc_id=aiml-138114-kinfeylo) installed on your machine, using this template is as simple as running this command in a new directory.
2214

23-
### Terminal Command
24-
25-
```bash
26-
azd init -t azd-aistudio-starter
27-
```
28-
29-
Or
30-
If using the azd VS Code extension you can paste this URL in the VS Code command terminal.
31-
32-
### Terminal URL
15+
## Manual Creation
3316

34-
```bash
35-
azd-aistudio-starter
36-
```
17+
Creating a Microsoft Azure AI Foundry project and hub is a great way to organize and manage your AI work. Here's a step-by-step guide to get you started:
3718

38-
## Manual Creation
19+
### Creating a Project in Azure AI Foundry
3920

40-
Create Azure AI Foundry on [Azure Portal](https://portal.azure.com?WT.mc_id=aiml-138114-kinfeylo)
21+
1. **Go to Azure AI Foundry**: Sign in to the Azure AI Foundry portal.
22+
2. **Create a Project**:
23+
- If you're in a project, select "Azure AI Foundry" at the top left of the page to go to the Home page.
24+
- Select "+ Create project".
25+
- Enter a name for the project.
26+
- If you have a hub, it will be selected by default. If you have access to more than one hub, you can select a different one from the dropdown. If you want to create a new hub, select "Create new hub" and supply a name.
27+
- Select "Create".
4128

42-
![portal](../../imgs/02/AIStudio/ai-studio-portal.png)
29+
### Creating a Hub in Azure AI Foundry
4330

44-
After completing the naming of the studio and setting the region, you can create it
31+
1. **Go to Azure AI Foundry**: Sign in with your Azure account.
32+
2. **Create a Hub**:
33+
- Select the Management center from the left menu.
34+
- Select "All resources", then the down arrow next to "+ New project" and select "+ New hub".
35+
- In the "Create a new hub" dialog, enter a name for your hub (e.g., contoso-hub) and modify the other fields as desired.
36+
- Select "Next", review the information, and then select "Create".
4537

46-
![settings](../../imgs/02/AIStudio/ai-studio-settings.png)
38+
For more detailed instructions, you can refer to the official [Microsoft documentation](https://learn.microsoft.com/azure/ai-studio/how-to/create-projects).
4739

4840
After successful creation, you can access the studio you created through [ai.azure.com](https://ai.azure.com/)
4941

50-
![page](../../imgs/02/AIStudio/ai-studio-page.png)
51-
5242
There can be multiple projects on one AI Foundry. Create a project in AI Foundry to prepare.
5343

54-
![proj](../../imgs/02/AIStudio/ai-studio-proj.png)
44+
Create Azure AI Foundry [QuickStarts](https://learn.microsoft.com/azure/ai-studio/quickstarts/get-started-code)
5545

56-
## **2. Deploy the Phi-3 model in Azure AI Foundry**
5746

58-
Click the Explore option of the project to enter the Model Catalog and select Phi-3
47+
## **2. Deploy a Phi model in Azure AI Foundry**
5948

60-
![model](../../imgs/02/AIStudio/ai-studio-model.png)
49+
Click the Explore option of the project to enter the Model Catalog and select Phi-3
6150

6251
Select Phi-3-mini-4k-instruct
6352

64-
![phi3](../../imgs/02/AIStudio/ai-studio-phi3.png)
65-
6653
Click 'Deploy' to deploy the Phi-3-mini-4k-instruct model
6754

6855
> [!NOTE]
6956
>
7057
> You can select computing power when deploying
7158
72-
## **3. Playground Chat Phi-3 in Azure AI Foundry**
59+
## **3. Playground Chat Phi in Azure AI Foundry**
7360

7461
Go to the deployment page, select Playground, and chat with Phi-3 of Azure AI Foundry
7562

76-
![chat](../../imgs/02/AIStudio/ai-studio-chat.png)
77-
7863
## **4. Deploying the Model from Azure AI Foundry**
7964

8065
To deploy a model from the Azure Model Catalog, you can follow these steps:
@@ -92,16 +77,9 @@ To deploy a model from the Azure Model Catalog, you can follow these steps:
9277
> [!NOTE]
9378
> Please note that your account must have the Azure AI Developer role permissions on the Resource Group to perform these steps.
9479
95-
## **5. Using Phi-3 API in Azure AI Foundry**
80+
## **5. Using Phi API in Azure AI Foundry**
9681

9782
You can access https://{Your project name}.region.inference.ml.azure.com/swagger.json through Postman GET and combine it with Key to learn about the provided interfaces
9883

99-
![swagger](../../imgs/02/AIStudio/ai-studio-swagger.png)
100-
101-
such as access score api
102-
103-
![score](../../imgs/02/AIStudio/ai-studio-score.png)
104-
105-
You can get the request parameters very conveniently, as well as the response parameters. This is Postman result
84+
You can get the request parameters very conveniently, as well as the response parameters.
10685

107-
![result](../../imgs/02/AIStudio/ai-studio-result.png)

Diff for: md/02.QuickStart/GitHubModel_QuickStart.md

+4-4
Original file line numberDiff line numberDiff line change
@@ -2,15 +2,15 @@
22

33
Welcome to [GitHub Models](https://github.com/marketplace/models)! We've got everything fired up and ready for you to explore AI Models hosted on Azure AI.
44

5-
![GitHubModel](../../imgs/02/GitHub/GitHub_ModelCatalog.png)
5+
![GitHubModel](../../imgs/01/02/02/GitHub_ModelCatalog.png)
66

77
For more information about the Models available on GitHub Models, check out the [GitHub Model Marketplace](https://github.com/marketplace/models)
88

99
## Models Available
1010

1111
Each model has a dedicated playground and sample code
1212

13-
![Phi-3Model_Github](../../imgs/02/GitHub/GitHub_ModelPlay.png)
13+
![Phi-3Model_Github](../../imgs/01/02/02/GitHub_ModelPlay.png/)
1414

1515
### Phi-3 Models in GitHub Model Catalog
1616

@@ -36,7 +36,7 @@ There are a few basic examples that are ready for you to run. You can find them
3636

3737
There is also a dedicated Codespaces Environment for running the samples and models.
3838

39-
![Getting Started](../../imgs/02/GitHub/GitHub_ModelGetStarted.png)
39+
![Getting Started](../../imgs/01/02/02/GitHub_ModelGetStarted.png)
4040

4141

4242
## Sample Code
@@ -419,7 +419,7 @@ curl -X POST "https://models.inference.ai.azure.com/chat/completions" \
419419

420420
## FREE Usage and Rate limits for GitHub Models
421421

422-
![Model Catalog](../../imgs/02/GitHub/GitHub_Model.png)
422+
![Model Catalog](../../imgs/01/02/02/GitHub_Model.png)
423423

424424
The [rate limits for the playground and free API usage](https://docs.github.com/en/github-models/prototyping-with-ai-models#rate-limits) are intended to help you experiment with models and prototype your AI application. For use beyond those limits, and to bring your application to scale, you must provision resources from an Azure account, and authenticate from there instead of your GitHub personal access token. You don't need to change anything else in your code. Use this link to discover how to go beyond the free tier limits in Azure AI.
425425

Diff for: md/03.FineTuning/03.Inference/MLX_Inference.md

+4-4
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,7 @@ python -m mlx_lm.generate --model microsoft/Phi-3-mini-4k-instruct --max-token 2
3333

3434
The result (my env is Apple M1 Max,64GB) is
3535

36-
![Terminal](../../imgs/03/MLX/01.png)
36+
![Terminal](../../../imgs/01/03/MLX/01.png)
3737

3838
### **3. Quantizing Phi-3-mini with MLX in Terminal**
3939

@@ -59,15 +59,15 @@ python -m mlx_lm.generate --model ./mlx_model/ --max-token 2048 --prompt "<|use
5959

6060
The result is
6161

62-
![INT4](../../imgs/03/MLX/02.png)
62+
![INT4](../../../imgs/01/03/MLX/02.png)
6363

6464

6565
### **4. Running Phi-3-mini with MLX in Jupyter Notebook**
6666

6767

68-
![Notebook](../../imgs/03/MLX/03.png)
68+
![Notebook](../../../imgs/01/03/MLX/03.png)
6969

70-
***Note:*** Please read this sample [click this link](../../code/03.Inference/MLX/MLX_DEMO.ipynb)
70+
***Note:*** Please read this sample [click this link](../../../code/03.Inference/MLX/MLX_DEMO.ipynb)
7171

7272

7373
## **Resources**

0 commit comments

Comments
 (0)