Skip to content

Commit a11c2ff

Browse files
emerging-tech-cdk-constructs-botgithub-actions
emerging-tech-cdk-constructs-bot
and
github-actions
authored
chore(deps): upgrade list of models and DLC images (#448)
Upgrade list of models and DLC images. See details in [workflow run]. [Workflow Run]: https://github.com/awslabs/generative-ai-cdk-constructs/actions/runs/9071572077 ------ *Automatically created by projen via the "code-generation" workflow* Signed-off-by: github-actions <[email protected]> Co-authored-by: github-actions <[email protected]>
1 parent ec327f7 commit a11c2ff

File tree

5 files changed

+81
-1
lines changed

5 files changed

+81
-1
lines changed

‎apidocs/classes/DeepLearningContainerImage.md

+14
Original file line numberDiff line numberDiff line change
@@ -66,6 +66,7 @@ https://github.com/aws/deep-learning-containers/blob/master/available_images.md
6666
- [HUGGINGFACE\_PYTORCH\_INFERENCE\_NEURONX\_1\_13\_0\_TRANSFORMERS4\_28\_1\_NEURONX\_PY38\_SDK2\_9\_1\_UBUNTU20\_04](DeepLearningContainerImage.md#huggingface_pytorch_inference_neuronx_1_13_0_transformers4_28_1_neuronx_py38_sdk2_9_1_ubuntu20_04)
6767
- [HUGGINGFACE\_PYTORCH\_INFERENCE\_NEURONX\_1\_13\_1\_TRANSFORMERS4\_34\_1\_NEURONX\_PY310\_SDK2\_15\_0\_UBUNTU20\_04](DeepLearningContainerImage.md#huggingface_pytorch_inference_neuronx_1_13_1_transformers4_34_1_neuronx_py310_sdk2_15_0_ubuntu20_04)
6868
- [HUGGINGFACE\_PYTORCH\_INFERENCE\_NEURONX\_1\_13\_1\_TRANSFORMERS4\_36\_2\_NEURONX\_PY310\_SDK2\_16\_1\_UBUNTU20\_04](DeepLearningContainerImage.md#huggingface_pytorch_inference_neuronx_1_13_1_transformers4_36_2_neuronx_py310_sdk2_16_1_ubuntu20_04)
69+
- [HUGGINGFACE\_PYTORCH\_INFERENCE\_NEURONX\_2\_1\_2\_TRANSFORMERS4\_36\_2\_NEURONX\_PY310\_SDK2\_18\_0\_UBUNTU20\_04](DeepLearningContainerImage.md#huggingface_pytorch_inference_neuronx_2_1_2_transformers4_36_2_neuronx_py310_sdk2_18_0_ubuntu20_04)
6970
- [HUGGINGFACE\_PYTORCH\_TGI\_INFERENCE\_2\_0\_0\_TGI0\_6\_0\_GPU\_PY39\_CU118\_UBUNTU20\_04](DeepLearningContainerImage.md#huggingface_pytorch_tgi_inference_2_0_0_tgi0_6_0_gpu_py39_cu118_ubuntu20_04)
7071
- [HUGGINGFACE\_PYTORCH\_TGI\_INFERENCE\_2\_0\_0\_TGI0\_8\_2\_GPU\_PY39\_CU118\_UBUNTU20\_04](DeepLearningContainerImage.md#huggingface_pytorch_tgi_inference_2_0_0_tgi0_8_2_gpu_py39_cu118_ubuntu20_04)
7172
- [HUGGINGFACE\_PYTORCH\_TGI\_INFERENCE\_2\_0\_1\_TGI0\_9\_3\_GPU\_PY39\_CU118\_UBUNTU20\_04](DeepLearningContainerImage.md#huggingface_pytorch_tgi_inference_2_0_1_tgi0_9_3_gpu_py39_cu118_ubuntu20_04)
@@ -79,6 +80,7 @@ https://github.com/aws/deep-learning-containers/blob/master/available_images.md
7980
- [HUGGINGFACE\_PYTORCH\_TGI\_INFERENCE\_2\_1\_1\_TGI1\_4\_5\_GPU\_PY310\_CU121\_UBUNTU22\_04](DeepLearningContainerImage.md#huggingface_pytorch_tgi_inference_2_1_1_tgi1_4_5_gpu_py310_cu121_ubuntu22_04)
8081
- [HUGGINGFACE\_PYTORCH\_TGI\_INFERENCE\_2\_1\_1\_TGI2\_0\_0\_GPU\_PY310\_CU121\_UBUNTU22\_04](DeepLearningContainerImage.md#huggingface_pytorch_tgi_inference_2_1_1_tgi2_0_0_gpu_py310_cu121_ubuntu22_04)
8182
- [HUGGINGFACE\_PYTORCH\_TGI\_INFERENCE\_2\_1\_1\_TGI2\_0\_1\_GPU\_PY310\_CU121\_UBUNTU22\_04](DeepLearningContainerImage.md#huggingface_pytorch_tgi_inference_2_1_1_tgi2_0_1_gpu_py310_cu121_ubuntu22_04)
83+
- [HUGGINGFACE\_PYTORCH\_TGI\_INFERENCE\_2\_3\_0\_TGI2\_0\_2\_GPU\_PY310\_CU121\_UBUNTU22\_04](DeepLearningContainerImage.md#huggingface_pytorch_tgi_inference_2_3_0_tgi2_0_2_gpu_py310_cu121_ubuntu22_04)
8284
- [HUGGINGFACE\_TENSORFLOW\_INFERENCE\_2\_11\_0\_TRANSFORMERS4\_26\_0\_CPU\_PY39\_UBUNTU20\_04](DeepLearningContainerImage.md#huggingface_tensorflow_inference_2_11_0_transformers4_26_0_cpu_py39_ubuntu20_04)
8385
- [HUGGINGFACE\_TENSORFLOW\_INFERENCE\_2\_11\_0\_TRANSFORMERS4\_26\_0\_GPU\_PY39\_CU112\_UBUNTU20\_04](DeepLearningContainerImage.md#huggingface_tensorflow_inference_2_11_0_transformers4_26_0_gpu_py39_cu112_ubuntu20_04)
8486
- [HUGGINGFACE\_TENSORFLOW\_INFERENCE\_2\_11\_1\_TRANSFORMERS4\_26\_0\_CPU\_PY39\_UBUNTU20\_04](DeepLearningContainerImage.md#huggingface_tensorflow_inference_2_11_1_transformers4_26_0_cpu_py39_ubuntu20_04)
@@ -417,6 +419,12 @@ ___
417419

418420
___
419421

422+
### HUGGINGFACE\_PYTORCH\_INFERENCE\_NEURONX\_2\_1\_2\_TRANSFORMERS4\_36\_2\_NEURONX\_PY310\_SDK2\_18\_0\_UBUNTU20\_04
423+
424+
▪ `Static` `Readonly` **HUGGINGFACE\_PYTORCH\_INFERENCE\_NEURONX\_2\_1\_2\_TRANSFORMERS4\_36\_2\_NEURONX\_PY310\_SDK2\_18\_0\_UBUNTU20\_04**: [`ContainerImage`](ContainerImage.md)
425+
426+
___
427+
420428
### HUGGINGFACE\_PYTORCH\_TGI\_INFERENCE\_2\_0\_0\_TGI0\_6\_0\_GPU\_PY39\_CU118\_UBUNTU20\_04
421429

422430
▪ `Static` `Readonly` **HUGGINGFACE\_PYTORCH\_TGI\_INFERENCE\_2\_0\_0\_TGI0\_6\_0\_GPU\_PY39\_CU118\_UBUNTU20\_04**: [`ContainerImage`](ContainerImage.md)
@@ -495,6 +503,12 @@ ___
495503

496504
___
497505

506+
### HUGGINGFACE\_PYTORCH\_TGI\_INFERENCE\_2\_3\_0\_TGI2\_0\_2\_GPU\_PY310\_CU121\_UBUNTU22\_04
507+
508+
▪ `Static` `Readonly` **HUGGINGFACE\_PYTORCH\_TGI\_INFERENCE\_2\_3\_0\_TGI2\_0\_2\_GPU\_PY310\_CU121\_UBUNTU22\_04**: [`ContainerImage`](ContainerImage.md)
509+
510+
___
511+
498512
### HUGGINGFACE\_TENSORFLOW\_INFERENCE\_2\_11\_0\_TRANSFORMERS4\_26\_0\_CPU\_PY39\_UBUNTU20\_04
499513

500514
▪ `Static` `Readonly` **HUGGINGFACE\_TENSORFLOW\_INFERENCE\_2\_11\_0\_TRANSFORMERS4\_26\_0\_CPU\_PY39\_UBUNTU20\_04**: [`ContainerImage`](ContainerImage.md)

‎apidocs/classes/JumpStartModel.md

+56
Original file line numberDiff line numberDiff line change
@@ -244,6 +244,7 @@
244244
- [HUGGINGFACE\_LLM\_GEMMA\_7B\_INSTRUCT\_1\_1\_1](JumpStartModel.md#huggingface_llm_gemma_7b_instruct_1_1_1)
245245
- [HUGGINGFACE\_LLM\_GEMMA\_7B\_INSTRUCT\_1\_1\_2](JumpStartModel.md#huggingface_llm_gemma_7b_instruct_1_1_2)
246246
- [HUGGINGFACE\_LLM\_GEMMA\_7B\_INSTRUCT\_1\_1\_3](JumpStartModel.md#huggingface_llm_gemma_7b_instruct_1_1_3)
247+
- [HUGGINGFACE\_LLM\_GRADIENTAI\_LLAMA\_3\_8B\_INSTRUCT\_262K\_1\_0\_0](JumpStartModel.md#huggingface_llm_gradientai_llama_3_8b_instruct_262k_1_0_0)
247248
- [HUGGINGFACE\_LLM\_HUGGINGFACEH4\_MISTRAL\_7B\_SFT\_ALPHA\_1\_0\_0](JumpStartModel.md#huggingface_llm_huggingfaceh4_mistral_7b_sft_alpha_1_0_0)
248249
- [HUGGINGFACE\_LLM\_HUGGINGFACEH4\_MISTRAL\_7B\_SFT\_ALPHA\_1\_1\_0](JumpStartModel.md#huggingface_llm_huggingfaceh4_mistral_7b_sft_alpha_1_1_0)
249250
- [HUGGINGFACE\_LLM\_HUGGINGFACEH4\_MISTRAL\_7B\_SFT\_BETA\_1\_0\_0](JumpStartModel.md#huggingface_llm_huggingfaceh4_mistral_7b_sft_beta_1_0_0)
@@ -300,6 +301,7 @@
300301
- [HUGGINGFACE\_LLM\_MIXTRAL\_8X7B\_INSTRUCT\_GPTQ\_1\_1\_0](JumpStartModel.md#huggingface_llm_mixtral_8x7b_instruct_gptq_1_1_0)
301302
- [HUGGINGFACE\_LLM\_NEXAAIDEV\_OCTOPUS\_V2\_1\_0\_0](JumpStartModel.md#huggingface_llm_nexaaidev_octopus_v2_1_0_0)
302303
- [HUGGINGFACE\_LLM\_NEXUSFLOW\_STARLING\_LM\_7B\_BETA\_1\_0\_0](JumpStartModel.md#huggingface_llm_nexusflow_starling_lm_7b_beta_1_0_0)
304+
- [HUGGINGFACE\_LLM\_NOUSRESEARCH\_HERMES\_2\_PRO\_LLAMA\_3\_8B\_1\_0\_0](JumpStartModel.md#huggingface_llm_nousresearch_hermes_2_pro_llama_3_8b_1_0_0)
303305
- [HUGGINGFACE\_LLM\_NOUSRESEARCH\_NOUS\_HERMES\_2\_SOLAR\_10\_7B\_1\_0\_0](JumpStartModel.md#huggingface_llm_nousresearch_nous_hermes_2_solar_10_7b_1_0_0)
304306
- [HUGGINGFACE\_LLM\_NOUSRESEARCH\_NOUS\_HERMES\_2\_SOLAR\_10\_7B\_1\_1\_0](JumpStartModel.md#huggingface_llm_nousresearch_nous_hermes_2_solar_10_7b_1_1_0)
305307
- [HUGGINGFACE\_LLM\_NOUSRESEARCH\_NOUS\_HERMES\_LLAMA2\_13B\_1\_0\_0](JumpStartModel.md#huggingface_llm_nousresearch_nous_hermes_llama2_13b_1_0_0)
@@ -308,6 +310,8 @@
308310
- [HUGGINGFACE\_LLM\_NOUSRESEARCH\_NOUS\_HERMES\_LLAMA\_2\_7B\_1\_1\_0](JumpStartModel.md#huggingface_llm_nousresearch_nous_hermes_llama_2_7b_1_1_0)
309311
- [HUGGINGFACE\_LLM\_NOUSRESEARCH\_YARN\_MISTRAL\_7B\_128K\_1\_0\_0](JumpStartModel.md#huggingface_llm_nousresearch_yarn_mistral_7b_128k_1_0_0)
310312
- [HUGGINGFACE\_LLM\_NOUSRESEARCH\_YARN\_MISTRAL\_7B\_128K\_1\_1\_0](JumpStartModel.md#huggingface_llm_nousresearch_yarn_mistral_7b_128k_1_1_0)
313+
- [HUGGINGFACE\_LLM\_NVIDIA\_LLAMA3\_CHATQA\_1\_5\_70B\_1\_0\_0](JumpStartModel.md#huggingface_llm_nvidia_llama3_chatqa_1_5_70b_1_0_0)
314+
- [HUGGINGFACE\_LLM\_NVIDIA\_LLAMA3\_CHATQA\_1\_5\_8B\_1\_0\_0](JumpStartModel.md#huggingface_llm_nvidia_llama3_chatqa_1_5_8b_1_0_0)
311315
- [HUGGINGFACE\_LLM\_OPENLM\_RESEARCH\_OPEN\_LLAMA\_7B\_V2\_1\_0\_0](JumpStartModel.md#huggingface_llm_openlm_research_open_llama_7b_v2_1_0_0)
312316
- [HUGGINGFACE\_LLM\_OPENLM\_RESEARCH\_OPEN\_LLAMA\_7B\_V2\_1\_1\_0](JumpStartModel.md#huggingface_llm_openlm_research_open_llama_7b_v2_1_1_0)
313317
- [HUGGINGFACE\_LLM\_PHI\_2\_1\_0\_0](JumpStartModel.md#huggingface_llm_phi_2_1_0_0)
@@ -1557,12 +1561,16 @@
15571561
- [META\_TEXTGENERATION\_LLAMA\_2\_7B\_F\_4\_1\_0](JumpStartModel.md#meta_textgeneration_llama_2_7b_f_4_1_0)
15581562
- [META\_TEXTGENERATION\_LLAMA\_3\_70B\_1\_0\_0](JumpStartModel.md#meta_textgeneration_llama_3_70b_1_0_0)
15591563
- [META\_TEXTGENERATION\_LLAMA\_3\_70B\_2\_0\_0](JumpStartModel.md#meta_textgeneration_llama_3_70b_2_0_0)
1564+
- [META\_TEXTGENERATION\_LLAMA\_3\_70B\_2\_0\_1](JumpStartModel.md#meta_textgeneration_llama_3_70b_2_0_1)
15601565
- [META\_TEXTGENERATION\_LLAMA\_3\_70B\_INSTRUCT\_1\_0\_0](JumpStartModel.md#meta_textgeneration_llama_3_70b_instruct_1_0_0)
15611566
- [META\_TEXTGENERATION\_LLAMA\_3\_70B\_INSTRUCT\_2\_0\_0](JumpStartModel.md#meta_textgeneration_llama_3_70b_instruct_2_0_0)
1567+
- [META\_TEXTGENERATION\_LLAMA\_3\_70B\_INSTRUCT\_2\_0\_1](JumpStartModel.md#meta_textgeneration_llama_3_70b_instruct_2_0_1)
15621568
- [META\_TEXTGENERATION\_LLAMA\_3\_8B\_1\_0\_0](JumpStartModel.md#meta_textgeneration_llama_3_8b_1_0_0)
15631569
- [META\_TEXTGENERATION\_LLAMA\_3\_8B\_2\_0\_0](JumpStartModel.md#meta_textgeneration_llama_3_8b_2_0_0)
1570+
- [META\_TEXTGENERATION\_LLAMA\_3\_8B\_2\_0\_1](JumpStartModel.md#meta_textgeneration_llama_3_8b_2_0_1)
15641571
- [META\_TEXTGENERATION\_LLAMA\_3\_8B\_INSTRUCT\_1\_0\_0](JumpStartModel.md#meta_textgeneration_llama_3_8b_instruct_1_0_0)
15651572
- [META\_TEXTGENERATION\_LLAMA\_3\_8B\_INSTRUCT\_2\_0\_0](JumpStartModel.md#meta_textgeneration_llama_3_8b_instruct_2_0_0)
1573+
- [META\_TEXTGENERATION\_LLAMA\_3\_8B\_INSTRUCT\_2\_0\_1](JumpStartModel.md#meta_textgeneration_llama_3_8b_instruct_2_0_1)
15661574
- [META\_TEXTGENERATION\_LLAMA\_CODELLAMA\_13B\_1\_0\_0](JumpStartModel.md#meta_textgeneration_llama_codellama_13b_1_0_0)
15671575
- [META\_TEXTGENERATION\_LLAMA\_CODELLAMA\_13B\_1\_0\_1](JumpStartModel.md#meta_textgeneration_llama_codellama_13b_1_0_1)
15681576
- [META\_TEXTGENERATION\_LLAMA\_CODELLAMA\_13B\_1\_0\_2](JumpStartModel.md#meta_textgeneration_llama_codellama_13b_1_0_2)
@@ -3159,6 +3167,12 @@ ___
31593167

31603168
___
31613169

3170+
### HUGGINGFACE\_LLM\_GRADIENTAI\_LLAMA\_3\_8B\_INSTRUCT\_262K\_1\_0\_0
3171+
3172+
▪ `Static` `Readonly` **HUGGINGFACE\_LLM\_GRADIENTAI\_LLAMA\_3\_8B\_INSTRUCT\_262K\_1\_0\_0**: [`JumpStartModel`](JumpStartModel.md)
3173+
3174+
___
3175+
31623176
### HUGGINGFACE\_LLM\_HUGGINGFACEH4\_MISTRAL\_7B\_SFT\_ALPHA\_1\_0\_0
31633177

31643178
▪ `Static` `Readonly` **HUGGINGFACE\_LLM\_HUGGINGFACEH4\_MISTRAL\_7B\_SFT\_ALPHA\_1\_0\_0**: [`JumpStartModel`](JumpStartModel.md)
@@ -3495,6 +3509,12 @@ ___
34953509

34963510
___
34973511

3512+
### HUGGINGFACE\_LLM\_NOUSRESEARCH\_HERMES\_2\_PRO\_LLAMA\_3\_8B\_1\_0\_0
3513+
3514+
▪ `Static` `Readonly` **HUGGINGFACE\_LLM\_NOUSRESEARCH\_HERMES\_2\_PRO\_LLAMA\_3\_8B\_1\_0\_0**: [`JumpStartModel`](JumpStartModel.md)
3515+
3516+
___
3517+
34983518
### HUGGINGFACE\_LLM\_NOUSRESEARCH\_NOUS\_HERMES\_2\_SOLAR\_10\_7B\_1\_0\_0
34993519

35003520
▪ `Static` `Readonly` **HUGGINGFACE\_LLM\_NOUSRESEARCH\_NOUS\_HERMES\_2\_SOLAR\_10\_7B\_1\_0\_0**: [`JumpStartModel`](JumpStartModel.md)
@@ -3543,6 +3563,18 @@ ___
35433563

35443564
___
35453565

3566+
### HUGGINGFACE\_LLM\_NVIDIA\_LLAMA3\_CHATQA\_1\_5\_70B\_1\_0\_0
3567+
3568+
▪ `Static` `Readonly` **HUGGINGFACE\_LLM\_NVIDIA\_LLAMA3\_CHATQA\_1\_5\_70B\_1\_0\_0**: [`JumpStartModel`](JumpStartModel.md)
3569+
3570+
___
3571+
3572+
### HUGGINGFACE\_LLM\_NVIDIA\_LLAMA3\_CHATQA\_1\_5\_8B\_1\_0\_0
3573+
3574+
▪ `Static` `Readonly` **HUGGINGFACE\_LLM\_NVIDIA\_LLAMA3\_CHATQA\_1\_5\_8B\_1\_0\_0**: [`JumpStartModel`](JumpStartModel.md)
3575+
3576+
___
3577+
35463578
### HUGGINGFACE\_LLM\_OPENLM\_RESEARCH\_OPEN\_LLAMA\_7B\_V2\_1\_0\_0
35473579

35483580
▪ `Static` `Readonly` **HUGGINGFACE\_LLM\_OPENLM\_RESEARCH\_OPEN\_LLAMA\_7B\_V2\_1\_0\_0**: [`JumpStartModel`](JumpStartModel.md)
@@ -11037,6 +11069,12 @@ ___
1103711069

1103811070
___
1103911071

11072+
### META\_TEXTGENERATION\_LLAMA\_3\_70B\_2\_0\_1
11073+
11074+
▪ `Static` `Readonly` **META\_TEXTGENERATION\_LLAMA\_3\_70B\_2\_0\_1**: [`JumpStartModel`](JumpStartModel.md)
11075+
11076+
___
11077+
1104011078
### META\_TEXTGENERATION\_LLAMA\_3\_70B\_INSTRUCT\_1\_0\_0
1104111079

1104211080
▪ `Static` `Readonly` **META\_TEXTGENERATION\_LLAMA\_3\_70B\_INSTRUCT\_1\_0\_0**: [`JumpStartModel`](JumpStartModel.md)
@@ -11049,6 +11087,12 @@ ___
1104911087

1105011088
___
1105111089

11090+
### META\_TEXTGENERATION\_LLAMA\_3\_70B\_INSTRUCT\_2\_0\_1
11091+
11092+
▪ `Static` `Readonly` **META\_TEXTGENERATION\_LLAMA\_3\_70B\_INSTRUCT\_2\_0\_1**: [`JumpStartModel`](JumpStartModel.md)
11093+
11094+
___
11095+
1105211096
### META\_TEXTGENERATION\_LLAMA\_3\_8B\_1\_0\_0
1105311097

1105411098
▪ `Static` `Readonly` **META\_TEXTGENERATION\_LLAMA\_3\_8B\_1\_0\_0**: [`JumpStartModel`](JumpStartModel.md)
@@ -11061,6 +11105,12 @@ ___
1106111105

1106211106
___
1106311107

11108+
### META\_TEXTGENERATION\_LLAMA\_3\_8B\_2\_0\_1
11109+
11110+
▪ `Static` `Readonly` **META\_TEXTGENERATION\_LLAMA\_3\_8B\_2\_0\_1**: [`JumpStartModel`](JumpStartModel.md)
11111+
11112+
___
11113+
1106411114
### META\_TEXTGENERATION\_LLAMA\_3\_8B\_INSTRUCT\_1\_0\_0
1106511115

1106611116
▪ `Static` `Readonly` **META\_TEXTGENERATION\_LLAMA\_3\_8B\_INSTRUCT\_1\_0\_0**: [`JumpStartModel`](JumpStartModel.md)
@@ -11073,6 +11123,12 @@ ___
1107311123

1107411124
___
1107511125

11126+
### META\_TEXTGENERATION\_LLAMA\_3\_8B\_INSTRUCT\_2\_0\_1
11127+
11128+
▪ `Static` `Readonly` **META\_TEXTGENERATION\_LLAMA\_3\_8B\_INSTRUCT\_2\_0\_1**: [`JumpStartModel`](JumpStartModel.md)
11129+
11130+
___
11131+
1107611132
### META\_TEXTGENERATION\_LLAMA\_CODELLAMA\_13B\_1\_0\_0
1107711133

1107811134
▪ `Static` `Readonly` **META\_TEXTGENERATION\_LLAMA\_CODELLAMA\_13B\_1\_0\_0**: [`JumpStartModel`](JumpStartModel.md)

‎src/patterns/gen-ai/aws-model-deployment-sagemaker/deep-learning-container-image.ts

+2
Original file line numberDiff line numberDiff line change
@@ -63,6 +63,7 @@ export class DeepLearningContainerImage extends ContainerImage {
6363
public static readonly HUGGINGFACE_PYTORCH_INFERENCE_NEURONX_1_13_0_TRANSFORMERS4_28_1_NEURONX_PY38_SDK2_9_1_UBUNTU20_04 = this.fromDeepLearningContainerImage('huggingface-pytorch-inference-neuronx', '1.13.0-transformers4.28.1-neuronx-py38-sdk2.9.1-ubuntu20.04');
6464
public static readonly HUGGINGFACE_PYTORCH_INFERENCE_NEURONX_1_13_1_TRANSFORMERS4_34_1_NEURONX_PY310_SDK2_15_0_UBUNTU20_04 = this.fromDeepLearningContainerImage('huggingface-pytorch-inference-neuronx', '1.13.1-transformers4.34.1-neuronx-py310-sdk2.15.0-ubuntu20.04');
6565
public static readonly HUGGINGFACE_PYTORCH_INFERENCE_NEURONX_1_13_1_TRANSFORMERS4_36_2_NEURONX_PY310_SDK2_16_1_UBUNTU20_04 = this.fromDeepLearningContainerImage('huggingface-pytorch-inference-neuronx', '1.13.1-transformers4.36.2-neuronx-py310-sdk2.16.1-ubuntu20.04');
66+
public static readonly HUGGINGFACE_PYTORCH_INFERENCE_NEURONX_2_1_2_TRANSFORMERS4_36_2_NEURONX_PY310_SDK2_18_0_UBUNTU20_04 = this.fromDeepLearningContainerImage('huggingface-pytorch-inference-neuronx', '2.1.2-transformers4.36.2-neuronx-py310-sdk2.18.0-ubuntu20.04');
6667
public static readonly HUGGINGFACE_PYTORCH_TGI_INFERENCE_2_0_0_TGI0_6_0_GPU_PY39_CU118_UBUNTU20_04 = this.fromDeepLearningContainerImage('huggingface-pytorch-tgi-inference', '2.0.0-tgi0.6.0-gpu-py39-cu118-ubuntu20.04');
6768
public static readonly HUGGINGFACE_PYTORCH_TGI_INFERENCE_2_0_0_TGI0_8_2_GPU_PY39_CU118_UBUNTU20_04 = this.fromDeepLearningContainerImage('huggingface-pytorch-tgi-inference', '2.0.0-tgi0.8.2-gpu-py39-cu118-ubuntu20.04');
6869
public static readonly HUGGINGFACE_PYTORCH_TGI_INFERENCE_2_0_1_TGI0_9_3_GPU_PY39_CU118_UBUNTU20_04 = this.fromDeepLearningContainerImage('huggingface-pytorch-tgi-inference', '2.0.1-tgi0.9.3-gpu-py39-cu118-ubuntu20.04');
@@ -76,6 +77,7 @@ export class DeepLearningContainerImage extends ContainerImage {
7677
public static readonly HUGGINGFACE_PYTORCH_TGI_INFERENCE_2_1_1_TGI1_4_5_GPU_PY310_CU121_UBUNTU22_04 = this.fromDeepLearningContainerImage('huggingface-pytorch-tgi-inference', '2.1.1-tgi1.4.5-gpu-py310-cu121-ubuntu22.04');
7778
public static readonly HUGGINGFACE_PYTORCH_TGI_INFERENCE_2_1_1_TGI2_0_0_GPU_PY310_CU121_UBUNTU22_04 = this.fromDeepLearningContainerImage('huggingface-pytorch-tgi-inference', '2.1.1-tgi2.0.0-gpu-py310-cu121-ubuntu22.04');
7879
public static readonly HUGGINGFACE_PYTORCH_TGI_INFERENCE_2_1_1_TGI2_0_1_GPU_PY310_CU121_UBUNTU22_04 = this.fromDeepLearningContainerImage('huggingface-pytorch-tgi-inference', '2.1.1-tgi2.0.1-gpu-py310-cu121-ubuntu22.04');
80+
public static readonly HUGGINGFACE_PYTORCH_TGI_INFERENCE_2_3_0_TGI2_0_2_GPU_PY310_CU121_UBUNTU22_04 = this.fromDeepLearningContainerImage('huggingface-pytorch-tgi-inference', '2.3.0-tgi2.0.2-gpu-py310-cu121-ubuntu22.04');
7981
public static readonly HUGGINGFACE_TENSORFLOW_INFERENCE_2_11_0_TRANSFORMERS4_26_0_CPU_PY39_UBUNTU20_04 = this.fromDeepLearningContainerImage('huggingface-tensorflow-inference', '2.11.0-transformers4.26.0-cpu-py39-ubuntu20.04');
8082
public static readonly HUGGINGFACE_TENSORFLOW_INFERENCE_2_11_0_TRANSFORMERS4_26_0_GPU_PY39_CU112_UBUNTU20_04 = this.fromDeepLearningContainerImage('huggingface-tensorflow-inference', '2.11.0-transformers4.26.0-gpu-py39-cu112-ubuntu20.04');
8183
public static readonly HUGGINGFACE_TENSORFLOW_INFERENCE_2_11_1_TRANSFORMERS4_26_0_CPU_PY39_UBUNTU20_04 = this.fromDeepLearningContainerImage('huggingface-tensorflow-inference', '2.11.1-transformers4.26.0-cpu-py39-ubuntu20.04');

0 commit comments

Comments
 (0)