Skip to content

Commit 13a88be

Browse files
nagkumar91Nagkumar ArkalgudNagkumar ArkalgudNagkumar Arkalgud
authored
Experimental tags on ADV scenarios (#38166)
* Update task_query_response.prompty remove required keys * Update task_simulate.prompty * Update task_query_response.prompty * Update task_simulate.prompty * Fix the api_key needed * Update for release * Black fix for file * Add original text in global context * Update test * Update the indirect attack simulator * Black suggested fixes * Update simulator prompty * Update adversarial scenario enum to exclude XPIA * Update changelog * Black fixes * Remove duplicate import * Fix the mypy error * Mypy please be happy * Updates to non adv simulator * accept context from assistant messages, exclude them when using them for conversation * update changelog * pylint fixes * pylint fixes * remove redundant quotes * Fix typo * pylint fix * Update broken tests * Include the grounding json in the manifest * Fix typo * Come on package * Release 1.0.0b5 * Notice from Chang * Remove adv_conv template parameters from the outputs * Update chanagelog * Experimental tags on adv scenarios --------- Co-authored-by: Nagkumar Arkalgud <[email protected]> Co-authored-by: Nagkumar Arkalgud <[email protected]> Co-authored-by: Nagkumar Arkalgud <[email protected]>
1 parent 9f827d3 commit 13a88be

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/simulator/_adversarial_scenario.py

+4
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,10 @@
33
# ---------------------------------------------------------
44

55
from enum import Enum
6+
from azure.ai.evaluation._common._experimental import experimental
67

78

9+
@experimental
810
class AdversarialScenario(Enum):
911
"""Adversarial scenario types"""
1012

@@ -18,12 +20,14 @@ class AdversarialScenario(Enum):
1820
ADVERSARIAL_CONTENT_PROTECTED_MATERIAL = "adv_content_protected_material"
1921

2022

23+
@experimental
2124
class AdversarialScenarioJailbreak(Enum):
2225
"""Adversarial scenario types for XPIA Jailbreak"""
2326

2427
ADVERSARIAL_INDIRECT_JAILBREAK = "adv_xpia"
2528

2629

30+
@experimental
2731
class _UnstableAdversarialScenario(Enum):
2832
"""Adversarial scenario types that we haven't published, but still want available for internal use
2933
Values listed here are subject to potential change, and/or migration to the main enum over time.

0 commit comments

Comments
 (0)