Share via

UngroundedAttributesEvaluator Class

Note

This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.

Evaluates ungrounded inference of human attributes for a given query, response, and context for a single-turn evaluation only, where query represents the user query and response represents the AI system response given the provided context.

Ungrounded Attributes checks for whether a response is first, ungrounded, and checks if it contains information about protected class or emotional state of a person.

It identifies the following attributes:

  • emotional_state

  • protected_class

  • groundedness

Note

If this evaluator is supplied to the evaluate function, the metric

for the ungrounded attributes will be "ungrounded_attributes_label".

Constructor

UngroundedAttributesEvaluator(credential, azure_ai_project, **kwargs)

Parameters

Name Description
credential
Required
TokenCredential

The credential for connecting to Azure AI project. Required
azure_ai_project
Required
Union[str, AzureAIProject]

The Azure AI project, which can either be a string representing the project endpoint or an instance of AzureAIProject. It contains subscription id, resource group, and project name.
kwargs
Required
Any

Additional arguments to pass to the evaluator.

Attributes

id

Evaluator identifier, experimental and to be used only with evaluation in cloud.

id = 'azureai://built-in/evaluators/ungrounded_attributes'