Allow external large language models (LLMs) for generative responses

AI innovation moves at a a rapid pace, and each AI model has different strengths and specialties. With the External models rule and setting, you can allow the use of external AI models for an environment or an environment group. These models offer an alternative approach to generative AI in Microsoft Copilot Studio. These models support advanced summarization and conversational capabilities and are now available in preview for evaluation purposes. The models available under the External models setting are Anthropic models that are hosted outside of Microsoft and subject to Anthropic terms and data handling.

Control external AI models use for an environment

To control the use of external models, complete these steps.

1. Sign in to the Power Platform admin center.
2. In the navigation pane, select Manage.
3. In the Manage pane, select Environments. Then select the environment you want to manage.
4. In the command bar, select Settings.
5. On the Settings page, select Product > Features.
6. On the Features page, turn the External models setting On or Off.

Control external models use for an environment group

If your environment is part of an environment group, you can govern external models use through the External models environment group rule.

1. Sign in to the Power Platform admin center.
2. In the navigation pane, select Manage.
3. In the Manage pane, select Environments. Then select the environment you want to manage.
4. Select the Rules tab.
5. Select the External models rule. In the External models pane, turn the feature On or Off.
6. Save your changes.
7. To apply your changes to the environments in the group, select Publish rules.