Request to Enable Serverless Compute in Azure Databricks Workspace

Hi Karthick E,

Thank you for reaching on Microsoft Q&A!

you're looking to enable Serverless Compute in your Azure Databricks workspace.

Here's how you can proceed:

1. Ensure Eligibility

Make sure that your workspace meets the following requirements to use Serverless Compute:

• It must have Unity Catalog enabled.
• It should be located in a supported region for serverless compute.
• Your workspace must not have PCI-DSS enabled in its compliance profile.

2. Check Workspace Plan

You will need to be on the Premium plan to utilize Serverless SQL warehouses. If you're currently on a trial or standard plan, you’ll need to upgrade. You can do this through the Azure Portal.

• Your Azure Databricks workspace must be on the Premium plan.

3. Enable Serverless SQL

To enable Serverless SQL for your workspace (if eligible):

• You should automatically have serverless SQL warehouses enabled, but you can verify this under your workspace settings.
• Your workspace must be in a region that supports Databricks SQL Serverless.
• In case of issues, ensure that there are no restrictions in your compute policy that may prevent the usage of serverless compute.

4. Role Assignments

To ensure your service principal has the necessary access, verify that it has the following roles assigned:

• Contributor
• Databricks Admin

5. Testing

Once enabled, you can create and run test notebooks to confirm that the serverless compute pool is working correctly within Unity Catalog. If you encounter issues, the following steps might help:

• Ensure that your Azure Storage firewall rules allow access from serverless compute nodes.
• If you’re facing quota issues, you might need to request an increase in your serverless quota.

Reference:

https://free.blessedness.top/en-us/azure/databricks/compute/serverless

https://free.blessedness.top/en-us/azure/databricks/admin/sql/serverless#limitations

I hope this helps, let us know if you need further assistance. Kindly consider upvoting if the information is helpful.

Thanks!

Kalyani

Karthick E •Thanks for the question and using MS Q&A platform.

You can enable or disable Serverless Compute for workflows and Notebooks directly for the select Previews option as shown below.

Note: This experience is only available to workspace and account admins. Account admins can manage Databricks account-level Previews from the Account console.

For more details, refer to Manage Azure Databricks Previews and Enable serverless compute.

𝘛𝘰 𝘴𝘵𝘢𝘺 𝘪𝘯𝘧𝘰𝘳𝘮𝘦𝘥 𝘢𝘣𝘰𝘶𝘵 𝘵𝘩𝘦 𝘭𝘢𝘵𝘦𝘴𝘵 𝘶𝘱𝘥𝘢𝘵𝘦𝘴 𝘢𝘯𝘥 𝘪𝘯𝘴𝘪𝘨𝘩𝘵𝘴 𝘰𝘯 𝘈𝘻𝘶𝘳𝘦 𝘋𝘢𝘵𝘢𝘣𝘳𝘪𝘤𝘬𝘴, 𝘥𝘢𝘵𝘢 𝘦𝘯𝘨𝘪𝘯𝘦𝘦𝘳𝘪𝘯𝘨, 𝘢𝘯𝘥 𝘤𝘭𝘰𝘶𝘥 𝘪𝘯𝘯𝘰𝘷𝘢𝘵𝘪𝘰𝘯𝘴, 𝘧𝘰𝘭𝘭𝘰𝘸 𝘮𝘦 𝘰𝘯 𝘓𝘪𝘯𝘬𝘦𝘥𝘐𝘯.