2,736 questions with Azure Databricks tags

Sort by: Updated
0 answers

Unity catalog is not automatically created when a new databricks environment is created

When we create a new databricks instance, the unity catalog is not automatically created. This is odd, as usually it is created as part of the install. Guidance would be appreciated as to how to install the catalog against our new environment.

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-26T08:05:35.0133333+00:00
David Aston 0 Reputation points
1 answer

issue on azure signup 5000225

Hi Team, I am facing issue while signu Azure . not able to succeed my email id ******@outlook.com Mobile No 9764685441 for study and practice purpose I want to use. Kindly help., Regards Basanta Padhiary

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-26T04:09:37.12+00:00
Basanta Kumar Padhiary 0 Reputation points
answered 2025-10-26T04:33:31.7033333+00:00
Aashok Kumar Sharma 0 Reputation points
0 answers

Unity Catalog nor serverless automatically deployed/enabled by default on our new environment

While deploying Azure Databricks workspaces, Unity Catalog and Serverless services are not enabled by default and we are unable to use the Databricks account console in order to fix this issue

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-25T12:55:01.3466667+00:00
David Aston 0 Reputation points
0 answers

Databricks account id : xxx-xx-xx doesn't have active subscription to create metastore in unity catalog

Databricks account id : xxx-xx-xx doesn't have active subscription to create metastore in UNity Catalog. Can you tell me how to get active subscription?

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-24T15:14:37.3566667+00:00
s.chatterjee 0 Reputation points
edited a comment 2025-10-24T16:52:38.1633333+00:00
Siva shunmugam Nadessin 1,990 Reputation points Microsoft External Staff Moderator
2 answers

Azure Databricks PERMISSION_DENIED on ADLS container, seems to require account-level access

In Azure Databricks, I created an External Location and Credentials to access ADLS Gen2 storage container. I have the proper Unity Catalog permissions and the "Storage Blob Data Reader" role on the container. Unity catalog can browse the…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-20T13:23:21.02+00:00
Scott Hietpas 11 Reputation points
answered 2025-10-24T15:35:34.4366667+00:00
Scott Hietpas 11 Reputation points
1 answer

Can't create a compute with server - Student Account

I need to run scala in the workspace as instructed in the course but got a notification saying that my compute is serverless. Although as prof says, our student account should be able to create clusters. I also checked the "Credit" section in…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-24T03:28:44.5166667+00:00
Kai Yang 20 Reputation points
answered 2025-10-24T08:28:36.8966667+00:00
Aryan Parashar 1,850 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Azure for Student Validation Failure - Need this to complete assignment...

{ "code": "InvalidTemplateDeployment", "message": "The template deployment failed because of policy violation. Please see details for more information.", "details": [ { "code":…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-23T23:57:49.04+00:00
Kai Yang 20 Reputation points
commented 2025-10-24T01:30:43.03+00:00
Kai Yang 20 Reputation points
1 answer One of the answers was accepted by the question author.

Certain service endpoints are missing or not showing up in Azure Databricks.

I attempted to query the endpoint from an external application but encountered a “Request failed” exception. When I checked the Serving UI, all the endpoints were missing (unfortunately, I don’t have a screenshot). Later, I regenerated a few endpoints…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-17T07:10:11.7933333+00:00
Ashok Reddy (IT/EC) 40 Reputation points
accepted 2025-10-23T03:46:01.74+00:00
Ashok Reddy (IT/EC) 40 Reputation points
1 answer

Unable to start a compute cluster with settings 'enable_elastic_disk' set to false

I want to reduce the disk consumption of the VM in my compute cluster because the metrics shows that none of the disk is used. Databricks documentation says I can leverage this option : enable_elastic_disk So I created a 2 pools with following…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-21T08:25:00.1933333+00:00
Michael Guirao 0 Reputation points
answered 2025-10-21T08:36:52.4966667+00:00
VRISHABHANATH PATIL 1,295 Reputation points Microsoft External Staff Moderator
1 answer

How to resolve Azure Databricks private endpoint URLs from on-prem over ExpressRoute

Hello Friends, We have set up Azure Databricks with two private endpoints — Databricks UI-API, and Browser Authentication. From an Azure VM within the virtual network, name resolution correctly resolves to the private IPs. However, when we try to access…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-16T09:55:33.51+00:00
krutibasa majhi 25 Reputation points
edited an answer 2025-10-21T08:19:13.15+00:00
krutibasa majhi 25 Reputation points
1 answer

Improve connectivity between Azure Databricks and SAP Datasphere

We're ingesting into SAP Datasphere remote tables from Azure Databricks via JDBC through a single, shared DP Agent. Under higher data volumes or when multiple spaces run at once, the DP agent becomes overloaded, disconnects for 10 minutes, and causes…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-19T18:23:09.9533333+00:00
LearnAndLearn 120 Reputation points
commented 2025-10-21T07:59:08.6733333+00:00
Manoj Kumar Boyini 330 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Facing Issue while extracting the offset value from event hubs in data bricks

Hi Team, Could you please help us to provide code to extract the offset data from event hubs attached the screenshot of event hub details, the below code were using it, even I have tried with case sensitive pass the offset column in schema, at final…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-16T14:11:49.0533333+00:00
Ravi Sai Mahsiva 20 Reputation points
accepted 2025-10-17T14:31:38.4333333+00:00
Ravi Sai Mahsiva 20 Reputation points
1 answer One of the answers was accepted by the question author.

Unable to create Databricks Cluster despite increasing total region vCores to 128

Unable to create Databricks Cluster despite increasing total region vCores to 128

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-16T13:33:21.5433333+00:00
Rakesh P 20 Reputation points
commented 2025-10-17T10:22:50.72+00:00
Smaran Thoomu 31,910 Reputation points Microsoft External Staff Moderator
3 answers One of the answers was accepted by the question author.

Unable to login to Azure Databricks Account Console

I have a personal Azure pay-as-you-go subscription in which I have the 'Global Administrator' role. I am also the databricks account administrator. Until two weeks ago, I was able to access the databricks account console without any issues, but I am…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2024-08-12T09:01:10.54+00:00
Ramesh 50 Reputation points
answered 2025-10-16T21:25:10.6+00:00
Alicia Dunn 0 Reputation points
1 answer

How to get rid of "Active" Removed from Entra ID" status in console for my gmail.com account? I want my gmail.com account to be admin in data bricks

I created a free Azure account with 200 USD credits for a month using my email ******@gmail.com to practice databricks skills using unity catalogue. I set up datalake and databricks under a resource group already. Now, when I launch databricks…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-15T08:42:16+00:00
Sarika Kamble 0 Reputation points
commented 2025-10-16T09:32:00.86+00:00
Manoj Kumar Boyini 330 Reputation points Microsoft External Staff Moderator
1 answer

Cannot Create DIRECT_ACCESS on my Databricks Workspace

Got this error when trying to create a direct access index, my databricks workspace is premium type. Exception: Response content b'{"error_code":"INVALID_PARAMETER_VALUE","message":"Vector index type DIRECT_ACCESS is…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-13T14:15:56.1333333+00:00
Eric Tan 0 Reputation points
answered 2025-10-16T05:28:11.2733333+00:00
VRISHABHANATH PATIL 1,295 Reputation points Microsoft External Staff Moderator
1 answer

I need directions to create metsatore admin on Databricks workspace created on azure

I had setup Databricks Workspace in Azure. However, as I need to enable Delta sharing and have access to shares from my provider I need certain privileges on my role (USE_PROVIDER) that can be only granted by a metsatore admin. The workspace was not…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-14T10:54:18.6166667+00:00
Vamsi Mohan 0 Reputation points
commented 2025-10-15T12:16:44.9866667+00:00
Smaran Thoomu 31,910 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Do we need both 'dfs' and 'blob' subresource private endpoints for ADLS connected with Azure Databricks ( UC enabled )

Hi team, Do we need both 'dfs' and 'blob' subresource private endpoints ( 2 private endpoints, one for 'dfs' and another for 'blob' ) for ADLS connected with Azure Databricks ( UC enabled ). I believe only 'dfs' is enough but can you confirm on this? …

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-14T12:54:39.48+00:00
Akash S02 20 Reputation points
accepted 2025-10-15T05:51:52.0866667+00:00
Akash S02 20 Reputation points
2 answers

Need to remove compliance security profile from Databricks workspace

When trying to troubleshoot Databricks Agentbricks access, the compliance security profile was turned on for a workspace. There was no regulated data processed here. Can we have assistance removing this from the workspace?

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-14T14:31:26.7666667+00:00
Devin Robbins 0 Reputation points
answered 2025-10-14T15:25:06.65+00:00
Abhisek Mishra 845 Reputation points Microsoft External Staff Moderator
2 answers

Request to Enable Serverless Compute in Azure Databricks Workspace

We have successfully provisioned the Azure Databricks workspace and its dependent resources (VNet, subnets, storage, and Key Vault) through Terraform in accordance with our HITRUST-compliant setup. The next step is to enable Serverless Compute for the…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,736 questions
asked 2025-10-11T17:31:34.14+00:00
Karthick E 0 Reputation points
commented 2025-10-14T11:36:41.72+00:00
Kalyani Kondavaradala 3,145 Reputation points Microsoft External Staff Moderator