Export dataverse data to in delta lake format not working
We have setup Azure Synapse Link for Dataverse and followed the documentation here: https://free.blessedness.top/en-us/power-apps/maker/data-platform/azure-synapse-link-synapse Export Microsoft Dataverse data in Delta Lake format - Power Apps |…
Azure Synapse Analytics
Cost of Azure Synapse Analytics - 1 vs 2 workspace (no Dedicated SQL Pool)
Sir/Madam, Need to understand the cost implications of planning for Synapse Analytics workspaces. Goal is to run Serverless Spark pool + Serverless SQL Pool. No plans of having Dedicated SQL Pool Is there a cost savings involved in running a single…
Azure Synapse Analytics
Msg 13807, Level 16, State 1, Line 1 - Content of directory on path cannot be listed
I have got a synapse serverless SQL pool which was created by synapse link for Dynamics 365, I granted the user access to the serverless pool datalake database by assigning them the data reader role, the user queries a database table and gets the…
Azure Synapse Analytics
User gets "Login failed for user '<token-identified principal>'" when creating a DB in Synapse serverless SQL pool, despite having admin roles
Hi everyone, I have an Azure Synapse Analytics workspace, and I’m trying to give another user access to create a database in the Built-in serverless SQL pool. Here’s what I’ve done so far: In the Synapse workspace, under Manage → Security → Access…
Azure Synapse Analytics
Generic error when running a Synapse pipeline containing a dataflow or trying to start a debug session
I have 2 Synapse instances in UK South. Error only occurs in one of them and doesn't seem to show up in the workspace logs - 'Internal server error executing the request.' This happens when trying to start debug cluster or run a pipeline with a dataflow…
Azure Synapse Analytics
Synapse Spark Pool starting time is significant longer than before
Hello, Over the past few months, I’ve noticed that Synapse Spark Pools take significantly longer to start. Previously, it took around 5 minutes to start a Spark Pool from scratch, but now it takes about 10 minutes. Is there any way to reduce the startup…
Azure Synapse Analytics
Why are Spark Pools 3.4 in Synapse Taking Twice as Long to Start Up?
Why are Spark Pools 3.4 in Synapse Taking Twice as Long to Start Up? Since 3.5 Preview all pools are taking longer to spin up. This is also happening with custom environments in Fabric. Is this issue being worked on actively?
Azure Synapse Analytics
eRRO Spark job requested 80 vcores.
Ola boa tarde. Preciso de uma ajuda? Esta apresentando essa mensagem: InvalidHttpRequestToLivy: Your Spark job requested 80 vcores. However, the workspace has a 12 core limit. Try reducing the numbers of vcores requested or increasing your vcore quota.…
Azure Synapse Analytics
Can't create Azure Synapse link to Dataverse in Power Platform despite having correct apache spark version
I have a dynamics environment in Canada region I have an Azure Synapse Workspace containing a Spark Pool in the Canada East region (there was no 'Canada' option) In Powerapps, I try to create a link to the Dataverse, and after choosing the Azure Synapse…
Azure Synapse Analytics
Connect Azure Synapse to MongoDB Database with a Private Endpoint
We have a MongoDB Atlas Cluster deployed using Azure as our Cloud Provider and I'm trying to use a Private Endpoint to allow the connection from our Azure Synapse Workspace but I keep getting a Timeout Issue whenever I try to test the connection from the…
Azure Synapse Analytics
Empty Files being Placed when using OIC(Oracle Integration Cloud) to copy data into Azure Data Lake
We are currently facing an issue in our UAT environment while copying files from Oracle Integration Cloud (OIC) to Azure Data Lake Gen2 using the OIC connectivity agent installed on an Azure VM inside a secure VNET. Issue Observed When the file copy…
Azure Synapse Analytics
Force Azure Synapse Copy Data to ignore internal GUID
I just added a GUID in an existing table, using ALTER ... and NEWID() as generator. I now have issues updating this table. 1st attempt: When trying to upsert (on another column : client_id) in this table with the source system newest data, I got an error…
Azure Synapse Analytics
Azure Synapse Missing Theme In Settings
Hi, I am new to Azure and had the opportunity to adjust Microsoft products themes to Dark Mode. I was unable to change such theme in Azure Synapse as the option is missing. Looking on the internet there is a Theme option that should be present up top the…
Azure Synapse Analytics
Unable to see the spark pool I have created while configuring the synapse link for dataverse
I have created a spark pool in my synapse workspace to use it for the delta conversion during configuring the synapse link for dataverse for the D365FO data , unfortunately once I choose the synapse workspace and enabled "Use spark pool for delta…
Azure Synapse Analytics
Hit unexpected exception, please retry. If the problem persists, please contact Azure Support
Dataflows in Synapse are erroring out with below details. I am also not able to start debug cluster. "errorCode": "145", "message": "Hit unexpected exception, please retry. If the problem persists, please contact Azure…
Azure Synapse Analytics
Intermittent Spark Pool Failures and Increased Startup Time After Upgrading to Spark 3.5 in Azure Synapse
We recently upgraded our Synapse Spark pools from version 3.4 to 3.5. As part of the upgrade process, we followed these steps: Removed custom packages from the pools Upgraded the Spark pool version to 3.5 Re-attached the required packages After the…
Azure Synapse Analytics
One-time Data migration from Cosmos DB to Storage Account (data lake) using Azure Synapse Error converting value "MultiHash" to type 'Microsoft.Azure.Documents.PartitionKind'
Hello, I'm trying to perform a data migration from CosmosDB to Storage Account, but on the mapping step, I'm facing the following issue: Error converting value "MultiHash" to type 'Microsoft.Azure.Documents.PartitionKind'. Path…
Azure Synapse Analytics
Which is faster copy command vs bulkinsert/polybase in copy activity (synapse)?
Dear all, Could you please help me explaining which is faster to use copy command vs bulk insert /poly base in copy activity while pushing data to sink? Thanks, Mahasweta
Azure Synapse Analytics
Why Does My Azure Synapse Analytics Pipeline Keep Failing with Data Loading Errors?
I’m working on an Azure Synapse Analytics pipeline (dedicated SQL pool, 200 DWUs) to load sales data from Azure Blob Storage (CSV files with columns OrderID, Product, Revenue) into a data warehouse for business reporting. The pipeline uses Copy…
Azure Synapse Analytics
How well does R work in Synapse Analytics Notebooks?
Hello, According to the documentation (https://free.blessedness.top/en-us/azure/synapse-analytics/spark/apache-spark-r-language), Synapse Analytics Notebooks support an R runtime as part of the Spark environment. I’d like to clarify whether it’s possible…