Unable to see the spark pool I have created while configuring the synapse link for dataverse

Question

Unable to see the spark pool I have created while configuring the synapse link for dataverse

Athira Reghuraman 95

I have created a spark pool in my synapse workspace to use it for the delta conversion during configuring the synapse link for dataverse for the D365FO data , unfortunately once I choose the synapse workspace and enabled "Use spark pool for delta lake conversion" , it is not showing the spark pool I have created in the dropdown . I have created the spark pool based on the document provided by microsoft and I have owner and synapse admin access

Ganesh Gurram 7,230 Reputation points Moderator

2024-11-06T14:06:24.33+00:00

@Athira Reghuraman - Just checking in to see if the below answer provided by @Vinodh247 helped.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know
Vinodh247 39,201 Reputation points MVP Volunteer Moderator

2024-11-10T10:41:48.26+00:00

Athira Reghuraman: Please 'Accept as Answer' and click the 'Upvote'(Thumbs-up) button if the reply was helpful. This will help us to close this thread.
tmeeksdba 0 Reputation points

2025-01-14T20:18:11.2766667+00:00

This is happening for me as well. I was able to complete the creation of the Synapse Link in our SAT environment in mid 2024, but now in the beginning of 2025, I'm trying to create a new Synapse Link in our prod environment and am not able to select the spark pool I created in the PROD resource group. It is in the same resource group and geo-location as all other resources.

Also of note is that the Spark Pool still requires version 3.3 even though in less than 2 months version 3.3 will go away.

1 answer

Your answer

Ganesh Gurram 7,230 Reputation points Moderator

2024-11-06T14:06:24.33+00:00

@Athira Reghuraman - Just checking in to see if the below answer provided by @Vinodh247 helped.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know
Vinodh247 39,201 Reputation points MVP Volunteer Moderator

2024-11-10T10:41:48.26+00:00

Athira Reghuraman: Please 'Accept as Answer' and click the 'Upvote'(Thumbs-up) button if the reply was helpful. This will help us to close this thread.
tmeeksdba 0 Reputation points

2025-01-14T20:18:11.2766667+00:00

This is happening for me as well. I was able to complete the creation of the Synapse Link in our SAT environment in mid 2024, but now in the beginning of 2025, I'm trying to create a new Synapse Link in our prod environment and am not able to select the spark pool I created in the PROD resource group. It is in the same resource group and geo-location as all other resources.

Also of note is that the Spark Pool still requires version 3.3 even though in less than 2 months version 3.3 will go away.

Answer 1

Hi Athira Reghuraman,

Thanks for reaching out to Microsoft Q&A.

This issue could occur due to several reasons sometimes commonly related to permissions, Spark pool settings or synapse Link configuration nuances.

Ensure that the Spark pool was created with the correct region and settings compatible with Synapse Link requirements for Dataverse. Occasionally, region mismatches or unsupported configurations can cause issues.
Confirm that the Synapse Link and the Synapse workspace are correctly set up, including any specific settings for compatibility with Dataverse and Delta Lake.
Changes in Azure resources aren't immediately reflected. Try refreshing the Synapse Link configuration page, or even re-establishing the connection to your Synapse workspace.
Although you have owner and Synapse admin roles, make sure you have the necessary permissions specifically for Synapse Link with Dataverse, as certain linked access requirements might not be covered by general roles.
Clear cache or try a different browser: Occasionally, cached settings or browser compatibility issues can interfere with resource display in Azure portal dropdowns.

If there is still issue, consider re deploying the spark pool or checking azure service health to ensure there are no regional disruptions impacting resource visibility.

Please feel free to click the 'Upvote' (Thumbs-up) button and 'Accept as Answer'. This helps the community by allowing others with similar queries to easily find the solution.

Athira Reghuraman 95 Reputation points

2024-11-07T10:03:14.1333333+00:00

Thanks @Vinodh247 , I have created spark pool version 3.4 and it was not accepting by synapse link and I tried with 3.3 version and it is supported by synapse link
Vinodh247 39,201 Reputation points MVP Volunteer Moderator

2024-11-07T10:26:31.0266667+00:00

does the answer helped in any way? to narrow down the issue? if yes mark as answer
Kristina Punzalan Lee 0 Reputation points

2025-10-22T20:45:59.81+00:00

As of Oct 2025, Azure Synapse Link requires 3.4 or higher. When the Apache Spark Pool was created at 3.5, it doesn't show up. When the Apache Spark Pool was created at 3.4, it shows up. Hope that helps.

Share via

Unable to see the spark pool I have created while configuring the synapse link for dataverse

1 answer

Your answer