Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
1 answer
One of the answers was accepted by the question author.
Architecture design
Hi friends, thank you for your help as always. My follow up question to below: https://free.blessedness.top/en-us/answers/questions/2282164/architecture Sorry for silly question. How to get to good hands on the diagraming tools such as Draw IO etc. , I…
Azure Data Factory
asked 2025-06-10T13:24:57.7333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 88%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
azure_learner
880
Reputation points
accepted 2025-10-25T10:57:38.6466667+00:00
azure_learner
880
Reputation points
1 answer
Azure Data Factory Oracle 2.0 Connector CLR error with SDO_GEOMETRY data type
We're testing data loading after updating our Oracle Linked Service connection from 1.0 to 2.0, and are running into an issue with columns that use the Oracle SDO_GEOMETRY data type. With the 1.0 connector, queries that pulled these columns in executed…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-22T18:01:26.6933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 57.99999999999999%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEM%3C/text%3E%3C/svg%3E)
Evan Morgoch
1
Reputation point
commented 2025-10-25T05:36:13.8733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 18%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVP%3C/text%3E%3C/svg%3E)
VRISHABHANATH PATIL
1,295
Reputation points Microsoft External Staff
Moderator
1 answer
ADF Vs Fabric which one better ?
Hi, ADF Vs Fabric which one better ? Thanks Himanshu
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-24T02:58:29.0133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,527
Reputation points Microsoft Employee
Moderator
commented 2025-10-25T05:34:15.4233333+00:00
VRISHABHANATH PATIL
1,295
Reputation points Microsoft External Staff
Moderator
0 answers
Data Factory Copy Activity is failing for Hubspot data source
A Data Factory Copy Activity, sourcing data from a HubSpot connector and sinking to a CSV file in a data lake, is consistently failing with a data type conversion error on the source side. The pipeline is attempting to copy data without an explicitly…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-24T18:19:21.0833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 66%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPB%3C/text%3E%3C/svg%3E)
Peter Blatchley
0
Reputation points
commented 2025-10-24T19:48:20.76+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 72%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Swapnesh Panchal
740
Reputation points Microsoft External Staff
Moderator
1 answer
Azure Jira Connector - Upgraded Version and Dataset Warning.
When trying to upgrade my Azure Linked Service to the new (non-deprecated) version of Jira Connector, my dataset referencing the new linked service will not update (still getting the warning "...older version will be deprecated soon. ..." on…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-13T19:50:49.1433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 17%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGD%3C/text%3E%3C/svg%3E)
Gue, David
90
Reputation points
commented 2025-10-24T15:28:28.7966667+00:00
Gue, David
90
Reputation points
2 answers
Failed to run resource validation using @microsoft/azure-data-factory-utilities on Github
Hi Team, I am creating a workflow for ADF deployment on GitHub and encountering an issue when running the npm validate command. The validation fails with the following error: ERROR === Validator: Unhandled validation error for: pipeline - ***, error:…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-23T13:20:01.8266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 85%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES3%3C/text%3E%3C/svg%3E)
ShaikNisharunnisa-3795
20
Reputation points
commented 2025-10-24T13:11:35.15+00:00
ShaikNisharunnisa-3795
20
Reputation points
1 answer
Firebase data ingestion to Delta Lake (Databricks)
Hi, I am working towards ingesting data from Firebase into Delta Lake (powered by databricks). Among the connectors listed on Microsoft site, I am unable to see Firebase connectors. Please advise if there is a way for data to be ingested from Firebase…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-21T22:15:51.2933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(19.2, 97%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESN%3C/text%3E%3C/svg%3E)
Subhash Nagaraju
0
Reputation points
commented 2025-10-24T02:06:42.65+00:00
VRISHABHANATH PATIL
1,295
Reputation points Microsoft External Staff
Moderator
1 answer
ADF Vs Fabric which one better ?
Which is better ADF Vs Fabric ? Thanks Himanshu
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-24T00:07:22.8466667+00:00
HimanshuSinha-msft
19,527
Reputation points Microsoft Employee
Moderator
answered 2025-10-24T00:14:23.1266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 38%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMP%3C/text%3E%3C/svg%3E)
Marcin Policht
63,645
Reputation points MVP
Volunteer Moderator
1 answer
Can we deploy the Web API on Azure App services ?
Can we deploy the Web API on Azure App services ? I am getting the a 404 error once i deploy , but locally its works fine . Thanks Himanshu
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-23T19:14:32.1166667+00:00
HimanshuSinha-msft
19,527
Reputation points Microsoft Employee
Moderator
answered 2025-10-23T20:10:37.8066667+00:00
Azar
30,735
Reputation points MVP
Volunteer Moderator
1 answer
One of the answers was accepted by the question author.
Failed to connect to Sftp server Server HMAC algorithm not found. Azure Data Factory
I am trying to connect to an SFTP site from Azure Data Factory and receive the error message Failed to connect to Sftp server 'sftp.***.com'. Server HMAC algorithm not found. I can connect to the server from my computer bash from which the logs indicate…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-20T14:02:46.02+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 4%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEK%3C/text%3E%3C/svg%3E)
Elliott Kurtz
20
Reputation points
accepted 2025-10-23T13:32:54.3866667+00:00
Elliott Kurtz
20
Reputation points
1 answer
PostgreSQL V2 Connector Not Appearing as Sink in Azure Data Factory
Hi Team, We are working on a data integration pipeline using Azure Data Factory (ADF) to load data from Azure Data Lake (Zen2 Lake) into an on-premises PostgreSQL database using the PostgreSQL V2 connector. Here’s our setup: PostgreSQL version: 15+ ADF…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-21T12:01:30.41+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 37%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Mohan, Maddala Dharmendra
0
Reputation points
answered 2025-10-23T13:25:59.6633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 2%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMK%3C/text%3E%3C/svg%3E)
Manoj Kumar Boyini
330
Reputation points Microsoft External Staff
Moderator
1 answer
Setting up Oracle linked service using version 2.0 in ADF using SHIR
Hi all. I am trying to setup Oracle v2.0 Linked Service in ADF . At the moment its failing with the error: Test connection operation failed. Failed to open the Oracle database connection. ORA-50000: Connection request timed out We have our SHIR in…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-22T12:37:28.1033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 62%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
AD
0
Reputation points
commented 2025-10-23T11:29:08.6+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 16%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKK%3C/text%3E%3C/svg%3E)
Kalyani Kondavaradala
3,145
Reputation points Microsoft External Staff
Moderator
2 answers
One of the answers was accepted by the question author.
Mapping Data Flow adding Headers in Sink Setting bug
First of all let me show you the data preview of my source: In the Sink setting there is an option to add headers so, by using that I want to replace col0 with 'id' , col1 with 'name' and so on.. In the expression we have to…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2022-10-08T09:07:03.777+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 82%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Shubham Phegade
21
Reputation points
answered 2025-10-23T05:26:34.73+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 28.999999999999996%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Atheeth Korakathu
0
Reputation points
1 answer
Secure Data connection from Data Factory.
Hi, We are using Data factory service in Azure and created "Selfhosted Integration Runtime" on the window virtual machine in azure for connecting on-premise data store(For ex:Db2). Using azure express route for network connectivity between…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 37%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
3 answers
How to get the new data factory oracle 2.0 connector to connect?
We currently connect to oracle using the 1.0 connector. We must be moved to the new oracle 2.0 connector before end of support, 7/31/25. I was able to get this to connect to a non encrypted database, but unable to connect to an encrypted database. I had…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-05-22T14:01:06.2+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 55.00000000000001%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBD%3C/text%3E%3C/svg%3E)
Blasko, Dan W
60
Reputation points
answered 2025-10-22T14:29:15.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 28.999999999999996%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERR%3C/text%3E%3C/svg%3E)
roeland rens
0
Reputation points
1 answer
One of the answers was accepted by the question author.
Will Azure Data Factory Amazon Redshift linked service v2.0 be available with Azure Integration Runtime
ADF duly prompts me to upgrade the Redshift linked service at every possible part of the UI. However, I am using Azure Integration Runtime only, for which this upgrade is not available. What's the recommended course of action?
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-21T07:16:14.68+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(310.4, 92%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVG%3C/text%3E%3C/svg%3E)
Vincents Goldmanis
20
Reputation points
accepted 2025-10-22T05:57:42.2366667+00:00
Vincents Goldmanis
20
Reputation points
1 answer
Unable to connect Azure Blob Storage using Service Principal authentication in ADF Sink configuration (Connection failed)
Hello Support Team, I’m currently configuring a Microsoft Graph Data Connect (MGDC) pipeline in Azure Data Factory, and I’m encountering a persistent connection issue when trying to link Azure Blob Storage as the Sink destination. After completing the…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-21T09:11:43.8+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(41.6, 27%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJS%3C/text%3E%3C/svg%3E)
Jang Seongwon
0
Reputation points
commented 2025-10-23T08:51:51.19+00:00
Manoj Kumar Boyini
330
Reputation points Microsoft External Staff
Moderator
2 answers
How do you monitor and debug ADF pipelines?
Hello all , Do we have a document which we can follow for monitoring and debugging ADF ?
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-21T20:02:39.01+00:00
HimanshuSinha-msft
19,527
Reputation points Microsoft Employee
Moderator
commented 2025-10-22T23:26:05.7866667+00:00
Swapnesh Panchal
740
Reputation points Microsoft External Staff
Moderator
1 answer
Pipelines Failing when using trim function
Starting this morning, our main pipeline that processes our data running across 3 environments started failing with the following error: The provided parameters for function 'trim' are not valid There were no changes with our pipeline, and it was…
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-22T17:41:27.35+00:00
Evan Morgoch
1
Reputation point
commented 2025-10-23T09:11:53.6466667+00:00
Kalyani Kondavaradala
3,145
Reputation points Microsoft External Staff
Moderator
1 answer
Azure SQL DB restoration
How can we restore an Azure SQL DB through scripts ?
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,895 questions
asked 2025-10-22T21:05:11.0633333+00:00
HimanshuSinha-msft
19,527
Reputation points Microsoft Employee
Moderator
answered 2025-10-22T21:58:00.4833333+00:00
Marcin Policht
63,645
Reputation points MVP
Volunteer Moderator