Azure datalake adls to delta lake
Hi Kind friends and experts, we have a data modernization roadmap, which I have also discussed similar but not exactly the same as this question here in below…
Azure Data Lake Storage
Exporting D365 F&O Data Directly to Azure Data Lake Gen2 Without Dataverse. Questions on Current Approach, Format & Folder Structure
Hi Everyone, I’m currently working on exporting all tables/entities from Dynamics 365 Finance and Operations (Tier 2 environment) directly to Azure Data Lake Gen2. I don’t want to use Dataverse in between. I’ve already created a Storage Account in Azure…
Azure Data Lake Storage
ADLS and optimal solution with historical data
Hi @Anonymous Thank you again for your answer: https://free.blessedness.top/en-us/answers/questions/5579939/adls-and-optimal-solution My apologies. I missed an important and critical factor : ERP data in ADLS has data since 2016 but the Azure data…
Azure Data Lake Storage
Not able to access the ADLS storage account via Microsoft Purview scanning
I have created an SPN and stored secretes under the KV "abcd". I am trying to Scan the Storage account 'stkordnadlsprod01' from Purview . but I am getting below errors. Request failed with status code 403 Request ID:…
Azure Data Lake Storage
ADLS and optimal solution
Hi Kind friends, the scenario I am currently in , and I have made lots of deliberations but I need your expert guidance. We have a database that is currently moved and hosted in Azure managed instance(MI) , and we have an ERP tool which is already…
Azure Data Lake Storage
Request for Guidance on Enabling Managed Identity for Blob Storage Access with HNS Requirement
As part of our IT Security compliance and audit requirements, we are aligning with Microsoft’s recommendation to use Azure Active Directory (Azure AD) for authorizing access to Azure Storage accounts, instead of using Shared Key authorization. Azure AD…
Azure Data Lake Storage
partition the csv files creating log files
I am partitioning the csv files and storing in azure data lake. The destination contains:- _committed_138917450370135985 _started_138917450370135985 _SUCCESS part-00000-tid-138917450370135985-822eee2b-508b-46ea-9ed6-c426f350d05c-223-1-c000.csv I only…
Azure Data Lake Storage
Azure Databricks
How to know how much storage you have in Dataverse
I am building a website through PowerPages that allows users to upload their files. However, I am not sure if there is any storage limit, rate limit, etc. How can I check on those details
Azure Data Lake Storage
Upgrade to a storage account with Azure Data Lake Gen2 capabilities is temporarily disabled
Hi, I would like to upgrade a Storage Account with Data Lake Gen2 capabilities (hierarchical namespace). When I'm trying to do it from Azure console UI, I'm getting the message: "Upgrade to a storage account with Azure Data Lake Gen2 capabilities is…
Azure Data Lake Storage
adls static data sources
Hi friends, Thank you to the experts @Anonymous and @Anonymous for the direction and kind help. https://free.blessedness.top/en-us/answers/questions/5532358/adls-structure-approach …
Azure Data Lake Storage
Storage options and solution
Hi kind friends, as we are moving data views from virtualization tool to Azure, we are left with two options in data landing, create these views in Synapse dedicated pool and data would reside in table within Synapse, another option is follow the current…
Azure Data Lake Storage
ADLS data incoporation with other data source
Hi friends, we have an ERP data in ADLS and we have come up with KPIs on that dataset, but business want KPIs that consist of ERP and legacy application data which has data since that legacy database host data since 1985 hence it want KPIs that enlist…
Azure Data Lake Storage
ADLS structure approach
Hi friends, we are getting data from API endpoint , and saving the data in Parquet file format, since it is Parquet file format ,I have designed Data Lake hierarchical order in the form ,ADLS hierarchy for landing zone,bronze, silver layer now, for…
Azure Data Lake Storage
How to change Blob Inventory files daily generation time
In my Azure Data Lake Storage Gen2 storage account, I have a Blob Inventory rule to generate files daily: I want the files to be generated at the end of the day (9PM), since I have another scheduled process that consumes the generated data at 10PM every…
Azure Data Lake Storage
[URGENT] Accidental Deletion of Azure Data Lake Storage Gen2 Account – Can Data Be Restored?
Hello Microsoft Support Team, I am reaching out regarding an accidental deletion of our Azure Data Lake Storage Gen2 account. The storage account was deployed inside the Resource Group rg-x-production, which I unintentionally deleted. After the deletion,…
Azure Data Lake Storage
Azure Storage account tier availability
Hi, We plan on using Lifecycle policies in Azure Storage Account (ADLS). I know there are different SLAs for tiers. The question is: if a blob is in cold tier and this tier is unavailable, can we move it to hot tier and the blob can be read again? Would…
Azure Data Lake Storage
how to get SLA% of a storage account
we knew there a metric Availability showing the SLA% of a storage account (https://free.blessedness.top/en-us/azure/azure-monitor/reference/supported-metrics/microsoft-storage-storageaccounts-metrics#category-transaction ), but this metric also contains…
Azure Data Lake Storage
Connecting to Azure Data Lake Storage Gen2 from Tableau Desktop is throwing error
Error Receiving in Tableau Desktop: Tableau received an OAuth error from your request. Please see the error message for more information: User authorization failed (invalid_client). When checked the auth url it seems the url is the one like below -…
Azure Data Lake Storage
401 Unauthorized "Audience validation failed" from ADLS endpoint
We are using service principal credentials to authenticate using OAuth2 token. Fetching the access token step is successful however, request getting failed when hitting ADLS endpoint . Error response : Exact error message :…
Azure Data Lake Storage
How to enable Managed Identity for accessing an ADLS Gen2 storage?.
How to enable or use Managed Identity for an ADLS Gen2 storage, instead of using storage access keys.