Azure Blob Storage: Failing to load 7GB dataset

[Anonymous]

Hi All,

I'm using Azure Blob Storage as a Source in Power BI, After editing the query & on applying the changes, its taking a lot of time as CSV file is of about 7GB. It fails most of the time.

We want the process & load time to be less.

I'm providing the require key & other details as well.

We are stuck on this 

Please help me out, how can it be done.

[dearwatson]

Hi Geetika1993

loading a 7GB csv from blob storage is not ideal. I'm not sure its supported. You may need to use data factory or SSIS to move this into a SQL source.

Some things to test: 

1. Does the query work if you only load a small part of the file (create a csv with only a few rows and then try and load it)

2. can you push this csv to Azure SQL? you would have more control.

3. Try using dataflows in the cloud service to pull it into power bi.

Cheers

Greg

[ananeto]

If your CSV is 7GB big...  Have you considered using a database instead?