cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
geetika1993 Occasional Visitor
Occasional Visitor

Azure Blob Storage: Failing to load 7GB dataset

Hi All,

 

I'm using Azure Blob Storage as a Source in Power BI, After editing the query & on applying the changes, its taking a lot of time as CSV file is of about 7GB. It fails most of the time.Capture.JPG

We want the process & load time to be less.

I'm providing the require key & other details as well.

 

We are stuck on this 

Please help me out, how can it be done.

2 REPLIES 2
dearwatson Member
Member

Re: Azure Blob Storage: Failing to load 7GB dataset

Hi Geetika1993

 

loading a 7GB csv from blob storage is not ideal. I'm not sure its supported. You may need to use data factory or SSIS to move this into a SQL source.

 

Some things to test: 

 

1. Does the query work if you only load a small part of the file (create a csv with only a few rows and then try and load it)

2. can you push this csv to Azure SQL? you would have more control.

3. Try using dataflows in the cloud service to pull it into power bi.

 

Cheers

Greg

"The commonality between science and art is in trying to see profoundly - to develop strategies of seeing and showing." - Edward Tufte
Highlighted
ananeto Frequent Visitor
Frequent Visitor

Re: Azure Blob Storage: Failing to load 7GB dataset

If your CSV is 7GB big...  Have you considered using a database instead?

Helpful resources

Announcements
Can You Solve These Challenge

Challenge: Can You Solve These?

Find out how to participate in the first Power BI 'Can You Solve These?' challenge.

Community News & Announcements

Community News & Announcements

Get your latest community news and announcements.

Virtual Launch Event

Microsoft Business Applications October Virtual Launch Event

Join us for an in-depth look at the new innovations across Dynamics 365 and the Microsoft Power Platform.

Community Kudopalooza

Win Power BI Swag with Community Kudopalooza!

Each week, complete activities and be qualified in the drawing for cool Power BI Swag.

Users Online
Currently online: 6 members 1,233 guests
Please welcome our newest community members: