cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
geetika1993 Occasional Visitor
Occasional Visitor

Azure Blob Storage: Failing to load 7GB dataset

Hi All,

 

I'm using Azure Blob Storage as a Source in Power BI, After editing the query & on applying the changes, its taking a lot of time as CSV file is of about 7GB. It fails most of the time.Capture.JPG

We want the process & load time to be less.

I'm providing the require key & other details as well.

 

We are stuck on this 

Please help me out, how can it be done.

2 REPLIES 2
dearwatson Member
Member

Re: Azure Blob Storage: Failing to load 7GB dataset

Hi Geetika1993

 

loading a 7GB csv from blob storage is not ideal. I'm not sure its supported. You may need to use data factory or SSIS to move this into a SQL source.

 

Some things to test: 

 

1. Does the query work if you only load a small part of the file (create a csv with only a few rows and then try and load it)

2. can you push this csv to Azure SQL? you would have more control.

3. Try using dataflows in the cloud service to pull it into power bi.

 

Cheers

Greg

"The commonality between science and art is in trying to see profoundly - to develop strategies of seeing and showing." - Edward Tufte
ananeto Frequent Visitor
Frequent Visitor

Re: Azure Blob Storage: Failing to load 7GB dataset

If your CSV is 7GB big...  Have you considered using a database instead?

Helpful resources

Announcements
Virtual Launch Event

Microsoft Business Applications October Virtual Launch Event

Join us for an in-depth look at the new innovations across Dynamics 365 and the Microsoft Power Platform.

Power BI Helps Homeless and Trouble Youth

Power BI Helps Homeless and Trouble Youth

We spoke with Power BI Super User, Greg Deckler, about his charity work

MBAS Gallery

Watch Sessions On Demand!

Continue your learning in our online communities.

Top Kudoed Authors
Users Online
Currently online: 115 members 1,701 guests
Please welcome our newest community members: