File size is getting double when loading from Azure blob storage to Power BI Desktop

[nowreena21]

Hello Community,

I am facing issue while loading csv file from Azure blob storage. I am reading a csv file which is around 4 GB on Azure blob storage but PBI load more than 8 GB for it. 

I have checked all below:
1. My file only has one data source connected (Azure blob storage)

2. I have only one page in the PBI .pbix file

Can anyone help on it?

[lbendlin · Accepted solution]

You know that Power BI loads certain files twice, and runs queries twice, to get to the meta data, right?

Apart from the observed doubling in network traffic, are there any other adverse effects? Did the dataset size increase accordingly or did it stay the same?

[lbendlin · Accepted solution]

10 GB is only the limit for the initial dataset size.  If you set the dataset to incremental refresh then you can grow the dataset size beyond 10 GB during subsequent refreshes.

[nowreena21]

Thank you @lbendlin , 

This makes sense, the pbix file is getting compressed significantly, nothing is duplicvating just the load size is doubled which makes refresh taking longer time. 

Also, Do you have idea on load size limit on power BI? I read that power BI premium support 10GB dataset size, so wanted to make sure that it isn't causing any load error in future if file load increases above 10gbs. 

[lbendlin · Accepted solution]

You know that Power BI loads certain files twice, and runs queries twice, to get to the meta data, right?

Apart from the observed doubling in network traffic, are there any other adverse effects? Did the dataset size increase accordingly or did it stay the same?