Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
karun_r
Employee
Employee

Incremental Refresh without Last Modified Date

I have a dataset that is kind of huge, the file is around 4 GB at this point and there is nothing I can do about it. 

 

This model has a table that is pulling data for about like two fiscal quarters at customer level for each day. And the datasource for this table doesn't have a LastModifiedDate column indicating if a row has been updated. And I don't have the guarantee that the data in the original source for a random day would not be updated today/tomorrow etc. 

 

So I don't have a way to figure out which row has been modified. So I suppose Incremental Refresh is out of the question. Is there any clever way to reduce the refresh times for this dataset? It takes around 10-15 mins to refresh the table each time. And how common is having a PBI report with size of around 2+ GB ? Should I be looking for some alternative approach like building a tabular model on a different server and just pulling the measures into the report ? Or is it okay to have this big dataset on the .pbix file ?

3 REPLIES 3
Anuradha
Frequent Visitor

It depends on the infrastruction and license.

 

Power BI supports Max of 1 GB (.pbix).
Power BI Premium supports (.pbix) files that are up to 10 GB in size.

 

However the capacity of the desktop version will depend on your infrastructure limitations.

 

Following blogs might give you more insight on the file size limitations:
https://powerbi.microsoft.com/en-us/blog/power-bi-service-may-update-file-size-increase-to-1-gb/
https://docs.microsoft.com/en-us/power-bi/service-premium-large-datasets

I am not actually concerned on the limitations. I just wanted to know how common it is to have models of that size in general use cases. 

Hi karun_r,

 

The datasize of your report depends on your specific. senario. If you have resolved your issue, could you please mark the answer above to finish this thread?

 

Regards,

Jimmy Tao

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.