Moving large amount of data in the pbi service

[Anonymous]

Hello - I am using Power BI premium per user and I keep getting refersh timeouts on larger datasets. Ultimately, I would like to bring in all my main tables at least daily, this is probably on the order of ~50gb. Looking for best practices, advice or any hidden tricks the community may have. 

[GilbertQ]

Hi @Anonymous 

What I would suggest doing is to create an incremental refresh on your main table. I would suggest configuring it with the last N Months, this is so that it will partition and query monthly. Which will ensure that the query does not take too long to run.

I would then deploy this to your Premium Instance, and then refresh the dataset, which would then create and process those monthly partitions.

One option is to then manually kick off the refresh which would then