PowerBi Connection with Datawarehouse or any data source with 10/100 million data

[djmenon22]

How do I connect PowerBi with any Data Warehouse or any datasource that has 100 millions of data?

What's the right steps and settings to keep for optimal performance? Please help

[amitchandak]

@djmenon22 , prefer import mode as far as possible

Try not to have any new column in power query or DAX, Try to have that in DW

Prefer to use Star schema with single direction join 

Do not bring unnecessary rows or columns in the power bi dataset

[djmenon22]

Thanks Amit.

But when it comes to import with so many records how do I set it for schedule refresh because it would take a lot of time for refreshing the datasets when we publish it to Service. What do you suggest. There could be multiple tables and records in them so when it comes to refreshing them automatically wont it fail?

[v-easonf-msft]

Hi， @djmenon22 

For the refresh of large datasets, Incremental refresh and real-time data will help you to some extent.

Incremental refresh extends scheduled refresh operations by providing automated partition creation and management for dataset tables that frequently load new and updated data. 

Best Regards,
Community Support Team _ Eason