cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Shadaiv
Helper II
Helper II

Data flow/ Data Mart/ Data verse for Enterprise dataset ?

Hi Experts. 

Need your help to understand the best practice for the Enterprise dataset creation.

 

We want to create a Power BI dataset which should have 80% of data required all the reporting in our organisation. This dataset would have many dimenstions and fact tables. For examples tables like Date, Employee, Cost,  Training Fact, Leave Fact

 

We are thinking 80% of the data would be availble in this dataset and 20% would be report specific. Also Users/ developers should be able to add calculated columns on top of this enterprise dataset.

 

I have been reading all the new features Data flow, Data mart and Data verse, but not sure which feature or combination of feature can be used in this scenario. 

 

Please advice on this. 

 

 

 

 

 

 

1 ACCEPTED SOLUTION

For your requirement I'd do a combination of:

 

1. Dataflows for ETL

2. Promoted dataset

3. Live connection children datasets

 

Feel free to experiment with datamarts to see if they could be part of the solution between the dataflows and promoted dataset, but be aware that they're in Preview and really not suitable for production at the moment.

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
More tips and guidance in my Power BI architecture and development blog

View solution in original post

4 REPLIES 4
otravers
Super User
Super User

I wrote an entry to position these various artifacts, please have a look and let me know if you have more specific questions:

https://www.oliviertravers.com/power-bi-dataset-dataflow-datamart-dataverse-sql-server/

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
More tips and guidance in my Power BI architecture and development blog

Thank you much  @otravers for sharing this. 
I understand all the components now. 

 

For my requirement, I am confused between data flow and Data mart. Should i just create data flows and use it in the Power BI dataset. Or should i create a datamart which is the combination of data flow+database+dataset. 

 

We are using the SQL on premises data base.

 

For your requirement I'd do a combination of:

 

1. Dataflows for ETL

2. Promoted dataset

3. Live connection children datasets

 

Feel free to experiment with datamarts to see if they could be part of the solution between the dataflows and promoted dataset, but be aware that they're in Preview and really not suitable for production at the moment.

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
More tips and guidance in my Power BI architecture and development blog

Well written article @otravers - Kudos for that!


I want to add to this one limitation that I have come across while trying out dataflows,datamarts and datasets for large dataset like this.
When importing huge chunks for data with incremental refreshes into powerbi dataflow and datarmart, you have no controll over the partitions automaticall created by PowerBI and therefore need to load all the data at once and cannot refresh individual partitions seperately.

 

For me this was the reason I ended up using dataset for this same purpose.

Helpful resources

Announcements
August 2022 update 768x460.jpg

Check it Out!

Click here to learn more about the August 2022 updates!

August 1 episode 9_no_dates 768x460.jpg

The Power BI Community Show

Watch the playback when Priya Sathy and Charles Webb discuss Datamarts! Kelly also shares Power BI Community updates.

Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.

Top Solution Authors