cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Regular Visitor

Request: Deployments pipelines should support centralized datasets

In this link it is recommended to use a centralized workspace with datasets.

https://docs.microsoft.com/en-us/power-bi/create-reports/deployment-pipelines-best-practices


However in Deployment Pipelines -> Deployment Settings, when creating a "Dataset Rule", the only option to use another dataset is to add new connection string.  This creates a new dataset in the Workspace.

 

This seems to contradict the suggestion to use Workspace with centralized datasets.

"Deployment pipelines best practices

If you're using centralized datasets that are used across the organization, we recommend that you create two types of workspaces:

  • Modeling and data workspaces - These workspaces will contain all the centralized datasets"

 

From my understanding, it should be possible to link a Dataset Rule to a Dataset in another Workspace.

This would allow to have one dataset per environment (e.g. DEV) for all pipelines.

 

 

 

 

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
Power BI Team
Power BI Team

Hi @harold ,

Reports can be managed in pipelines even is they are connected to external datasets.

whenever you deploy report update across the stages, it will keep pointing to the same shared dataset.

You can also manage 'central datasets' WS in pipelines.

 

However, managing both datasets and connected reports in separate pipelines is still not working in an optimal way, as there's no built-in way to connect each dataset in each stage with the correlated reports in each stage.

 

We recommend that for now, you connect all reports in all stages to the Prod dataset. in the 'central datasets' pipeline, keep few reports for testing in each stage, so that any change in datasets will be verified on reports before hitting Prod.

 

If you still encounter problems in some reports, you can use the dev/ test stages to fix it in each pipeline, and deploy to Prod.

 

Hope it was clear.

View solution in original post

2 REPLIES 2
Highlighted
Super User II
Super User II

This may be a mixing of two concepts - or me misunderstanding the issue.

 

concept 1:  Ability to use shared datasets across multiple workspaces: allows disparate audiences to be served with the same set of master data, but filtered/restricted according to the audience.  Reduces development effort, avoids duplication of data, gets you closer to the "one source of truth"  fallacy. Sorry, ideal. I meant to say ideal.

 

concept 2: Ability to speed up development and testing proess without impacting actual production systems.  DEV and ITG workspaces can be pointed to datasets that have a reduced but still representative subset of the data, and can also emulate flush&fill events that may not be desirable in production

 

Neither concept needs deployment pipelines, but the second concept sure benefits from them.

Highlighted
Power BI Team
Power BI Team

Hi @harold ,

Reports can be managed in pipelines even is they are connected to external datasets.

whenever you deploy report update across the stages, it will keep pointing to the same shared dataset.

You can also manage 'central datasets' WS in pipelines.

 

However, managing both datasets and connected reports in separate pipelines is still not working in an optimal way, as there's no built-in way to connect each dataset in each stage with the correlated reports in each stage.

 

We recommend that for now, you connect all reports in all stages to the Prod dataset. in the 'central datasets' pipeline, keep few reports for testing in each stage, so that any change in datasets will be verified on reports before hitting Prod.

 

If you still encounter problems in some reports, you can use the dev/ test stages to fix it in each pipeline, and deploy to Prod.

 

Hope it was clear.

View solution in original post

Helpful resources

Announcements
Community Conference

Power Platform Community Conference

Check out the on demand sessions that are available now!

Community Conference

Microsoft Power Platform Communities

Check out the Winners!

secondImage

Create an end-to-end data and analytics solution

Learn how Power BI works with the latest Azure data and analytics innovations at the digital event with Microsoft CEO Satya Nadella.

Top Solution Authors
Top Kudoed Authors