Options to use close to real-time filterable dashboards/reports

[SiroPW]

Hi All,

My requirement is to have end users view, slice, filter my custom made dashboards/reports with the data being refreshed in as close to real-time as possible (preferably under 1 minute).

My datasets are curated from an API and pre-processed in python (necessary step) - this portion happens in real-time in the background. Currently, I save these outputs to .csv and set up a scheduled refresh in PowerBI service every ~1.5hours (limited to max 8 scheduled refreshes per day).

This is too slow for people to rely on for day-to-day functions so I'm looking for a solution to have the reports updated faster to reflect the true data in the background.

Is this possible with PowerBI? I'm open to using new architectures if required - eg. moving processed data into SQL if that enables real-time updates etc.

Thanks for any assistance.

[v-jiascu-msft]

HI @SiroPW,

There could be two methods.

1. We can store the data in one of the data sources that are supported by Power BI Direct Query. Please refer to desktop-directquery-data-sources and desktop-use-directquery. The direct query mode is close to real-time.

2. Using streaming dataset. Please refer to power-bi/service-real-time-streaming.

Best Regards,

Dale