Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
dparkinson
Advocate I
Advocate I

Streaming Dataset DateTime Field Date Hierarchy Missing

I've previously asked this in the developer forum, but it's a little quiet over there, so I thought I'd try here too -- hope that's ok...

 

I have a streaming dataset with a DateTime field. The streaming dataset is keeping historical data. When I create a report to put on a dashboard using the DateTime field, I do not have any date hierarchy capabilities. I am therefore not able to see my data by day/month, only by time.

Whilst it's great to see the data realtime, some departments only want to see that data summarised over day/week/month not by minute. I'm truly hoping that I'm doing something wrong rather than a fundamental piece of functionality being missing.

Any thoughts greatly received.
Many thanks,
D.

9 REPLIES 9
JasonWelch
Frequent Visitor

I think my issue https://community.fabric.microsoft.com/t5/DAX-Commands-and-Tips/Simple-cumulative-sum-issue-with-liv... is probably the same as this one.  Not only is the date hierarchy missing, but cumulative measures built off the datetime field don't work.  I think this is a reasonable use-case for live stream data though - we're maybe showing live, "last hour" and "cumulative today" data so this is quite a limitation for live streams IMHO.

Anonymous
Not applicable

I'm guessing this is a missing feature for streaming datasets. I've tried to accomplish your exact solution for the same reasons but failed to create the hierarchies. Adding new measures for dateparts and using those as drill down layers might work for some visuals, but to be honest I'm not about to spend that time. 

The main reason behind this issue might be that creating detailed aggregated reports may not be what PBI team is aiming with streaming datasets. Let's agree on the best way they work is when you need to monitor frequent data, like sensor streams. I'm leaning towards seperating the datasets for respective purposes: real-time and warm data.

 

@dparkinson have you found any workaround to this?

kartikeya
Regular Visitor

Hi, I am facing sort of same issue.

When "Historic Data Analysis" tab is checked, it does not take timestamp as Datetime, rather accepts it if i change it to Text.

But unfortunately I am unable to use the date hierarchy while creating reports from the same since it recognizes it as just a string.

alanhodgson
Solution Supplier
Solution Supplier

I am having the same issue. PBI Desktop doesn't seem to support the data heirarchy feature on live streaming data. Some of the visualizations don't have the data heirarchy feature at all, even with the data type set to DateTime.

CahabaData
Memorable Member
Memorable Member

I don't have a streaming data set but maybe this will be the same: in Dataset - starting with a blank canvas, select your date field from the right Fields pane so it shows up in the canvas

 

then in the Visualization pane, look at it's drop down and see if Date Hierarchy is checked.......

 

 

www.CahabaData.com

Hi, thanks for the response.  Yes, that's the point, that option is missing...

any chance the field is coming is a text field?  any strange alpha mingled in to make PBI think it is text?

www.CahabaData.com

So, to be clear, this is a streaming dataset with the field set as a DateTime field.  When shown on a live tile, it shows the data updating every 30 seconds (as that is how often I'm updating the data), so the field is recognised ok as a date time field.  It's just that when I put the field onto a normal report (rather than realtime), date hierarchy is not an option so that I can view average stats over a day/week/month/year etc.

 

I hope that's clearer.

 

sds.png

 

 

Hi,
I'm facing the same issue. I can only use date hierarchy when I use a normal (not streaming) data source.
As a workaround, I pushed the same JSON data to Azure Event Hub, then with a Stream Analytics job copied it into a DocumentDB database.
The DocumentDB database can be used as source with Power BI Desktop. If you publish the report to Power BI online service, data can be refreshed with a schedule (pro feature) automatically from Azure DocumentDB. Since the source is not a stream anymore, it is not useful to show real time data on a dashboard, but you can build better reports.
However, if you keep pushing the same data (same JSON string) straight to Power BI too, you can display that data on a dashboard in a real-time way.

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors