Stream Analytics - Update row in dataset

[cdupland]

Hello,

I am using an Azure architecture to have a real-time Dashboard Power BI about Twitter post.

Architecture is like this : Event Hub -> Streaming Analytics -> Power BI

This works fine and I can show Tweets and statistics moce in real-time.

My problem is that Stream Analytics can only add row in my Dataset and it's possible to receive same tweet from my Event Hub.

So I potentially add several times the same Tweet in my Dataset and distort data statistics.

I would like to know if it's possible to do an update with Stream Analytics in the Dataset, or if there is a trick to get the most recent post when there is a duplication ?

Thanks.

Cyril

[v-jiascu-msft]

Hi Cyril,

If they are duplicates, they all could be the most recent. Maybe you can filter them in the beginning. Which visual did you use in the Power BI? Maybe we can filter them using a slicer. About filtering push dataset, please refer to service-real-time-streaming#can-i-use-filters-on-push-dataset-how-about-streaming-dataset.

Best Regards,

Dale

[cdupland]

Hi Dale,

Main visual in Power BI are counting rows (distcint), list, bargraph with date, circular, etc..

I don"t know how to get the most recent row between 2.

Thanks

Cyril

[v-jiascu-msft]

Hi Cyril,

How can we identify the "2"? By date?

Do you mean this scenario below?

row1  news1  date1

row2  news1  date1

row3  news2  date2

Since the row1 and row2 are the same, you need to show up the row1 and row3.

Best Regards,

Dale

[cdupland]

Hi Dale,

My scenario is below :

row1 news1 date1

row2 news1 date2

row3 news2 date1

Row1 and row2 are the same, with date2 > date1.

So, I would like to show row2 and row3.

Thanks

Best Regards

Cyril

[Roberto81]

Hi @cdupland 

Did you solve this issue, I'm struggling with the exact same..

BR

Roberto