Streaming Dataset seems to be locked at around 200000 - 220000

[Mike282]

Hi all so a quick question about the streaming dataset and having historical analysis turned on. 

I read somewhere that with historial analysis turned on it can hold up to 5 million rows but what I've noticed is that as I'm adding data to the Streaming dataset it's seems to be deleting the old data. It seems to be capped at around 200,000 to 220,000 rows before anymore data being sent via the API seems to be replacing the old. 

My question is how do I get it to retain a maximum of 5 million rows? I'm happy for it to override the old data once it hits that but at the moment it's overwriting at around 200,000.

So steps to create:

1. Create a streaming dataset and set it to add data via the API and then turn Historic data analysis on.

2. Start streaming data into the dataset via the API. 

3. I created a report from that dataset but the total rows seem to always hover between 200,000 to 220,000 rows.

Am I doing something wrong or is that the limitation? I thought historical data analysis can hold up to 5 million rows? 200,000 rows is well below what's documented.

[v-shex-msft]

Hi @Mike282,

I agree with lbendlin 's point of view, I'd like to suggest you check the limitations of API usages if they meet your scenarios:

Power BI REST API limitations - Power BI | Microsoft Docs
Regards,

Xiaoxin Sheng

[lbendlin · Accepted solution]

I think the actual limit is size based. If you have a row with just the UTC timestamp and a single value column you'll probably see a higher row limit.