cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
kmas Frequent Visitor
Frequent Visitor

Streaming Dataset limitations

Hi all,

 

I'm creating a data flow between a remote equipment and Power BI (JSON format).

I create streaming dataset option in Power BI  where I define the different fields of these data.

I also switch ON the "Historic data analysis".

 

Can someone clarify me the data memory limitations for my current scenario? 

I've seen this official info:   

 

  • 75 max columns
  • 75 max tables
  • 10,000 max rows per single POST rows request
  • 1,000,000 rows added per hour per dataset
  • 5 max pending POST rows requests per dataset
  • 120 POST rows requests per minute per dataset
  • If table has 250,000 or more rows, 120 POST rows requests per hour per dataset
  • 200,000 max rows stored per table in FIFO dataset
  • 5,000,000 max rows stored per table in ‘none retention policy’ dataset
  • 4,000 characters per value for string column in POST rows operation

However, I'm not sure if my current configuration is "none retention policy" or not.

 

In addition, can someone explain to me the differences between "historic data analysis" enabled or disabled in terms of rows limitations?

 

Thanks in advance 

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
Community Support Team
Community Support Team

Re: Streaming Dataset limitations

Hi @kmas,

 

>>However, I'm not sure if my current configuration is "none retention policy" or not.

AFAIK, FIFO mode is for live steam dataset, otherwise I think they will use the ‘non retention policy’ mode to store dataset.

 

>>In addition, can someone explain to me the differences between "historic data analysis" enabled or disabled in terms of rows limitations?

As document said, streaming dataset itself not cache/store data, so you can only create particular live tiles and can't do any customize on it.


Historic data analysis feature is for customize. If you turn on it, pushed records will caching to dataset so you cna use these history data to create other visualizations

Real-time streaming in Power BI

 

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin Sheng
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.



For learning resources/Release notes, please visit: | |

View solution in original post

2 REPLIES 2
Highlighted
Community Support Team
Community Support Team

Re: Streaming Dataset limitations

Hi @kmas,

 

>>However, I'm not sure if my current configuration is "none retention policy" or not.

AFAIK, FIFO mode is for live steam dataset, otherwise I think they will use the ‘non retention policy’ mode to store dataset.

 

>>In addition, can someone explain to me the differences between "historic data analysis" enabled or disabled in terms of rows limitations?

As document said, streaming dataset itself not cache/store data, so you can only create particular live tiles and can't do any customize on it.


Historic data analysis feature is for customize. If you turn on it, pushed records will caching to dataset so you cna use these history data to create other visualizations

Real-time streaming in Power BI

 

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin Sheng
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.



For learning resources/Release notes, please visit: | |

View solution in original post

kmas Frequent Visitor
Frequent Visitor

Re: Streaming Dataset limitations

Thank you very much for the clarification!

Helpful resources

Announcements
Ask Amanda Anything Q&A

Ask Amanda Anything Q&A

Learn the answers to some of the questions asked during the Amanda Triple A event.

October 2019 Community Highlights

October 2019 Community Highlights

October was a busy month in the community. Read the recap article to learn about some of the events and content.

New Solution Badges

New Solution Badges

Two waves of brand new solution badges are coming! Read the article for more information on our new community badges.

Analytics in Azure virtual event

Analytics in Azure virtual event

Experience a limitless analytics service built to ingest, prep, manage, and serve data for immediate use in Power BI.

Users Online
Currently online: 6 members 1,635 guests
Please welcome our newest community members: