Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
kmas
Frequent Visitor

Streaming Dataset limitations

Hi all,

 

I'm creating a data flow between a remote equipment and Power BI (JSON format).

I create streaming dataset option in Power BI  where I define the different fields of these data.

I also switch ON the "Historic data analysis".

 

Can someone clarify me the data memory limitations for my current scenario? 

I've seen this official info:   

 

  • 75 max columns
  • 75 max tables
  • 10,000 max rows per single POST rows request
  • 1,000,000 rows added per hour per dataset
  • 5 max pending POST rows requests per dataset
  • 120 POST rows requests per minute per dataset
  • If table has 250,000 or more rows, 120 POST rows requests per hour per dataset
  • 200,000 max rows stored per table in FIFO dataset
  • 5,000,000 max rows stored per table in ‘none retention policy’ dataset
  • 4,000 characters per value for string column in POST rows operation

However, I'm not sure if my current configuration is "none retention policy" or not.

 

In addition, can someone explain to me the differences between "historic data analysis" enabled or disabled in terms of rows limitations?

 

Thanks in advance 

1 ACCEPTED SOLUTION
v-shex-msft
Community Support
Community Support

Hi @kmas,

 

>>However, I'm not sure if my current configuration is "none retention policy" or not.

AFAIK, FIFO mode is for live steam dataset, otherwise I think they will use the ‘non retention policy’ mode to store dataset.

 

>>In addition, can someone explain to me the differences between "historic data analysis" enabled or disabled in terms of rows limitations?

As document said, streaming dataset itself not cache/store data, so you can only create particular live tiles and can't do any customize on it.


Historic data analysis feature is for customize. If you turn on it, pushed records will caching to dataset so you cna use these history data to create other visualizations

Real-time streaming in Power BI

 

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin
If this post helps, please consider accept as solution to help other members find it more quickly.

View solution in original post

2 REPLIES 2
v-shex-msft
Community Support
Community Support

Hi @kmas,

 

>>However, I'm not sure if my current configuration is "none retention policy" or not.

AFAIK, FIFO mode is for live steam dataset, otherwise I think they will use the ‘non retention policy’ mode to store dataset.

 

>>In addition, can someone explain to me the differences between "historic data analysis" enabled or disabled in terms of rows limitations?

As document said, streaming dataset itself not cache/store data, so you can only create particular live tiles and can't do any customize on it.


Historic data analysis feature is for customize. If you turn on it, pushed records will caching to dataset so you cna use these history data to create other visualizations

Real-time streaming in Power BI

 

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin
If this post helps, please consider accept as solution to help other members find it more quickly.

Thank you very much for the clarification!

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.