cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
mariya_k Frequent Visitor
Frequent Visitor

Sampling of more than 30,000 data

I develop with custom visuals.

I have one question.

 

How is it sampled when more than 30,000 data is imported?

* In dataReductionAlgorithm of capabilities.json setting
sample is being set.

        "categorical": {
            "categories": {
                "select": [{
                    "bind": {
                        "to": "xxxxxxxxx"
                    }
                }],
                "dataReductionAlgorithm": {
                    "sample": {
                        "count": 30000
                    }
                }
            },

* In the documentation
sample: Reduce the dataset by a simple sampling algorithm, limited to a count number of items.It means that the first and last items are included, and a count number of items have equal intervals between them.For example, if you have a dataset [0, 1, 2, ... 100] and a count of 9, you'll receive the values ​​[0, 10, 20 ... 100].

But I feels different.

https://docs.microsoft.com/ja-jp/power-bi/developer/visuals/dataview-mappings#data-reduction-algorit...

*Shouldn't Power BI read more than 30,000 data?


that's all. Thank you

1 REPLY 1
Super User I
Super User I

Re: Sampling of more than 30,000 data

Hi @mariya_k,

I have requested help from the Custom Visuals team in the past on how the sampling reduction method actually works, as I use it in one of my visuals. All I could get confirmed is that it is not the same as the one used in the core visuals. You might have better luck if you want to liaise with them at pbicvsupport@microsoft.com.

You can go beyond the 30,000 row limit in TypeScript custom visuals, but it is still limited by the amount of memory the development visual sandbox is consuming. I can consistently get 150,000 rows in a test visual I have set up.

If you want to explore this, you need to work with fetchMoreData. Note that you will need to change your dataReductionAlgorithm to window.

I have a couple of repositories that demonstrate this that you are welcome to refer to:

Hopefully some of this might be useful for you. Good luck!

Daniel


If my post solves your challenge, then please consider accepting as a solution to help other forum members find the answer more quickly 🙂





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




Helpful resources

Announcements
Exclusive LIVE Community Event #3 – Ask Arun Anything

Exclusive LIVE Community Event #3 – Ask Arun Anything

Join us in the third Triple A event!

Meet the 2020 Season 1 Power BI Super Users!

Meet the 2020 Season 1 Power BI Super Users!

It’s the start of a new Super User season! Learn all about the new Super Users and brand-new tiered recognition system.

Super User Challenge: Can You Solve These?

Super User Challenge: Can You Solve These?

We're celebrating the start of the New Super User season with our first ever Super User 'Can You Solve These?' challenge.

Power BI Desktop Update - February 2020

Power BI Desktop Update - February 2020

We are super excited for our update this month, as we are releasing two of our top community requests!

Power Platform Online Conference

Power Platform Online Conference

Join us for the first ever Power Platform Online Conference!

Top Kudoed Authors