cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Anonymous
Not applicable

What about too much data

hi all

 

       When I was using power bi Desktop, there was a data source with about 500,000 lines, which made my data refresh slow. Does anyone know what to do?

       I don't need all these data. Is there any way to intercept them?

 

Best Regards

alan-li

1 ACCEPTED SOLUTION

Thanks 🙂

There are difinity ways to filter it, based on the top N records. filtering based on a field.

you can also apply grouping and aggregations on the dataset to make it smaller if you want.


Cheers

Reza

Author, Consultant, Speaker
https://radacad.com

View solution in original post

5 REPLIES 5
reza_rad
MVP

500K is not a lot of rows.

I had 500M rows with Power Query with no problem.

I believe either the data source is slow that you feel 500K loads slowly. Or you have done some complex set of transformations.

 

However, if you don't need all the data, there are ways to filter the data and load only parts that you want. For example, if you have a date field, you can only filter data for the previous periods (last 2, 3 years/quarters/months etc)

Author, Consultant, Speaker
https://radacad.com
Anonymous
Not applicable

hi @reza_rad 

 

Big guy, I have been reading your book, thank you very much for sharing

 

Best Regards

alan-li

Anonymous
Not applicable

hi @reza_rad 

 

Not many in this day and age. But it's growing by tens of thousands every day, so I was wondering if I could filter some data

 

Best Regards

alan-li

 

Thanks 🙂

There are difinity ways to filter it, based on the top N records. filtering based on a field.

you can also apply grouping and aggregations on the dataset to make it smaller if you want.


Cheers

Reza

Author, Consultant, Speaker
https://radacad.com

View solution in original post

Anonymous
Not applicable

hi @reza_rad 

 

thinks a lot , 

 

Best Regards

alan-li

Helpful resources

Announcements
PBI User Groups

Welcome to the User Group Public Preview

Check out new user group experience and if you are a leader please create your group

March Update

Check it Out!

Click here to read more about the March 2021 Updates!

secondImage

The largest Power BI virtual conference

100+ sessions, 100+ speakers, Product managers, MVPs, and experts. All about Power BI. Attend online or watch the recordings.

secondImage

Experience what’s next for Power BI

See the latest Power BI innovations, updates, and demos from the Microsoft Business Applications Launch Event.

Top Solution Authors
Top Kudoed Authors