cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
santiagomur
Resolver II
Resolver II

performance .parquet patitions datalake gen2

hi, 
I am using .parquet partitions and I would like to know which is better, to have a single partition or many partitions, currently I have 24 partitions about 200mb each and power bi desktop gives me a memory error when i try to refresh.

I would like to know if processing small partitions can reduce memory usage?
greater number of partitions longer refresh time?
How do I know how much memory I need to do the refresh?  


1 REPLY 1
lbendlin
Super User
Super User

Sounds more like a configuration issue on your datalake.  Which SKU are you running this on?

Helpful resources

Announcements
Carousel_PBI_Wave1

2023 Release Wave 1 Plans

Power BI release plans for 2023 release wave 1 describes all new features releasing from April 2023 through September 2023.

Power BI Summit Carousel 2

Global Power BI Training

Make sure you register today for the Power BI Summit 2023. Don't miss all of the great sessions and speakers!

Thank you 2022 Review

2022 Monthly Feature Releases

We had a great 2022 with a ton of feature releases to help you drive a data culture.