cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
aleggore
Frequent Visitor

Duplicate values

I am finding duplicate values in my dataset after I try to refresh. There are no duplicate values showing when I run my query independently or in Power Query before I load to PowerBI. Has anyone seen this happen before and know of any resolution? 

1 ACCEPTED SOLUTION
StefanoGrimaldi
Super User
Super User

power query doesnt load all the data since its just load a sample data for you to see the tranformation you doing, when you apply the query power bi desktop does pull all the data from the source, so probably there its some duplicate on the source data, or a tranformation you applying its generating the duplicate (this can be the case happends frenquently over merge or append steps)





Did I answer your question? Mark my post as a solution! / Did it help? Give some Kudos!

Proud to be a Super User!




View solution in original post

2 REPLIES 2
v-luwang-msft
Community Support
Community Support

Hi @aleggore ,

Please check if your steps include the following.

vluwangmsft_0-1654052456058.png

I created the file containing the duplicate data for testing and after importing it, the duplicates did not disappear, you can use my file for testing.

vluwangmsft_1-1654052797191.png

Best Regards

Lucien

StefanoGrimaldi
Super User
Super User

power query doesnt load all the data since its just load a sample data for you to see the tranformation you doing, when you apply the query power bi desktop does pull all the data from the source, so probably there its some duplicate on the source data, or a tranformation you applying its generating the duplicate (this can be the case happends frenquently over merge or append steps)





Did I answer your question? Mark my post as a solution! / Did it help? Give some Kudos!

Proud to be a Super User!




Helpful resources

Announcements
Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.

Power BI Dev Camp Session 23 768x460.jpg

Check it Out!

Mark your calendars and join us on Thursday, June 30 at 11a PDT for a great session with Ted Pattison!

June 20 episode 7 with aka link 768x460.jpg

The Power BI Community Show

Join us on June 20 at 11 am PDT when Kim Manis shares the latest on Azure Synapse analytics, the Microsoft Intelligent Data Platform, and notable Power BI Updates from Microsoft Build 2022.

Top Solution Authors