cancel
Showing results for 
Search instead for 
Did you mean: 
Reply

Re: Duplicates values exist in a column when in report / data view but not in query editor

I'm able to see which values are being duplicated. There isn't a pattern that I can see. Interestingly, having done a full refresh different ids are being duplicated (e.g. id 35 is now unique)

MarcelBeug Super Contributor
Super Contributor

Re: Duplicates values exist in a column when in report / data view but not in query editor

Maybe something is happening in your query that might explain this behaviour.

 

I would focus on using volatile data like random numbers / current time stamps, different number formats (e.g. a duration of 35 days and number 35 would both load to number 35 in the data model).

 

One should also realize that query steps may be evaluated differently than might be expected. Maybe data is read from your source more than once.

 

How stable is the data in the source database? If it's highly volatile, then it may be that data is changing while loading.

 

Maybe you can use Table.Buffer to freeze your data, although this might harm performance as it will kill any query folding.

 

Or are you using Direct Query?

 

Maybe you can share the query code from the advanced editor (any sensitive parts like field names anonimized)?

 

As you may notice, it is hard to give a general answer, so we definitely need your help with supplying all relevant information as far as reasonably possible. I understand and appreciate fully that you can't share any sensitive data.

Specializing in Power Query Formula Language (M)
Super User
Super User

Re: Duplicates values exist in a column when in report / data view but not in query editor

Just a guess: Skip the sorting-operation and see if you still get dups.

If you liked my solution, please give it a thumbs up. An if I did answer your question, please mark my post as a solution. Thanks!

Proud to be a Datanaut!

Imke Feldmann

How to integrate M-code into your solution -- Check out more PBI- learning resources here -- Performance Tipps for M-queries




Re: Duplicates values exist in a column when in report / data view but not in query editor

Some intersting suggestions.  I'm querying a production database (not ideal I know...), so there will be new IDs every refresh, and it is also possible that the source data will change during loading.

 

I'm not using direct query so I'll try your Table.Buffer suggestion; lack of query folding won't be a problem because I'm extracting the entire table and the load is pretty quick anyway

 

I won't have access to the database though until next week. If your suggestions don't work I will try and create a PBIX with just the id column and share that. In the meantime, thanks for your help!

 

 

Helpful resources

Announcements
New Topics Started Badges Coming

New Topics Started Badges Coming

We're releasing new versions of the badge that everyone's talking about. ;) Check your inbox for notifications.

MBAS 2020

Save the new date (and location)!

Our business applications community is growing—so we needed a different venue, resulting in a new date and location. See you there!

Difinity Conference

Difinity Conference

The largest Power BI, Power Platform, and Data conference in New Zealand

Power Platform 2019 release wave 2 plan

Power Platform 2019 release wave 2 plan

Features releasing from October 2019 through March 2020

Top Solution Authors
Top Kudoed Authors (Last 30 Days)