cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Kumshan450 Helper II
Helper II

Re: Create new table by filtering column value

Hi I Finally got the answer, 

 

I created the new table by applying the formula using calculate table function. 

 

Distinctreceiptdump = CALCULATETABLE(Receiptdump,filter(Receiptdump,Receiptdump[Count]=1))

View solution in original post

Kumshan450 Helper II
Helper II

Re: Create new table by filtering column value

Its 20 lakh rows of data.

 

Also i dont want unique combinations. I want unique receipt no. 

 

IF i apply the formula 

Table = SUMMARIZE(Receiptdump,Receiptdump[Receipt no],Receiptdump[BPIS NO],Receiptdump[BPIS Date])

 

IT will show the unique combinations of receipt no|Receipdate|BPISno.

 

I want to remove all the duplicate receipt no and concentrate only on the unique receipt no. 

 

I have mentioned in the post that there are also samples where receipt no are same but the BPIS no and dates are different. I dont want to filter this data. I want to remove the same. 

Kumshan450 Helper II
Helper II

Re: Create new table by filtering column value

Its 20 lakh rows of data.

 

Also i dont want unique combinations. I want unique receipt no. 

 

IF i apply the formula 

Table = SUMMARIZE(Receiptdump,Receiptdump[Receipt no],Receiptdump[BPIS NO],Receiptdump[BPIS Date])

 

IT will show the unique combinations of receipt no|Receipdate|BPISno.

 

I want to remove all the duplicate receipt no and concentrate only on the unique receipt no. 

 

I have mentioned in the post that there are also samples where receipt no is same but the BPIS no and dates are different. I don't want to filter this data. I want to remove the same. 

Anonymous
Not applicable

Re: Create new table by filtering column value

Hi @Kumshan450,

 

Perfect! I see that you must be using Power BI then and not Power Pivot?

 

Congrats and Kudos,

 

Kris

Kumshan450 Helper II
Helper II

Re: Create new table by filtering column value

Hi, It will not filter out the below sample which is also a duplicate

 

Hi, I want to mention that there are also samples where receipt no is same but the BPIS no in the table are different. 
 
Receipt noBPIS NOBPIS DateMapping status Count
C009352180066251015x28-01-2018MAPPED2
C009352180066251016x28-01-2018MAPPED2

 

However, I applied the calculate table function which is giving me distinct values. 

 

Distinctreceiptdump = CALCULATETABLE(Receiptdump,filter(Receiptdump,Receiptdump[Count]=1))

 

Why am I totally against removing duplicates in power query stage? Removing duplicate step dont fit large volume of data. I am handlling around 20 lakh rows of data. IF suppose i add additional months and refresh OH god I have to wait for months to load the query in data model. 

Kumshan450 Helper II
Helper II

Re: Create new table by filtering column value

Yes i am using power BI

Helpful resources

Announcements
New Ranks Launched March 24th!

New Ranks Launched March 24th!

The time has come: We are finally able to share more details on the brand-new ranks coming to the Power BI Community!

‘Better Together’ Contest Finalists Announced!

‘Better Together’ Contest Finalists Announced!

Congrats to the finalists of our ‘Better Together’-themed T-shirt design contest! Click for the top entries.

Arun 'Triple A' Event Video, Q&A, and Slides

Arun 'Triple A' Event Video, Q&A, and Slides

Missed the Arun 'Triple A' event or want to revisit it? We've got you covered! Check out the video, Q&A, and slides now.

Join THE global Microsoft Power Platform event series.

Join THE global Power Platform event series.

Attend for two days of expert-led learning and innovation on topics like AI and Analytics, powered by Dynamic Communities.

Community Summit North America

Community Summit North America

Innovate, Collaborate, Grow. The top training and networking event across the globe for Microsoft Business Applications

Top Solution Authors
Top Kudoed Authors