cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Helper IV
Helper IV

Identify Duplicates before and after 30 days of a record

Hey everyone,

 

I need to identify duplicates in a tabe chart. The criteria for duplicates is:

-Same Vendor

-Same Reference No

-Same Invoice Amount

-Within 30 days of a record (before and after)

 

For e.g.

VendorReference NoInvoice AmountDate
ABC12310001/23/2020
XYZ11159002/01/2020
ABC12323001/01/2020
XYZ19159002/01/2020
ABC12310012/01/2019

 

Result:

VendorReference NoInvoice AmountDate
ABC12310001/23/2020
ABC12310012/01/2019

 

Would greatly appreciate the help.

1 ACCEPTED SOLUTION
Community Support
Community Support

Hi  @nataliengarces ,

 

Create a measure as below:

 

Measure = 
var _previousdate=CALCULATE(MAX('Table'[Date]),FILTER(ALL('Table'),'Table'[Vendor]=MAX('Table'[Vendor])&&'Table'[Reference No]=MAX('Table'[Reference No])&&'Table'[Invoice Amount]=MAX('Table'[Invoice Amount])&&'Table'[Date]<MAX('Table'[Date])))
var _afterdate=CALCULATE(MAX('Table'[Date]),FILTER(ALL('Table'),'Table'[Vendor]=MAX('Table'[Vendor])&&'Table'[Reference No]=MAX('Table'[Reference No])&&'Table'[Invoice Amount]=MAX('Table'[Invoice Amount])&&'Table'[Date]>MAX('Table'[Date])))
var _datediff1=DATEDIFF(_previousdate,MAX('Table'[Date]),DAY)
var _datediff2=DATEDIFF(MAX('Table'[Date]),_afterdate,DAY)
Return
IF(_previousdate=BLANK()||_afterdate=BLANK(),0,IF(_datediff1<30||_datediff2<30,1,0))

 

As the datediff between "01/23/2020" and "12/01/2019" is 53,not within 30,so my result returns as below:

Annotation 2020-08-05 102741.png

If you get the 1 returned,just go to filter pane,choose measure =1,then you will get what you request.

 

Best Regards,
Kelly
Did I answer your question? Mark my post as a solution!

View solution in original post

7 REPLIES 7
Super User IV
Super User IV

@nataliengarces , Create a new column like

if(countx(filter(Table,[Vendor] =earlier([Vendor]) && [Reference No] =earlier([Reference No]) && [Invoice Amount ] =earlier([Invoice Amount])
&& [date] >=earlier([Date])-30 && [date] <=earlier([Date])+30 ),[Reference No])+0>=2, "Duplicate", "Not Duplicate")

 

and filter Duplicate



Did I answer your question? Mark my post as a solution! Appreciate your Kudos!!
Dashboard of My Blogs !! YouTube Channel !! Connect on Linkedin

Proud to be a Super User!

Community Support
Community Support

Hi  @nataliengarces ,

 

Create a measure as below:

 

Measure = 
var _previousdate=CALCULATE(MAX('Table'[Date]),FILTER(ALL('Table'),'Table'[Vendor]=MAX('Table'[Vendor])&&'Table'[Reference No]=MAX('Table'[Reference No])&&'Table'[Invoice Amount]=MAX('Table'[Invoice Amount])&&'Table'[Date]<MAX('Table'[Date])))
var _afterdate=CALCULATE(MAX('Table'[Date]),FILTER(ALL('Table'),'Table'[Vendor]=MAX('Table'[Vendor])&&'Table'[Reference No]=MAX('Table'[Reference No])&&'Table'[Invoice Amount]=MAX('Table'[Invoice Amount])&&'Table'[Date]>MAX('Table'[Date])))
var _datediff1=DATEDIFF(_previousdate,MAX('Table'[Date]),DAY)
var _datediff2=DATEDIFF(MAX('Table'[Date]),_afterdate,DAY)
Return
IF(_previousdate=BLANK()||_afterdate=BLANK(),0,IF(_datediff1<30||_datediff2<30,1,0))

 

As the datediff between "01/23/2020" and "12/01/2019" is 53,not within 30,so my result returns as below:

Annotation 2020-08-05 102741.png

If you get the 1 returned,just go to filter pane,choose measure =1,then you will get what you request.

 

Best Regards,
Kelly
Did I answer your question? Mark my post as a solution!

View solution in original post

Super User IV
Super User IV

You can try this measure expression, in a table visual with the Vendor, Reference No, and Date columns.  It will return blank for rows that have a duplicate within 30 days (and filter them from the visual).  Note that the xyz rows in your sample data have different Reference #.  Should those have been filtered out from your example desired output?

 

Invoice Amount if No Duplicates =
VAR thisamount =
    SUM ( Invoices[Invoice Amount] )
VAR thisdate =
    MIN ( Invoices[Date] )
VAR dupecount =
    CALCULATE (
        COUNTROWS ( Invoices ),
        ALL ( Invoices[Date] ),
        Invoices[Date] >= thisdate,
        Invoices[Date] <= thisdate + 30
    )
RETURN
    IF ( dupecount = 1, thisamount )

 

If this works for you, please mark it as the solution.  Kudos are appreciated too.  Please let me know if not.

Regards,

Pat





Did I answer your question? Mark my post as a solution! Kudos are also appreciated!

To learn more about Power BI, follow me on Twitter or subscribe on YouTube.


@mahoneypa HoosierBI on YouTube


@mahoneypat  Hello! Yes, the xyz rows in mysample data have different Reference # so they should be filtered out from the example desired output.

Hi  @nataliengarces ,

 

Have you checked my reply?Is my solution what you need?If not,pls correct me.

 

Best Regards,
Kelly
Did I answer your question? Mark my post as a solution!

I thought you were trying to keep the ones that weren't duplicates.  Please try this expression instead.  I noticed in your example however that the two rows retained were >30 days apart (so wouldn't satisfy the criteria).  So I adapted this to look +/-60 days for duplicates.  If I have it backwards, you can replace with 30 and adjust the > and < to your desired logic.

 

 

Invoice Amount Duplicates =
VAR thisamount =
    SUM ( Invoices[Invoice Amount] )
VAR thisdate =
    MIN ( Invoices[Date] )
VAR dupecount =
    CALCULATE (
        COUNTROWS ( Invoices ),
        ALLEXCEPT ( Invoices, Invoices[Vendor], Invoices[Reference No] ),
        Invoices[Invoice Amount] = thisamount,
        Invoices[Date] >= thisdate - 60,
        Invoices[Date] <= thisdate + 60
    )
RETURN
    IF ( dupecount > 1, thisamount )

 

 

Note that this measure returns the Amount, so I didn't have that column in the Table visual.

 

If this works for you, please mark it as the solution.  Kudos are appreciated too.  Please let me know if not.

Regards,

Pat





Did I answer your question? Mark my post as a solution! Kudos are also appreciated!

To learn more about Power BI, follow me on Twitter or subscribe on YouTube.


@mahoneypa HoosierBI on YouTube


Hello! Yes, the xyz rows in mysample data have different Reference # so they should be filtered out from the example desired output.

Helpful resources

Announcements
secondImage

Happy New Year from Power BI

This is a must watch for a message from Power BI!

December Update

Check it Out!

Click here to read more about the December 2020 Updates!

Community Blog

Check it Out!

Click here to read the latest blog and learn more about contributing to the Power BI blog!

Get Ready for Power BI Dev Camp

Get Ready for Power BI Dev Camp

Mark your calendars and join us for our next Power BI Dev Camp!.

Top Solution Authors
Top Kudoed Authors