How to Import data for latest date or Apply dynamic filters during data refresh

[Anonymous]

Hi 

I have a data set that contains 6 months of data in table storage. Data is added on the table on a daily basis.  I want to add a dynamic filter during import which will pick data from the last 24 hours or using the latest date only from the table storage. As the data set is huge the refresh is failing so I want to apply this filter so that only the latest data is imported. Scheduled refresh is already applied on a daily time. Please assist . 

Connector Used: Azure Table Storage

Number of table: 19 

Sample Dataset .  Additional column that I have

[watkinnc · Accepted solution]

As long as you add this formula before expanding your table, it will work. 

[Anonymous · Accepted solution]

Hi,

      You can try incremental refresh

Configure incremental refresh for Power BI datasets - Power BI | Microsoft Docs

Thanks,

Shanthakumar.

[watkinnc · Accepted solution]

As long as you add this formula before expanding your table, it will work. 

[luzwales]

=Table.SelectRows(Table,each DateTime.Date([TimeStamping])=DateTime.Date(DateTime.LocalNow())

[watkinnc]

Type this into the formula bar:

= Table.Max(NameOfPriorStep, {"TimeStamp"})

--Nate

[Anonymous]

I want to do this during the data import. Eg . when the refresh happens on daily basis import should only pick the latest date data .