cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
garykglenn Frequent Visitor
Frequent Visitor

How do I purge old data?

I have a table that was imported as a Web CSV.  The format of the table has changed and new columns have been added.  I tried deleting the old table and importing again.  But the new table comes up with the old data and column format.  Obviously it has that table cached.  How do I get rid of the cached instance so I can re-import the table with the new data format?  I have gone through the delete/re-import process numerous times.  I have tried changing the names of columns it has in the cache to see if that would invoke an error and clean thing out.  But it always comes back with the same data.

4 REPLIES 4
Super User
Super User

Re: How do I purge old data?

Is it a public URL that you can share? Also, can you share the Source line from your query so that we can see what M function you are using? Go into Query Editor and then click on Advanced Editor.

 

For example, there are specific options when retrieving content using Web.Contents for ignoring the cache.

 

https://msdn.microsoft.com/en-us/library/mt260892.aspx

 

 


Did I answer your question? Mark my post as a solution!

Proud to be a Datanaut!


garykglenn Frequent Visitor
Frequent Visitor

Re: How do I purge old data?

This is an internal URL.  I have remove the Columns=5 clause from the Source line already, as I was advised that might help things.  Currently, import is failing because the cumulativeVolumes column is no longer present in the stream.  What I need it to do is regenerate the headers from the CSV source.

 

    Source = Csv.Document(Web.Contents("https://cosmos15.osdinfra.net/cosmos/Asimov.Partner.osg/shares/asimov.prod.data/PublicPartner/Proces...", Encoding=1252, QuoteStyle=QuoteStyle.None]),

 

Thanks.

Super User
Super User

Re: How do I purge old data?

Perhaps try this:

 

Source = Csv.Document(Web.Contents("https://cosmos15.osdinfra.net/cosmos/Asimov.Partner.osg/shares/asimov.prod.data/PublicPartner/Proces...", Encoding=1252, QuoteStyle=QuoteStyle.None],IsRetry),

 

This should force it not to retrieve from cache.


Did I answer your question? Mark my post as a solution!

Proud to be a Datanaut!


v-ljerr-msft Super Contributor
Super Contributor

Re: How do I purge old data?

Hi @garykglenn,

 

Have you tried the solution provided by @Greg_Deckler above? Does it work in your scenario? If it works, could you accept it as solution to close this thread?

 

If you still have any question on this issue, feel free to post here. Smiley Happy

 

Regards