Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
samgreene1
Resolver I
Resolver I

Covid Github data not refreshing with new columns

Hi,

 

I am pulling data from Github regarding Covid.  When I refresh the data, it doesn't seem to update in Powerbi.  There should be new columns for recent dates added to the end of lines.   If I edit my query and go back to the source step, I still don't see these new dates.  Opening the url in a browser shows the new dates.  Any ideas what I'm doing wrong?  Will power bi not check for new columns when refreshing data? 

 

Thanks,

Sam

 

Here's an example: 

 

let
Source = Csv.Document(Web.Contents("https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_ti...",", Columns=63, Encoding=65001, QuoteStyle=QuoteStyle.None]),
#"Promoted Headers" = Table.PromoteHeaders(Source, [PromoteAllScalars=true]),
#"Unpivoted Other Columns" = Table.UnpivotOtherColumns(#"Promoted Headers", {"Province/State", "Country/Region", "Lat", "Long"}, "Attribute", "Value"),
#"Renamed Columns" = Table.RenameColumns(#"Unpivoted Other Columns",{{"Attribute", "Date"}}),
#"Changed Type2" = Table.TransformColumnTypes(#"Renamed Columns",{{"Date", type date}}),
#"Renamed Columns1" = Table.RenameColumns(#"Changed Type2",{{"Value", "Confirmed Cases"}})
in
#"Renamed Columns1"

1 ACCEPTED SOLUTION
Greg_Deckler
Super User
Super User

You need to edit this line:

 

Source = Csv.Document(Web.Contents("https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_ti...",", Columns=63, Encoding=65001, QuoteStyle=QuoteStyle.None]),

 

You can get rid of that entirely I believe to make it recognize new columns


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

View solution in original post

4 REPLIES 4
Anonymous
Not applicable

@samgreene1 

 

Thank you for asking this! I was having the same issue in my own Power BI report that I am creating.

 

Thanks for the insightful answer, @Greg_Deckler !

Greg_Deckler
Super User
Super User

You need to edit this line:

 

Source = Csv.Document(Web.Contents("https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_ti...",", Columns=63, Encoding=65001, QuoteStyle=QuoteStyle.None]),

 

You can get rid of that entirely I believe to make it recognize new columns


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

Many thanks!  That worked!

Yeah, not sure why not excluding the number of columns is not the default. Comes up a fair amount.


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.