New columns in dataset and Automated Refresh

[irnm8dn]

Still working through some newbie questions...

I currently use the Refresh function (button) in Power BI to update my dashboards on a daily basis.  The source is simply a .csv flat file in a network folder that is replaced daily.

I have updated the dataset to include an additional column, which upon Refresh is not represented in Power BI (but it is clearly there in the .csv / flat file).  Two questions:

1.  When expanding a source dataset to include more columns, how do I get Power BI to acknowledge and accept the change and include the expanded information...or do I need to rebuild from scratch?

2.  Since I move the flat file to a network folder, in Power BI how can I ping the network folder at a scheduled interval to look for and refresh the data?

Thanks.

[zebing2]

Are you kidding me? I add columns ALL the time. I have to write some sort of code formula every time I refresh my data!!!

This is kind of a deal breaker, Microsoft. This switch from Tableau isn't being smooth sailing.

[Greg_Deckler]

I would open your original Power BI Desktop file, hit refresh there and then see if your columns show up. If they do, then you should be able to republish. As for your second question, I am not aware of any way that you can do that today. Would be a nifty thing to leverage Flow for but I do not believe Flow can kick off a refresh in Power BI just yet.

[irnm8dn]

@Greg_Deckler

This is the issue.  When I open the file, and refresh, the new column doesn't show up...

Thanks for any additional input.

[ceebu · Accepted solution]

With CSV as source, you have to edit the source query to change the number of columns. PowerBI desktop does not automatically add the additional columns.

Source = Csv.Document(File.Contents("C:\yourfolder\yourfile.csv"),[Delimiter=",", Columns=10, .....),

In the above example, you have to Change the columns to 11 for the new column to reflect.

[naiki]

This post is old but not accurate. If [Columns] is not specified, Csv.Document will read whatever number of columns it finds in the input.

https://learn.microsoft.com/en-us/powerquery-m/csv-document

[irnm8dn]

@ceebu

Thanks.  Worked perfectly.