cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
CLCastroEn
Helper IV
Helper IV

How to update report data automatically

Hello everyone:

I have a report already ready and published in power bi so that my whole team can see the charts. The data I use is an EXCEL with many rows, more than 800,000 rows. what I have to do is weekly, save the data in the bottom rows of that EXCEL data, but excel does not support so many rows, so my idea is to add a new file in each update, that is; this week add a new excel to my sharepoint and have my report save it automatically. Then, for the next week just upload another excel file and it will also be saved to the consolidated report with all the data from all excel files that I have.

I would appreciate it if I showed the types of actions that can be done in power BI, and if you need power bi pro, no problem because I can get it. Thank you very much!

1 ACCEPTED SOLUTION

Hi @CLCastroEn ,

 

It can be done in PBI Desktop, but it can also be done in DataFlows online in the PBI Service. The example picture I attached earlier is actually from an online DataFlow implementation where I use this technique to combine millions of rows of GPS data.

 

Pete

View solution in original post

7 REPLIES 7
FrankAT
Community Champion
Community Champion

BA_Pete
Super User
Super User

Hi @CLCastroEn ,

 

1) Go to New Source then select Sharepoint Folder.

2) Navigate to the folder where all your Excel files are kept and select Combine & Load. Make sure that the only files in this folder are the ones you want to combine.

3) You will see that Power Query has set up some steps for you like this:

castro1.PNG

 

4) Select Transform Sample File query and you should see one of your Excel files in there. Perform all the transformations in this query that you want done to ALL of the files in the folder BEFORE they are combined e.g. Use first row as headers, Change Types etc.

5) You should see one of the queries has not been blocked from loading to the model (name is not in italic script). This is the combined result of all of your Sharepoint files. You can then perform further transformation in this query on the combined dataset.

 

Pete

Karlos
Solution Sage
Solution Sage

This is fine, providing your column headers are all named the same, and the format is the same, 

 

just go to:
* Get Data
* either "Folder" or "SharePoint Folder"

* Select the desired folder

* Click "Combine & Transform Data" 

 

This will bring the files into one. 

Karlos_0-1597418269127.png

 

and can I do this without entering the power bi desktop? in order to leave these processes automated. In order to only update the sharepoint data

Hi @CLCastroEn ,

 

It can be done in PBI Desktop, but it can also be done in DataFlows online in the PBI Service. The example picture I attached earlier is actually from an online DataFlow implementation where I use this technique to combine millions of rows of GPS data.

 

Pete

mhossain
Super User
Super User

@CLCastroEn 

 

It's doable, there are multiple ways to do that. Please check below link if this helps:

https://thinkaboutit.be/2020/02/how-do-i-implement-an-incremental-refresh-in-power-bi-free-or-pro/

Helpful resources

Announcements
Microsoft Build 768x460.png

Microsoft Build is May 24-26. Have you registered yet?

Come together to explore latest innovations in code and application development—and gain insights from experts from around the world.

charticulator_carousel_with_text (1).png

Charticulator Design Challenge

Put your data visualization and design skills to the test! This exciting challenge is happening now through May 31st!

May UG Leader Call Carousel 768x460.png

What difference can a User Group make for you?

At the monthly call, connect with other leaders and find out how community makes your experience even better.

Power BI Dev Camp Session 22 768x460.jpg

Check it out!

Mark your calendars and join us on Thursday, May 26 at 11a PDT for a great session with Ted Pattison!