cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Anonymous
Not applicable

Problem with refreshing the data sources

Hello Guys, 

I have a problem with refreshing the data source.

I am importing files from Sharepoint , individual file for each day , and I Combine them by powerquery.

But I made a filter before appending ( file starts with some characters ) 

But when I add another file to the same folder , and refresh power bi model , it doesn't add the new file 

It works only when i enter to the power query editor and click > refresh preview

But i want to automate it to work with the schedualed refresh on the online service

any help please ?

 

the first pic is after clicking refresh on the bi file itself and didn't refreshed all files in the folder

johnelmasry_1-1598281773336.png

the second pic is after clicking refresh preview in the power query editor

johnelmasry_2-1598281793174.png

 

 

3 ACCEPTED SOLUTIONS
BA_Pete
Super User
Super User

Hi @Anonymous ,

 

This is how Power Query is supposed to work.

When you refresh data, even though the preview in Power Query doesn't update, the new data will actually be loaded into your model for use. I guess this is to speed up the data refresh process so the system doesn't waste time refreshing the query previews at the same time.

If you go into Options & settings, you can adjust whether Power Query performs background preview refreshes while you're working. This may help alleviate your concerns as then your previews will update as you're working on other queries.

 

Pete

View solution in original post

v-shex-msft
Community Support
Community Support

HI @Anonymous,

According to your description, I think it should more related to 'lazy Evaluation' that appears on refresh/processing with m query formulas. You can take a look at the below blog to know more about this:

Lazy Evaluation & Query Folding in Power BI / Power Query 

In addition, you can also refer to BA_Pete 's suggestion to check the option to allows 'data previews to download in the backend' if they fixed the issue.

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin
If this post helps, please consider accept as solution to help other members find it more quickly.

View solution in original post

Anonymous
Not applicable

Thank You guys for helping me out, But unfortunately all the sources you mentioned didn't help

 

However, I found a solution after a long search.

 

instead of getting the data using SharePoint Folder , you should use a blank query and type 

 

= SharePoint.Contents(" # Sharepoint Folder ")

 

this should work and refresh automatically after any change in the SharePoint folder without the need of manual click Refresh

View solution in original post

4 REPLIES 4
Anonymous
Not applicable

Thank You guys for helping me out, But unfortunately all the sources you mentioned didn't help

 

However, I found a solution after a long search.

 

instead of getting the data using SharePoint Folder , you should use a blank query and type 

 

= SharePoint.Contents(" # Sharepoint Folder ")

 

this should work and refresh automatically after any change in the SharePoint folder without the need of manual click Refresh

v-shex-msft
Community Support
Community Support

HI @Anonymous,

According to your description, I think it should more related to 'lazy Evaluation' that appears on refresh/processing with m query formulas. You can take a look at the below blog to know more about this:

Lazy Evaluation & Query Folding in Power BI / Power Query 

In addition, you can also refer to BA_Pete 's suggestion to check the option to allows 'data previews to download in the backend' if they fixed the issue.

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin
If this post helps, please consider accept as solution to help other members find it more quickly.
BA_Pete
Super User
Super User

Hi @Anonymous ,

 

This is how Power Query is supposed to work.

When you refresh data, even though the preview in Power Query doesn't update, the new data will actually be loaded into your model for use. I guess this is to speed up the data refresh process so the system doesn't waste time refreshing the query previews at the same time.

If you go into Options & settings, you can adjust whether Power Query performs background preview refreshes while you're working. This may help alleviate your concerns as then your previews will update as you're working on other queries.

 

Pete

Helpful resources

Announcements
May 23 2022 epsiode 5 without aka link.jpg

The Power BI Community Show

Welcome to the Power BI Community Show! Jeroen ter Heerdt talks about the importance of Data Modeling.

charticulator_carousel_with_text (1).png

Charticulator Design Challenge

Put your data visualization and design skills to the test! This exciting challenge is happening now through June10th!

Power BI Dev Camp Session 22 without aka link and time 768x460.jpg

Check it Out!

Watch Session 22 Ted's Dev Camp along with past sessions!

Power BI Release May 2022 768x460.png

Check it out!

Click here to read more about the May 2022 updates!

Top Kudoed Authors