cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
dudeeee
Regular Visitor

updated parquet file changes does not reflect in power bi

I am using local file path as a data source for the power bi dashboard. A parquet file is created by spark in overwrite mode and I am renaming the .parquet file being generated to a same name just so every time I do not have to change the data source path.
But there is no change in the table or dashboard after updating the parquet file.
I have also tried  deleting the folder and then overwriting the parquet file but still no changes.
Is there any way I can reflect the changes in dashboard from recently updated parquet file without changing the path in data source settings every time?

6 REPLIES 6
lbendlin
Super User
Super User

Ater you replace the Parquet file do you refresh your Power BI Desktop report?

@lbendlin Yes, I refresh the report. I have also set up a scheduled refresh (every one hour)

That means you have installed the personal gateway app?

@lbendlin I have installed personal gateway app and set up data source credentials. The scheduled refresh runs well. But the problem is that although the file has been updated in the local filesystem, it does not show any changes in the dataset and dashboard even after refreshing.

Would you be able to provide sample Parquet files before and after the column was added?

I tested on my side and saw an interesting issue when trying to swap the parqet file out (by renaming the file I had loaded).

 

lbendlin_0-1663898830791.png

Do you see the same issue?

Helpful resources

Announcements
September Update

Check it Out!

Click here to learn more about the September 2022 updates!

Power BI Dev Camp Session 26

Check it Out!

Mark your calendars and join us on Thursday, September 29 at 11a PDT for a great session with Ted Pattison!

Top Solution Authors
Top Kudoed Authors