Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.
Hello everyone,
In my company, we have a dashboard for HR analysis that have as one of it's data sources a folder query with ~400 excel files, with ~350 rows in each one. This number grows by 2 everyday.
Recently, the data source doesn't update anymore. It get's stuck for hours trying to work it out but it fails no matter what. Are there any way for me speed up the updating proccess in this case? I'm also open for ideas on how to build this data source better.
Thank you.
Hi @gudnsouza
I agree with @parry2k about keeping it in a database server rather than in excel files.
Still if you need to have the data in excel then it requiers out of the box thinking as the ask is intersting.
In this case I would write a powershell script to append all the files form specified or different folders together into one(Considering all the excel files have similar column pattern, 400 files must have some consistency) and then use this file to as a datasource in Power BI.
Did I answer your question? Mark my post as a solution! Appreciate your Kudos!!
Regards,
Pranit
Hope it resolves your issue? Did I answer your question? Mark my post as a solution! Appreciate your Kudos, Press the thumbs up button!! Linkedin Profile |
@pranit828, not a bad idea to club these together before consuming in power bi but why to add another step in the process if there is a possibility to store the data in first place in sql server. I hate one date move from 1 place to another and then another and it becomes a nightmare to manage when things fail.
Let's do it right but your idea is not bad but I will not do it.
Subscribe to the @PowerBIHowTo YT channel for an upcoming video on List and Record functions in Power Query!!
Learn Power BI and Fabric - subscribe to our YT channel - Click here: @PowerBIHowTo
If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤
Did I answer your question? Mark my post as a solution. Proud to be a Super User! Appreciate your Kudos 🙂
Feel free to email me with any of your BI needs.
@gudnsouza not sure if it is a scalable solution, not sure what is the source of these excel files, may be easier to store the data in sql server (onprem or on azure sql server) and use that in Power BI instead of directly reading Excel files, it is not going to work if you are adding 2 files every day
I would ❤ Kudos if my solution helped. 👉 If you can spend time posting the question, you can also make efforts to give Kudos whoever helped to solve your problem. It is a token of appreciation!
⚡Visit us at https://perytus.com, your one-stop-shop for Power BI-related projects/training/consultancy.⚡
Subscribe to the @PowerBIHowTo YT channel for an upcoming video on List and Record functions in Power Query!!
Learn Power BI and Fabric - subscribe to our YT channel - Click here: @PowerBIHowTo
If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤
Did I answer your question? Mark my post as a solution. Proud to be a Super User! Appreciate your Kudos 🙂
Feel free to email me with any of your BI needs.
Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City
Check out the April 2024 Power BI update to learn about new features.
User | Count |
---|---|
114 | |
101 | |
78 | |
75 | |
49 |
User | Count |
---|---|
145 | |
108 | |
107 | |
89 | |
61 |