Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and a 50 percent discount on exams.
Get startedEarn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.
Hi,
I need to be able to parse a SharePoint document library and return the file names only and their path. The fields from the list that I need to return are the Title and FieldValuesAsText.FileRef. I only need to see files in this list.
I am using the Sharepoint Online List connector.
When I tested it on a smaller list (10K items), It worked fine (by filtering on the field FileSystemOjbectType =0).
The problem I have now is that I need to parse a list that has around 500,000 items. I ran it (on desktop) for over an hour and it never completed.
Does anyone have any clues on a quick and generally less stressful way of doing this? I am open to using other tools, such as Power Automate to create this dataset and store it elsewhere.
Thanks
Solved! Go to Solution.
"I am using the Sharepoint Online List connector."
That's not the right connector for accessing a Sharepoint document library. Can you check again? Maybe post some sanitized Power Query code.
"I am using the Sharepoint Online List connector."
That's not the right connector for accessing a Sharepoint document library. Can you check again? Maybe post some sanitized Power Query code.
And that is the secret Sauce.
And changed over to use the SharePoint Folder connector and removed the unneeded fields (I.E., I don't need the binary content and I don't need the file attributes).
Once fixed, the process ran (relatively) quickly.
Thanks