cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
jonathankapoor
Frequent Visitor

files missing from sharepoint folder ONLY when using PQ in dataflows

Hi all,

 

For the last 12 months I have had a dataflow that connects to a sharepoint online folder and combines the files. Has worked very well! However today when it refreshed to include last months file it is missing not only last months file but all files going back to July 2019! (one file per month).

 

The strange thing is when I copy the query from Dataflows to PQ in PBI Desktop the query returns all files and combines successfullu. I have checked a few other dataflows that use a sharepoint folder connector and they too are now under reporting on the files in the sharepoint folder...

 

The issue isn't at the combine stage, it's when PQ lists all the files in the Sharepoint root and isn't brining through every file.

 

This is bizzare and has completely broken all models that uses these dataflows. Any idea what's happening??!

 

Jon

9 REPLIES 9
jonathankapoor
Frequent Visitor

Re: files missing from sharepoint folder ONLY when using PQ in dataflows

To be clear it is Sharepoint Online

Super User IV
Super User IV

Re: files missing from sharepoint folder ONLY when using PQ in dataflows

Hi there

No idea why it should be happening.

What happens when the dataset is refreshed?




Did I answer your question? Mark my post as a solution!

Proud to be a Super User!






Power BI Blog
Highlighted
jonathankapoor
Frequent Visitor

Re: files missing from sharepoint folder ONLY when using PQ in dataflows

Appears I'm not the only one having this issue.

 

https://community.powerbi.com/t5/Issues/idb-p/Issues

 

 

Community Support
Community Support

Re: files missing from sharepoint folder ONLY when using PQ in dataflows

Hi @jonathankapoor ,

 

Does there any change applied to the  queries used in Data flow recently? Does the data flow and power bi desktop use the same credential? Could you please try to verify if this issue also occur in a new dataflow?

 


Best regards,

 

Community Support Team _ Dong Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
jonathankapoor
Frequent Visitor

Re: files missing from sharepoint folder ONLY when using PQ in dataflows

My responses are in red.

 

Does there any change applied to the  queries used in Data flow recently?

 

Nope no changes to the query.

 

Does the data flow and power bi desktop use the same credential?

 

Nope same credentials

 

Could you please try to verify if this issue also occur in a new dataflow?

 

Occurs in other existing dataflows using Sharepoint Online Folder connector. Also occurs in brand new dataflows.

 

 

jeremyking77
Frequent Visitor

Re: files missing from sharepoint folder ONLY when using PQ in dataflows

Im having the same issue at the moment which is really frustrating

 

I found a work around that seems to be working for while the other method doesnt seem to work

You can use SharePoint.Contents instead.. Then you have to drill through each folder to your folder contents

 

let
Source = SharePoint.Contents("https://xxxx.sharepoint.com/sites/xxxx/", [ApiVersion = 15]),
#"Shared Documents" = Source{[Name="Shared Documents"]}[Content],
#"Reporting & Analysis" = #"Shared Documents"{[Name="Reporting & Analysis"]}[Content]
in 
#"Reporting & Analysis"

This works if you have all the source files in one directory. You'd have to do some more work if you have subfolders as well because you'd need to navigate through

Community Support
Community Support

Re: files missing from sharepoint folder ONLY when using PQ in dataflows

Hi @jonathankapoor ,

 

Sorry for that, We cannot reproduce the issue here and also not found an effective solution. We suggest you to open a ticket here for help if you are a pro user: https://powerbi.microsoft.com/en-us/support/

 

Support Ticket .gif


Best regards,

 

Community Support Team _ Dong Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
jeremyking77
Frequent Visitor

Re: files missing from sharepoint folder ONLY when using PQ in dataflows

I've raised a support ticket. so will let you guys know the outcome once its resolved

jeremyking77
Frequent Visitor

Re: files missing from sharepoint folder ONLY when using PQ in dataflows

@jonathankapoor @GilbertQ @v-lid-msft 

 

looks like Microsoft have found the issue and its going to be fixed next week

See https://community.powerbi.com/t5/Issues/Dataflows-failing-to-find-Sharepoint-files/idc-p/941788#M538...

 

Helpful resources

Announcements
New Ranks Launched March 24th!

New Ranks Launched March 24th!

The time has come: We are finally able to share more details on the brand-new ranks coming to the Power BI Community!

‘Better Together’ Contest Finalists Announced!

‘Better Together’ Contest Finalists Announced!

Congrats to the finalists of our ‘Better Together’-themed T-shirt design contest! Click for the top entries.

Arun 'Triple A' Event Video, Q&A, and Slides

Arun 'Triple A' Event Video, Q&A, and Slides

Missed the Arun 'Triple A' event or want to revisit it? We've got you covered! Check out the video, Q&A, and slides now.

Join THE global Microsoft Power Platform event series.

Join THE global Power Platform event series.

Attend for two days of expert-led learning and innovation on topics like AI and Analytics, powered by Dynamic Communities.

Community Summit North America

Community Summit North America

Innovate, Collaborate, Grow. The top training and networking event across the globe for Microsoft Business Applications

Top Solution Authors