cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
mjholland
Helper II
Helper II

Import Multiple SharePoint Lists as One Dataset share

Hi,

 

I've just watch Greg Low's webinar where he imported multiple CSV files from a folder in to one dataset by changing the filepath to look at the folder containing all these files.

 

Is it possible to do the same with SharePoint Lists? I have 3 lists in SharePoint all with the same structure. I've previously had to import all 3 to Power BI Desktop then append them all together to create one dataset. But there's so much data that it's slow to do a refresh is it's now refreshing 4 datasets. I want to be able to combined them all in to one dataset without the need to append.

 

When I try to link to a SharePoint Folder my lists don't appear. But when I just link to a SharePoint list, the 3 files appear and upload separately.

 

Is this possible?

 

Thanks,

mjholland

1 ACCEPTED SOLUTION
Greg_Deckler
Super User IV
Super User IV

So, are they lists or are you talking about something like CSV files in a document library?

 

If they are SharePoint lists, you can use a modified version of my "Power Query: Merge Queries with M" article.

http://social.technet.microsoft.com/wiki/contents/articles/32915.power-bi-merge-query-with-m.aspx

 

Essentially, within one query, you define the three sources and append them together. Similar to what you probably have today but it is all in one query.


---------------------------------------

@ me in replies or I'll lose your thread!!!

I have a NEW book! 
DAX Cookbook from Packt
Over 120 DAX Recipes!




Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




View solution in original post

3 REPLIES 3
Greg_Deckler
Super User IV
Super User IV

So, are they lists or are you talking about something like CSV files in a document library?

 

If they are SharePoint lists, you can use a modified version of my "Power Query: Merge Queries with M" article.

http://social.technet.microsoft.com/wiki/contents/articles/32915.power-bi-merge-query-with-m.aspx

 

Essentially, within one query, you define the three sources and append them together. Similar to what you probably have today but it is all in one query.


---------------------------------------

@ me in replies or I'll lose your thread!!!

I have a NEW book! 
DAX Cookbook from Packt
Over 120 DAX Recipes!




Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




View solution in original post

This looks about right. I'll give it a go next week and let you know how I get on.


Thanks,

mjholland

I've found a way to do this without having to go in to any M language ...

 

  • I linked to one of my lists in SharePoint and imported it in PowerQuery
  • Then I selected the cog next to 'source' on the Query Settings panel. This shows up all the lists that appear in my SharePoint site
  • From there I removed rows of lists I didn't need
  • Then I expended the table column to reveal the fields in each SharePoint list
  • When I did this it merged my lists together

 

It works a treat.

 

Helpful resources

Announcements
PBI_User Group Leader_768x460.jpg

Manage your user group events

Check out the News & Announcements to learn more.

MBAS on Demand

2021 Release Wave 2 Plan

Power Platform release plan for the 2021 release wave 2 describes all new features releasing from October 2021 through March 2022.

Get Ready for Power BI Dev Camp

Microsoft named a Leader in The Forrester Wave

Microsoft received the highest score of any vendor in both the strategy and current offering categories.

R2 (Green) 768 x 460px.png

Microsoft Dynamics 365 & Power Platform User Professionals

DynamicsCon is a FREE, 4 half-day virtual learning experience for 11,000+ Microsoft Business Application users and professionals.

Top Kudoed Authors