Need your JOIN/MERGE brainpower/skills please

[xerxel]

Hello All,

Situation: I have data in a table in SFDC with 250,000 rows and many columns. I only care about 200 of the rows. There is no way to filter the table from SFDC to select the 200 rows. I have a table in Sharepoint which contains the 200 unique IDs of the rows from SFDC that I care about. These change daily.

If I use PowerBI merge functionality, PowerBI tries to download a quarter of a million rows then does the join which takes along time: 10+ mins. I tried writing a dynamic select statement but when the select statement gets too long, the web api request to SFDC fails.

Does anyone know how I can get PowerBI to select the IDs from one table1 and use them as a filter on  table2 BEFORE it downloads the entire data set from table2?

Thanks in advance!

Xerxel

[BhaveshPatel]

Hi @xerxel

Other than the Merge Step, I don't see any other functionality would fit in your scenario as you have mentioned that using SELECT will not work in your case. 

[ImkeF]

So you are merging on JoinKind.Inner and it doesn't fold to the source?

Then you could chunk up your SELECT-statement into multiple queries and append the results. Just create a table which holds the chunks for each query in one row and pass them as parameters into your SELECT-statement. Expanding the resulting column should then present your consolidated results.

[xerxel]

Good idea! Haven't tried using parameters anywhere yet. Will give it a try!