cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
alexbjorlig
Helper III
Helper III

How to make List.Generate work with cursor based pagination

I'm developing a custom power bi connector consuming a GraphQl API, and my objective is to use the List.Generate to support cursor based pagination. My code is inspired by this Github comment. The code looks like this:

 

 

GeneratedList =
            List.Generate(
                () => [res = getPage(queryName, query, operationName, [pagination = [first = 100]])],
                each Comparer.Equals(Comparer.FromCulture("en-us"), [res][hasNextPage], true ),
                each [ res = getPage(queryName, query, operationName, [pagination = [first = 100, after = [res][endCursor]]] ) ],
                each [res][edges]
            )

 

 

The above works if the initial page has more than 100 items. But if all items can be returned in the initial call, then it does not work, an empty list is returned. Why is this the case? I checked the queries that are returned from the API and they seem to work perfect with hasNextPage property.

 

Update - and solution

According to this comment from Ben Gribaud, test function is also used for the initial result. With that in mind the working code looks like this:

 

 

        GeneratedList =
            List.Generate(
                () => [res = getPage(queryName, query, operationName, [pagination = [first = 11]])],
                each [res]<>null and [res][edges]<>null and List.Count([res][edges]) > 0,
                each [ res = if Comparer.Equals(Comparer.FromCulture("en-us"), [res][hasNextPage], false ) then null else getPage(queryName, query, operationName, [pagination = [first = 23, after = [res][endCursor]]] ) ],
                each [res][edges]
            )

 

 

 

1 REPLY 1
yingyinr
Community Support
Community Support

Hi @alexbjorlig ,

Thanks for sharing your solution here, it will help the others in the community find the solution easily if they face the same problem with yours. Much appreciated!

Best Regards

Community Support Team _ Rena
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
PBI User Groups

Welcome to the User Group Public Preview

Check out new user group experience and if you are a leader please create your group!

MBAS on Demand

Microsoft Business Applications Summit sessions

On-demand access to all the great content presented by the product teams and community members! #MSBizAppsSummit #CommunityRocks

MBAS Attendee Badge

Claim Your Badge & Digital Swag!

Check out how to claim yours today!

Top Kudoed Authors