Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Grow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.

Reply
iBusinessBI
Kudo Collector
Kudo Collector

Dataflow Gen 2 enable staging for API calls

I have several queries in a Dataflow that use API calls:

1. The first query "Customers" - gets a list of customer ids from API call (https://api.somecrm.com/v1/customers)
2. Query "Purchase History" - References Query 1 and adds an "Invoke Custom Function" column.
The function gets purchase history for each customerid (from the first query) using another API call (https://api.somecrm.com/v1/purchasehist/{customerid})
I have more queries like the second that reference the first and use other API cals per customer.
Yesterday when I started to get this error: "429 Too Many Requests" . The CRM has Rate limit of 100 calls only for the first API call.
I think that because of References - the first call is triggered many times instead of only ONCE.
Can Dataflow Gen 2 enable staging help? So the first Query is run, the result are kept somewhere, and then the other queries only reference this physical table with results, without running the first Query again and again.
Please help
0 REPLIES 0

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

MayPowerBICarousel1

Power BI Monthly Update - May 2024

Check out the May 2024 Power BI update to learn about new features.

Top Solution Authors