It seem like for a single Web Data Source query Power BI Desktop is issuing a number of requests for the URL and the number of requests for the URL for a single query increases as the records to be returned increases.
We have an inhouse REST API server that return a pipe seperated value dataset upon receiving a URL request.
For testing purposes we turned on logging in the REST API application so that it will capture the get requests being received.
Following are results of the test scenerios with different records size and setting timeout to 30 mins:
- Web request that return 9 records.
a. From invoking the Get Data till showing the Load dialog, 3 requests are received by the REST API server.
b. Upon clicking on the LOAD in the dialog 2 additional requests are received by the REST API server.
c. With each click of the Refresh 2 additional requests are received by the REST API server.
- Web request that return 500K records
a. From invoking the Get Data till showing the Load dialog, 11 requests are received by the REST API server.
b. Upon clicking on the LOAD in the dialog 4 additional requests are received by the REST API server.
c. With each click of the Refresh 4 additional equests are received by the REST API server.
- Web request that return 1M records.
a. The Get Data resulted in what seem like never ending loop of get requests to the URL until timeout of 30 mins.
If the above observation is correct then for 500K records which take about a mins for the server to response resulted in 20 mins for it to be loaded into Power BI Desktop. It will be quite impossible to load even larger recordset.
Have any one experience something similar?
Thanks in advance
Kin Kheong
