Need Help - What happens when number of rows to be refreshed exceeds 10 million rows

[Anonymous]

Hi,

We are using Impala for data source and working on import mode.

I would like to know the behavior of gateway when dataset has more than 10 million rows that needs to be imported.

1. Will it import only first 10 million rows?

2. If the data set has 12 million rows.... Will it import remaining 2 million rows in the next hr ?

3. Will the refresh fail altogether (no rows will be updated)?

Thanks,

Mannu

[Greg_Deckler]

Is there a stated limitation for that connector? I didn't see one when research real quick.

[Anonymous]

Hi smourpe

I thought that this limitation was applicable to all data sources (for a Pro License).
Data refresh of 10 million rows/ hour as against 1 million rows/ hr for a Free user?

I m unable to find the pricing page which made this comparison between Free and Pro license.
May be I m wrong !

[v-huizhn-msft]

Hi @Anonymous,

If you've got Pro account it takes an hour to load 1M rows in power bi service. For free account total size of all datasets can be maximum 1GB. For Pro it is 10GB. Each dataset cannot be more than 1GB for both free and Pro account.

Best Regards,
Angelia

[Anonymous]

@v-huizhn-msft

Thank you Angelia for the response.

I have a Pro License.

Let me re-phrase my question.

1. If I configure a daily refresh and have 2 million rows of data, will it continue beyond an hour and take take 2 hrs to complete the refresh or will it simply fail?  We can assume that size of data set < 1 GB and total number of columns is also well within the max-limit.

2. When the limit per dataset is specified as 1 GB, we are referring to the size after compression (the size of data as we see on the portal). Is my understanding correct?

Data Size as seen on app.powerbi.com

Thanks,

Mannu

[v-huizhn-msft · Accepted solution]

Hi @Anonymous,

1. Yes, it will take two hours if there is no error shown.

2. Your understanding is right.

Best Regards,
Angelia