cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
supton Regular Visitor
Regular Visitor

Direct Query Large Data Volumes

Hello everyone! I think I am struggling to understand even some basic concepts of Power BI. I seem to be unable to report on large sets of data, even using direct query. I am connected to an azure sql database, and some of the tables I am reporting on seem to run just fine. But there is one in particular that has around 1.5 million records, and I cant seem to figure out a way to report on this data properly. I understand that there is a 1 million row limit to power BI ( from here https://powerbi.microsoft.com/en-us/documentation/powerbi-desktop-use-directquery/), but it states that "For example, you can aggregate 10 million rows with your query that runs on the data source, and accurately return the results of that aggregation to Power BI using DirectQuery as long as the data returned to Power BI is less than 1 million rows.", so I attempted to modify the query itself and used a group by clause on a particular column, which should ultimately bring down the record count of that 1.5 million record table to around 100. However, this does not seem to work either, as the query times out (because it takes too long) and continues to create locking conflicts on my visualizations. How then, is it even possible to report on large sets of data in azure? Thank you in advanced for your responses, I really appreciate the time!

1 ACCEPTED SOLUTION

Accepted Solutions
supton Regular Visitor
Regular Visitor

Re: Direct Query Large Data Volumes

Thanks for the response! I actually wasnt writing the SQL queries directly, but when I switched to a "Native Database Query", it seemed to work properly (even if it still takes quite a while to load). Thank you!

View solution in original post

3 REPLIES 3
Moderator v-yuezhe-msft
Moderator

Re: Direct Query Large Data Volumes

Hi @supton,

You write specific SQL query in “SQL statement” to limit rows when connecting to Azure SQL database in Power BI Desktop, right? If so, have you set a high value in "Command timeout in minutes" ?

1.PNG


Regards,
Lydia Zhang

Community Support Team _ Lydia Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
supton Regular Visitor
Regular Visitor

Re: Direct Query Large Data Volumes

Thanks for the response! I actually wasnt writing the SQL queries directly, but when I switched to a "Native Database Query", it seemed to work properly (even if it still takes quite a while to load). Thank you!

View solution in original post

Moderator v-yuezhe-msft
Moderator

Re: Direct Query Large Data Volumes

@supton,

Glad to hear the issue is solved. Please accept appropriate replies as solution, that way, other community members would easily find the answer when they get same issues.

Regards,
Lydia Zhang

Community Support Team _ Lydia Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
Ask Amir Anything

Exclusive LIVE Community Event No. 2 – Ask Amir Anything

Next in our Triple A series: Ask Amir Netz questions about the latest updates, features and future.

Ask Amanda Anything Q&A

Ask Amanda Anything Q&A

Learn the answers to some of the questions asked during the Amanda Triple A event.

October 2019 Community Highlights

October 2019 Community Highlights

October was a busy month in the community. Read the recap article to learn about some of the events and content.

New Solution Badges

New Solution Badges

Two waves of brand new solution badges are coming! Read the article for more information on our new community badges.

Users Online
Currently online: 371 members 3,641 guests
Please welcome our newest community members: