Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
Anonymous
Not applicable

Reduce the Number of Records Pouring In

Hi:

Through an ODBC connection, we chose one view in our database from which to pull records into Power BI.  But, it's a lot.  We're talking millions upon millions.

We tried clicking the "Transform Data" button., as a possible solution.  But, upon trying to fliter the data based upon say "date", we could no longer find any records associated with the general ledger account number we want to report on.

Why would Transform Data not provide all data?

Regardless, what is the best way to filter on data so that the end user is not sitting in front of her monitor waiting for all of the records from the view or table or whatever to finish pouring into Power BI as she is having to do right now?

Thanks!

John

3 REPLIES 3
HotChilli
Super User
Super User

What is the data source?

How did you implement the filter- writing a sql statement or using the dropdown from a column heading?

 

"We tried clicking the "Transform Data" button., as a possible solution.  But, upon trying to fliter the data based upon say "date", we could no longer find any records associated with the general ledger account number we want to report on."  

- you'll have to read up on Query Folding.  ODBC data connections don't always fold (sending the query back to the data source).  They sometimes download all data requested from the source and then apply any filter.

Other things to take into account: Power Query defaults to showing 1000 rows in a preview, so that might be why you don't see the data you expect.  Or the SQL might be incorrect.

Anonymous
Not applicable

SQL ODBC data source.

Filter = dropdown from column heading.

I have never herd of Query Folding.  What is it?

Icey
Community Support
Community Support

Hi @Anonymous ,

 

For "Query Folding", please refer to these documents:

Query folding guidance in Power BI Desktop;
Power Query query folding.

 

In addition, how about using parameter to filter your data before loading the data into Power Query?

Reference:

Using parameters;

Deep Dive into Query Parameters and Power BI Templates;

Dynamic Power BI reports using Parameters.

 

 

Best Regards,

Icey

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.