cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Penn Regular Visitor
Regular Visitor

Difference: Real-time streaming vs. Direct Query

Hi All,

 

Does real-time streaming belong to push mode, one of the four storage modes?

 

Import mode

DirectQuery mode

LiveConnect mode

Push mode?

 

 

I am a bit confused.

2 ACCEPTED SOLUTIONS

Accepted Solutions
Super User
Super User

Re: Difference: Real-time streaming vs. Direct Query

Hey,

 

this is a good question, there are three kind of data connectivity modes, but most of the time just two of them are considered. Each mode connects to a Power BI dataset, these modes are

  1. real-time (push)
  2. direct query / live connection
  3. import

The above modes are ordered by the duration between the origin of data and its availability for analysis in Power BI. As one might guess by the name, real-time provides the smallest latency between data origin and analytical availability. The data will be pushed into a Power BI dataset, much more about real-time datasets and some subtle but important differences between the 3 kinds of real-time datasets is described in this article: https://docs.microsoft.com/en-us/power-bi/service-real-time-streaming  So, the answer to your question, real-time streaming data is considered push mode.

Whereas data from data sources connected using the import mode, will be imported to a Power BI dataset on a given schedule. Both connectivity modes (real-time / import) have this in common: data will be stored in a Power BI dataset.

Quite often Power BI datasets connected to data sources using the direct query / live connection mode can be considered the oldest datasets as the data has to "loaded" into these data sources, e.g. a data warehouse or a SQL Server Analysis Services data model, but the above ordering helps me a lot to differentiate between these three modes.

Of course, each mode has advantages and disadvantages, import comes with the greatest flexibility and capability regarding data modeling and DAX usage, real-time mode comes with the least flexibility / capability.

 

From, my point of view, the following is the greatest advantage of a data source that is connected to Power BI dataset using the direct query / live connection mode:

  • data is not copied to a Power BI dataset, meaning there is basically no dataset size limit .

Hopefully this adds some additional insights.

 

Regards,

Tom 

Hamburg - Germany
If I answer your question, please mark my post as solution, this will also help others.
Proud to be a Datanaut!

View solution in original post

Penn Regular Visitor
Regular Visitor

Re: Difference: Real-time streaming vs. Direct Query

wow thanks very much Tom, did not expect such a comprehensive and professional answer.

 

Just want to add on one thing, not all real time streaming methods store data in the dataset. Find more at https://docs.microsoft.com/en-us/power-bi/service-real-time-streaming

View solution in original post

3 REPLIES 3
Super User
Super User

Re: Difference: Real-time streaming vs. Direct Query

Hey,

 

this is a good question, there are three kind of data connectivity modes, but most of the time just two of them are considered. Each mode connects to a Power BI dataset, these modes are

  1. real-time (push)
  2. direct query / live connection
  3. import

The above modes are ordered by the duration between the origin of data and its availability for analysis in Power BI. As one might guess by the name, real-time provides the smallest latency between data origin and analytical availability. The data will be pushed into a Power BI dataset, much more about real-time datasets and some subtle but important differences between the 3 kinds of real-time datasets is described in this article: https://docs.microsoft.com/en-us/power-bi/service-real-time-streaming  So, the answer to your question, real-time streaming data is considered push mode.

Whereas data from data sources connected using the import mode, will be imported to a Power BI dataset on a given schedule. Both connectivity modes (real-time / import) have this in common: data will be stored in a Power BI dataset.

Quite often Power BI datasets connected to data sources using the direct query / live connection mode can be considered the oldest datasets as the data has to "loaded" into these data sources, e.g. a data warehouse or a SQL Server Analysis Services data model, but the above ordering helps me a lot to differentiate between these three modes.

Of course, each mode has advantages and disadvantages, import comes with the greatest flexibility and capability regarding data modeling and DAX usage, real-time mode comes with the least flexibility / capability.

 

From, my point of view, the following is the greatest advantage of a data source that is connected to Power BI dataset using the direct query / live connection mode:

  • data is not copied to a Power BI dataset, meaning there is basically no dataset size limit .

Hopefully this adds some additional insights.

 

Regards,

Tom 

Hamburg - Germany
If I answer your question, please mark my post as solution, this will also help others.
Proud to be a Datanaut!

View solution in original post

Penn Regular Visitor
Regular Visitor

Re: Difference: Real-time streaming vs. Direct Query

wow thanks very much Tom, did not expect such a comprehensive and professional answer.

 

Just want to add on one thing, not all real time streaming methods store data in the dataset. Find more at https://docs.microsoft.com/en-us/power-bi/service-real-time-streaming

View solution in original post

Super User
Super User

Re: Difference: Real-time streaming vs. Direct Query

Hey Penn,

 

sure, you are right PubNub is not a Power BI dataset, but, as I provided the link to the official msft docs where this is explained I resigned to incorporate this into my answer.

 

Regards,

Tom

Hamburg - Germany
If I answer your question, please mark my post as solution, this will also help others.
Proud to be a Datanaut!

Helpful resources

Announcements
Can You Solve These Challenge

Challenge: Can You Solve These?

Find out how to participate in the first Power BI 'Can You Solve These?' challenge.

New Badges

Incoming: New and Improved Badges

Exciting news: We've given our badges an overhaul and added brand news ones.

Ask Amir Anything

Exclusive LIVE Community Event No. 2 – Ask Amir Anything

Next in our Triple A series: Ask Amir Netz questions about the latest updates, features and future.

Analytics in Azure virtual event

Analytics in Azure virtual event

Experience a limitless analytics service built to ingest, prep, manage, and serve data for immediate use in Power BI.

Users Online
Currently online: 452 members 4,050 guests
Please welcome our newest community members: