cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
rossgh
Microsoft
Microsoft

Twitter streaming analytics - step-by-step

Hi guys,

 

I wanted to setup a simple stream analytics stream that I can capture (OutPut) in PowerBI.

There are instructions on how to set parts of it up, but not a complete end-to-end tutorial.

Does this require any type of coding in VS?

 

Thanks for your time and advice :).

1 ACCEPTED SOLUTION
konstantinos
Memorable Member
Memorable Member

Unfortunately I haven't found a steb by step for no coders ( I don't know Json or even use VS except SSDT )..

 

I had played around and searching for a couple of days to make work. I am sure this is not the best solution or even correct ( at least it works ) as also using the best avaliable azure resources  for the data workflow.

 

But at least for a no coder like me it was the only option I manage to make it work and seemed easier to follow.

I am planning to write an analytical blog post but until I found some time and optimize the set up, this is a summary of what I did.

 

I used Azure Logic apps to send tweets to an event hub and then used an Stream Analytics job to read from event hub and send them to PowerBI.

 

 

Create a Logic app and use the default twitter connector as trigger  ( plus the neccessary resource group, app plan etc. )  

 

https://azure.microsoft.com/en-us/documentation/articles/app-service-logic-create-a-logic-app/

This link also has other link on how to create the twitter app in Twitter Dev

 

Create an event hub

https://azure.microsoft.com/en-us/documentation/articles/event-hubs-csharp-ephcs-getstarted/

I didn't use VS since I only add endpoints

 

Deploy the event hub connector from Github

https://github.com/logicappsio/EventHubAPI

 

Add Twitter & EventHubAPI to Logic app workflow

 

 

Set up Stream Analytics Job

https://azure.microsoft.com/en-us/documentation/articles/stream-analytics-get-started/

 

 

A quick post that has all combined and unfortunately I found it after tried many other things

http://blogs.msdn.com/b/logicapps/archive/2015/09/23/adding-insights-and-telemetry-to-logic-apps-thr...

 

Hope it can help you start from somewhere.

I am also hoping many have designed it better and easier..Looking forward to their opinion

 

Konstantinos Ioannou

View solution in original post

1 REPLY 1
konstantinos
Memorable Member
Memorable Member

Unfortunately I haven't found a steb by step for no coders ( I don't know Json or even use VS except SSDT )..

 

I had played around and searching for a couple of days to make work. I am sure this is not the best solution or even correct ( at least it works ) as also using the best avaliable azure resources  for the data workflow.

 

But at least for a no coder like me it was the only option I manage to make it work and seemed easier to follow.

I am planning to write an analytical blog post but until I found some time and optimize the set up, this is a summary of what I did.

 

I used Azure Logic apps to send tweets to an event hub and then used an Stream Analytics job to read from event hub and send them to PowerBI.

 

 

Create a Logic app and use the default twitter connector as trigger  ( plus the neccessary resource group, app plan etc. )  

 

https://azure.microsoft.com/en-us/documentation/articles/app-service-logic-create-a-logic-app/

This link also has other link on how to create the twitter app in Twitter Dev

 

Create an event hub

https://azure.microsoft.com/en-us/documentation/articles/event-hubs-csharp-ephcs-getstarted/

I didn't use VS since I only add endpoints

 

Deploy the event hub connector from Github

https://github.com/logicappsio/EventHubAPI

 

Add Twitter & EventHubAPI to Logic app workflow

 

 

Set up Stream Analytics Job

https://azure.microsoft.com/en-us/documentation/articles/stream-analytics-get-started/

 

 

A quick post that has all combined and unfortunately I found it after tried many other things

http://blogs.msdn.com/b/logicapps/archive/2015/09/23/adding-insights-and-telemetry-to-logic-apps-thr...

 

Hope it can help you start from somewhere.

I am also hoping many have designed it better and easier..Looking forward to their opinion

 

Konstantinos Ioannou

Helpful resources

Announcements
September Update

Check it Out!

Click here to learn more about the September 2022 updates!

Power BI Show episode 9

The Power BI Community Show

Watch the playback when Priya Sathy and Charles Webb discuss Datamarts! Kelly also shares Power BI Community updates.

Power BI Dev Camp Session 25

Ted's Dev Camp - August 25, 2022

Watch Session 25 of Ted's Dev Camp.

Top Kudoed Authors