cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
rossgh Frequent Visitor
Frequent Visitor

Twitter streaming analytics - step-by-step

Hi guys,

 

I wanted to setup a simple stream analytics stream that I can capture (OutPut) in PowerBI.

There are instructions on how to set parts of it up, but not a complete end-to-end tutorial.

Does this require any type of coding in VS?

 

Thanks for your time and advice Smiley Happy.

1 ACCEPTED SOLUTION

Accepted Solutions
konstantinos Senior Member
Senior Member

Re: Twitter streaming analytics - step-by-step

Unfortunately I haven't found a steb by step for no coders ( I don't know Json or even use VS except SSDT )..

 

I had played around and searching for a couple of days to make work. I am sure this is not the best solution or even correct ( at least it works ) as also using the best avaliable azure resources  for the data workflow.

 

But at least for a no coder like me it was the only option I manage to make it work and seemed easier to follow.

I am planning to write an analytical blog post but until I found some time and optimize the set up, this is a summary of what I did.

 

I used Azure Logic apps to send tweets to an event hub and then used an Stream Analytics job to read from event hub and send them to PowerBI.

 

 

Create a Logic app and use the default twitter connector as trigger  ( plus the neccessary resource group, app plan etc. )  

 

https://azure.microsoft.com/en-us/documentation/articles/app-service-logic-create-a-logic-app/

This link also has other link on how to create the twitter app in Twitter Dev

 

Create an event hub

https://azure.microsoft.com/en-us/documentation/articles/event-hubs-csharp-ephcs-getstarted/

I didn't use VS since I only add endpoints

 

Deploy the event hub connector from Github

https://github.com/logicappsio/EventHubAPI

 

Add Twitter & EventHubAPI to Logic app workflow

 

 

Set up Stream Analytics Job

https://azure.microsoft.com/en-us/documentation/articles/stream-analytics-get-started/

 

 

A quick post that has all combined and unfortunately I found it after tried many other things

http://blogs.msdn.com/b/logicapps/archive/2015/09/23/adding-insights-and-telemetry-to-logic-apps-thr...

 

Hope it can help you start from somewhere.

I am also hoping many have designed it better and easier..Looking forward to their opinion

 

Konstantinos Ioannou
1 REPLY 1
konstantinos Senior Member
Senior Member

Re: Twitter streaming analytics - step-by-step

Unfortunately I haven't found a steb by step for no coders ( I don't know Json or even use VS except SSDT )..

 

I had played around and searching for a couple of days to make work. I am sure this is not the best solution or even correct ( at least it works ) as also using the best avaliable azure resources  for the data workflow.

 

But at least for a no coder like me it was the only option I manage to make it work and seemed easier to follow.

I am planning to write an analytical blog post but until I found some time and optimize the set up, this is a summary of what I did.

 

I used Azure Logic apps to send tweets to an event hub and then used an Stream Analytics job to read from event hub and send them to PowerBI.

 

 

Create a Logic app and use the default twitter connector as trigger  ( plus the neccessary resource group, app plan etc. )  

 

https://azure.microsoft.com/en-us/documentation/articles/app-service-logic-create-a-logic-app/

This link also has other link on how to create the twitter app in Twitter Dev

 

Create an event hub

https://azure.microsoft.com/en-us/documentation/articles/event-hubs-csharp-ephcs-getstarted/

I didn't use VS since I only add endpoints

 

Deploy the event hub connector from Github

https://github.com/logicappsio/EventHubAPI

 

Add Twitter & EventHubAPI to Logic app workflow

 

 

Set up Stream Analytics Job

https://azure.microsoft.com/en-us/documentation/articles/stream-analytics-get-started/

 

 

A quick post that has all combined and unfortunately I found it after tried many other things

http://blogs.msdn.com/b/logicapps/archive/2015/09/23/adding-insights-and-telemetry-to-logic-apps-thr...

 

Hope it can help you start from somewhere.

I am also hoping many have designed it better and easier..Looking forward to their opinion

 

Konstantinos Ioannou