cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
9192gks
Helper III
Helper III

Inserting streaming data into a static table

Hello Community ,
I have a requirement where i am using an api and it gives me a data of current date. What i was thinking that is there a way that i can insert these rows into a table .it's like copying the data of a streaming table  and inserting/appending it to a static table.

For example my api gives me a current day data and it comes to the streaming table and then i will send this data to my static table, Next day the api triggers again and truncate my streaming table and inserts that day's data and i want it to append in my static table so that i can have 2 days of data and so on.

1 ACCEPTED SOLUTION

I have already used dataflow approach, what it does is it truncates the streaming table data and insert the new data which then i append it to another historical table.

View solution in original post

5 REPLIES 5
adetogni
Solution Sage
Solution Sage

That is not the way powerbi works "normally", you can't have streaming data "pushed in". 
You can however use streaming dataset: https://docs.microsoft.com/en-us/power-bi/service-real-time-streaming

which however is a entirely differnet application and does not involve PowerBI Desktop

 





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




The api that i am using is not streaming ,it just gives me 1 record each day of that particular day,I just need to keep appending everyday records in 1 table to create an historical table

It's a difficult scenario to work in a direct connection API->PowerBi. You probably need a layer in between to store this data in a database and then read all the rows in PBI.

Remember that PBI works (typically) in "full load" everytime. You can't have "here is a piece of the new data, keep the old and add this". I've never used them but maybe dataflows might help you.





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




I have already used dataflow approach, what it does is it truncates the streaming table data and insert the new data which then i append it to another historical table.

@9192gks ,

Is the last solution you have provided resolved your issue. Or you are still looking for a solution

Did I answer your question? Mark my post as a solution! Appreciate your Kudos!! !!
Dashboard of My Blogs !! Connect on Linkedin
Want To Learn Power BI
Learn Power BI Beginners !! Advance Power BI Concepts !! Power BI For Tableau User !! Learn Power BI in Hindi !!
Proud to be a Super User!
!! Subscribe to my youtube Channel !!

Helpful resources

Announcements
May 23 2022 epsiode 5 without aka link.jpg

The Power BI Community Show

Welcome to the Power BI Community Show! Jeroen ter Heerdt talks about the importance of Data Modeling.

charticulator_carousel_with_text (1).png

Charticulator Design Challenge

Put your data visualization and design skills to the test! This exciting challenge is happening now through May 31st!

Power BI Dev Camp Session 22 with aka link 768x460.jpg

Check it out!

Mark your calendars and join us on Thursday, May 26 at 11a PDT for a great session with Ted Pattison!

Power BI Release May 2022 768x460.png

Check it out!

Click here to read more about the May 2022 updates!