Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
ragi
Regular Visitor

better way to automate data ingestion from third party rest api's

I am new to power bi. I was asked to automate the data ingestion from a third party rest api's and make this data available for power bi reports.

Currently I built a Azure's logic app which gets the data from third party rest api and transforms the data and push it to power bi streaming push datasets. 

 

I am not sure if its an ideal/best solution for this requirement as I see few power bi apps like Salesforce, Google Analytics etc.. where we can directly connect and get data incrementally (through scheduled refresh). 

 

I need a review/comments on the approach I used and also is there a better way to automate the data ingestion?

My customer is not very technical and they just want a system which is less maintainable. Any help would be highly appreciated.

6 REPLIES 6
lbendlin
Super User
Super User

What is the nature of the data? What are the customer expectations in terms of keeping historical data? Does your customer value the difference between snapshots and event based reports?

My understading is that the data is descrete in nature. Customer is looking to see the reports for last 9 months of data. I don't think they value the difference between snapshot and event based reports.  

Use an external process (Power Automate, PowerShell or whatever tool you like) to pull the data from the source and stuff it into a SQL Server database.  Then use that as the source for Power BI.

 

Power BI is not a data storage tool, it is a reporting tool. Don't use it for storage, especially not for data you cannot recover in other ways.

Thank you for the suggestion.

How does it works when we connect the salesforce objects or any standard connectors from power bi directly? I believe its stored in power bi datasets.

It's stored in Salesforce.com.  Power BI datasets are just there for the consumption. If your dataset goes bad/gets corrupted/deleted you can always re-load the data from Salesforce.com.

Currently I'm pulling the data from third party system through rest apis. Third party system stores the data and we can pull it anytime we want through their rest apis. 
So is it feasible to build a custom connector for this api and pull the data similar to salesforce?

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.