Hi,
I'm tring to do enterprise level BI with Azure.
The OLTP database will be updated on daily basis, and need to pushed to Azure data warehouse and then it needs to consumed from power bi for visualization.
I have planned the following architecture.
1, Need to load data from on premise sql server to Azure blob storage in an incremental manner using azure data factory(is the data from blob should be deleted after it is loaded to azure data warehouse or not).
2,Need to load data from azure blob storage to azure data warehouse in an incremental manner with azure data waouse(how to this series of incremental load i.e incremental load with sql server to azure blob and then from blob tp azure data warehouse).
3,Transform data with azure data factory(Don't know which methed to use whether spark,data bricks,etc)(not sure the data transformation should be done)
4,model data with azure analysis service(don't know whether it is needed or not and please let me know what is difference between with azure analysis services and without analysis services)
5,consume data from power bi for visualization.
