Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.
I have a large flat file in Excel. I'm going to break it up into 5 tables in a star schema format. No questions there. The data model is sound, one-to-many fact to dimension relationship, primary keys all set. I will perform this table break up at the TRANSFORM DATA level. Then create the joins. My question is this.... I have to refresh this data once a week with the same extract, It will be in the same SharePoint file, same name. When I click "REFRESH" will the incoming data go thru all of the transformations again without any manual intervention? I want to cklick refresh and have the new data automatically load my star schema data model. Is that what will occur?
Yes.
There could be problems if some of the data doesn't conform to the same pattern/types as the original data , for example, a text value in a number column would break a 'change type' step .
This is just an example, I'm not saying it's going to happen but should be fine.
Thank you very much. So this is best case scenario. My goal is that no data types will change. I am however adding a number of new conditional columns in the transformation as weel, I'm assuming those will fire off and get created during the refresh as well with no problems ?