Dataflow Custom Entities in schematized CDM

[FrederickD]

Hi,

When I read the first articles about Dataflow, Microsoft mentions "Dataflows support the CDM by offering easy mapping from any data in any shape into the standard CDM entities, such as Account, Contact etc. Dataflows also land the data, both standard and custom entities, in schematized CDM form."

I am not able to find a way to use custom entities. I can only see "map to standard" and standard entities. I am currently using the build in Data Lake (and not the Azure Data Lake storage option).

Thanks for your help!

Regards,

Frederick

[v-shex-msft]

Hi @FrederickD,

I think it means you can direct get data from created common data model entities which host in 'common data service for apps' side.

If this is a case, you can choose that connector to get data from common data service for apps.

How to use the Common Data Model

Regards,

Xiaoxin Sheng

[FrederickD]

Hi @v-shex-msft

Thx for the reply.

Actually I am trying to solve another problem, I will explain it with an example.

- I have 3 systems containing accounts.

- I want a global repository (Data Lake Gen2) to store all the account info in a uniform and standardized way.

- The account structure that I want is not fitting for 100% in the standard account entity of CDM.

So in the end I want 1 place where all the account records are stored in 1 type of entity. 

I know how to connect dataflow to our company Azure Data Lake Gen 2, but I am not finding a way to store the data at the same place in a custom entity model (so from data lake perspective: everything (data from the 3 systems) is stored in the same CDM folder with custom entity definition).

Kind regards,

Frederick

[v-shex-msft · Accepted solution]

Hi @FrederickD,

So you mean you want to extract particular fields from different datasorces and try to union them as one entity with all records from different datasorue fields?

If that is a case, current data flow seems not support advanced operations in M query formula.

Regards,

Xiaoxin Sheng

[Anonymous]

Hi all,

Did you get a solution for this?