cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
mpjtaylor
New Member

Dataflow - How can I stop automatic steps being added

I have a Datalake with multiple folders with lots of blobs that are JSON files each folder has different json structures and some are lists and others are records. I am trying to use a single dataflow to read in the content so that I can use subsequent dataflows to process specific folders and json files. The reason for this is to have a single datalake scheduled read transaction to get all the raw data.

 

The problem I have is I cannot find a way to save the dataflow with either the binary column or the Json [Content] column as they are automatically removed with the addtion of these frustrating steps which I want to prevent:

 

  #"Transform columns" = Table.TransformColumnTypes(JsonDocument, {{"JsonDocument"type text}}),
  #"Replace errors" = Table.ReplaceErrorValues(#"Transform columns", {{"JsonDocument"null}}),
  #"Remove columns" = Table.RemoveColumns(#"Replace errors", Table.ColumnsOfType(#"Replace errors", {type tabletype recordtype listtype nullable binarytype binarytype function}))

 

I have tried changing the Global and project settings but nothing I do seems to stop these being automatically added,,also tried changing the column types, duplicating the columns

 

How can this be achieved I just want the steps to stop at:

 

let
  Source = AzureStorage.Blobs("storageaccount"),
  Navigation = Source{[Name = "data"]}[Data],
  #"Filtered rows" = Table.SelectRows(Navigation, each [Extension] = ".json"),
  ChooseColumns = Table.SelectColumns(#"Filtered rows", {"Content""Name"}),
  JsonDocument = Table.AddColumn(ChooseColumns, "JsonDocument"each Json.Document([Content]))
in
JsonDocument

 

Kind Regards

Marcus

 

3 REPLIES 3
v-stephen-msft
Community Support
Community Support

Hi @mpjtaylor ,

 

To my knowledge, your requirement about locking applied steps could not be realized currently.
But this is at idea/feedback level alone. May be ,hopes Power Bi will implement this in nearby future.

 

 

 

Best Regards,

Stephen Tao

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

v-stephen-msft
Community Support
Community Support

Hi @mpjtaylor ,

 

Based on my test, you can't cancel the automatic steps. But you can maually delete the steps which you don't want.

 

You can delete a step in Query Settings.

17.png

 

Or you can delete a step in the advanced editor. You need to keep the grammar correct.

18.png

 

 

 

Best Regards,

Stephen Tao

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Thanks Stephen,

 

Deleting the steps and saving they just get recreated,

Helpful resources

Announcements
PBI User Groups

Welcome to the User Group Public Preview

Check out new user group experience and if you are a leader please create your group!

MBAS on Demand

Microsoft Business Applications Summit sessions

On-demand access to all the great content presented by the product teams and community members! #MSBizAppsSummit #CommunityRocks

MBAS Attendee Badge

Claim Your Badge & Digital Swag!

Check out how to claim yours today!

secondImage

Are You Ready?

Test your skills now with the Cloud Skills Challenge.

Top Solution Authors
Top Kudoed Authors