How to Automate Binary Extraction into Seperate Queries

[KamKam]

Hi Power BI Community,

I have a dataset that has a column with Binary values in it. When I click on one of the binary values it opens an entirely new table. I would like to extract the data in these Binary values and make them into a new Queries.

There are quite a few rows in the orginal data so I would like to automate this.

Is there a way to do this?

I was trying to do this with M Language but I could not find a way to create a new Query using it. Is there a way to do that?

[selimovd]

Hey @KamKam ,

if you don't have to transform anything, you can load the folder and use the "Combine & Transform" option:

How to Load Data from a Folder in Power BI - insightsoftware

Would that work for you?

If you need any help please let me know.

If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍

Best regards

Denis

Blog: WhatTheFact.bi

Follow me: twitter.com/DenSelimovic

[KamKam]

Thank you for the suggestion @selimovd.

Unfortunately, this only extracts the values from the first Binary row. I would like to do this for each of the Binary values.

Do you have any other suggestions?

[selimovd]

Hey @KamKam ,

this is not true. With the combine option, a function is created that combines all files in this folder. Like this you can combine all "binary files" (like CSV) into one table.

Please give it a try.

If you need any help please let me know.

If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍

Best regards

Denis

Blog: WhatTheFact.bi

Follow me: twitter.com/DenSelimovic

[KamKam]

Hi @selimovd,

You are right. It did pull the correct amount of rows. However, it has only made columns for the first Binary value. The other Binary values have different columns in them.

 

For example, this is what the first table looks like:

And here is the second:

 

[selimovd · Accepted solution]

Hey @KamKam ,

yes, the files have to have the same format.

But if you want to automate things, they anyway have to have the same format. If every file is different you have to load one by one and then after you changed the files you can combine them again.

Does this help you?

If you need any help please let me know.

If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍

Best regards

Denis

Blog: WhatTheFact.bi

Follow me: twitter.com/DenSelimovic

[KamKam]

Thanks @selimovd,

Do you think that I could automate this using M Lanugage? If so, do you know how to create a new Query using M Language?

[selimovd]

Hey @KamKam ,

you can do a lot with M and the functions.

What format do your binary files have?

Best regards

Denis

[KamKam]

Thank you @selimovd.

I ended up doing it manually.

I don't think that Power BI is the tool for ingesting the large amount of data that I was working with. When I clicked on Save & Apply in the Query Editor my machine ran out of RAM.

I will have to find a new tool for cleaning the data.

Thank you for your assistance.

[selimovd]

Hey @KamKam,

that depends if course on the amount and complexity of your data and the power of your notebook.

But for huge or complex amounts there are just physical limitations. Check the Azure techniques like data factory or synapse for these kind of situations. They are scalable and made for more complex scenarios.

Best regards

Denis