Reply
Highlighted
Frequent Visitor
Posts: 3
Registered: ‎12-03-2018
Accepted Solution

Ingesting multiple gzip files

We are trying to ingest multiple gzipped CSV files for a project.  We can ingest a single gzipped file with the following:

let
    Source = File.Contents("C:\Users\username\something.csv.gz"),
    Decompressed = Binary.Decompress(Source, Compression.GZip),
    #"Imported CSV" = Csv.Document(Decompressed,[Delimiter=",", Columns=28, Encoding=1252, QuoteStyle=QuoteStyle.None]),
    #"Promoted Headers" = Table.PromoteHeaders(#"Imported CSV", [PromoteAllScalars=true]),
    #"Changed Type" = ....snipped...
in
    #"Changed Type"

And we can import multiple plain CSV files from a directory using the directory source type.  What I can't figure out how to do is to import multiple gzipped files in a directory.  How do we apply the "Binary.Decompress" to each file in a directory as part of the load?


Accepted Solutions
Moderator
Posts: 10,201
Registered: ‎03-10-2016

Re: Ingesting multiple gzip files

@thomas_pike ,

You can create a function in Power BI Desktop as discussed in this similar thread, then invoke this function.

Regards,
Lydia

Community Support Team _ Lydia Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post


All Replies
Moderator
Posts: 10,201
Registered: ‎03-10-2016

Re: Ingesting multiple gzip files

@thomas_pike ,

You can create a function in Power BI Desktop as discussed in this similar thread, then invoke this function.

Regards,
Lydia

Community Support Team _ Lydia Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.