cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
anf1sher Frequent Visitor
Frequent Visitor

Help with JSON import from NIST

I'm trying to import the CVEs from NIST using this page.

https://nvd.nist.gov/vuln/data-feeds#JSON_FEED

 

I'm trying to get the ZIP feed

CVE-2018       7/6/2018

 

But when I bring it into Power BI it looks like this

CVE_data_type       CVE

CVE_data_format   MITRE

CVE_data_version  4.0 

 

I expect it to show all of the CVEs instead

4 REPLIES 4
Community Support Team
Community Support Team

Re: Help with JSON import from NIST

Hi @anf1sher,

 

Here are some similar examples for your reference:

Call web API, receive ZIP, decompress multiple JSON files, Load Them

import gzip csv from web to power bi.md

 

Regards,

Yuliana Gu

Community Support Team _ Yuliana Gu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
anf1sher Frequent Visitor
Frequent Visitor

Re: Help with JSON import from NIST

Either I didn't understand what they were trying say or it didn't help my problem. 

squiddly Frequent Visitor
Frequent Visitor

Re: Help with JSON import from NIST

Hi anf1sher,

 

I've gone down this road -- it's a LOT of data for Power BI to chew through.  The following code will download the JSON in its .GZ format, unzip it, and parse it.  If you're going to be doing this for all of the CVE data (2002-2018) then you might want to make a PowerShell script to download those files and extract them to a local folder, then point Power BI to the folder contents.  If that's something you want to do, let me know and I'll share the script I wrote.

 

 

let
    NvdUrl = "https://static.nvd.nist.gov/feeds/json/cve/1.0/nvdcve-1.0-2018.json.gz",
    Source = Json.Document(Binary.Decompress(Web.Contents(NvdUrl),Compression.GZip)),
    #"Converted to Table" = Record.ToTable(Source),
    Value = #"Converted to Table"{5}[Value],
    #"Converted to Table1" = Table.FromList(Value, Splitter.SplitByNothing(), null, null, ExtraValues.Error),
    #"Expanded Column1" = Table.ExpandRecordColumn(#"Converted to Table1", "Column1", {"cve", "configurations", "impact", "publishedDate", "lastModifiedDate"}, {"Column1.cve", "Column1.configurations", "Column1.impact", "Column1.publishedDate", "Column1.lastModifiedDate"})
in
    #"Expanded Column1"

You could also create a function to loop through and get 2002 thru 2018 but I don't know enough about that to be of help.

Bennos82 New Member
New Member

Re: Help with JSON import from NIST

Hi Squiddly,

 

Im trying to download and extract all the CVE data from NIST (2002-2019) but am not having much luck.

 

You mentioned you may be able to share your script - If you could it would solve a massive headache for me.

 

Many thanks in advance

Ben