volumn of data

[alvino]

Hello.

I have 5 terabyte of data, i need to make a dashboard .

If i buy power bi premium, i can create it??

[arvindsingh802 · Accepted solution]

Power BI does have good compression machenism thus your 400 GB model will contain around 4TB of data at source level.

As you mentioned you wanted to have 5TB of data in single Model I would suggest to rechout to Microsoft to opt for P4/P5
I would recommand to have only required data in your model that will help you to reduce the data size.

[alvino]

Thanks @arvindsingh802 and @Burningsuit , I understood, I already saw that I confuse the interpretation between model and data in general.

[arvindsingh802]

Yes, you will need Power BI Premium to have data more than 10 GB, it can hold data upto 100 TB

[alvino]

I saw on the Microsoft website that the model size limit on the power bi premium goes only up to 400GB, and I want to load all 5TB in a single model, since they all represent purchase.

[Burningsuit · Accepted solution]

Hi @alvino 

The size of a Datamodel depends on a great number of things, not just the number of rows. The datamodel compresses on a column by column basis based on column repetition. So the more your data contains repeated data the better it compresses. Equally with Power Query you can restrict which columns you bring in to Power BI. Many things can be done to optimise the Datamodel both for size and performance.

See: Optimization guide for Power BI - Power BI | Microsoft Docs

Also, if your data server is fast enough you can have a direct connection to the data, not necessarily import the data into the Datamodel, this can work for very large Databases. 

See: Using DirectQuery in Power BI - Power BI | Microsoft Docs

Lastly, you can use incremental refresh to work with very large Datasets, so you only have the portion of data you need fast access to in the Datamodel and the other data out on direct query.

See: Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Docs

So it's always difficult to say exactly how large a Datamodel will be, certainly you'll need Power BI Premium with large model support, but then there are several options which will govern the size of the resultant Datamodel. 

Hope this helps

Stuart

[arvindsingh802 · Accepted solution]

Power BI does have good compression machenism thus your 400 GB model will contain around 4TB of data at source level.

As you mentioned you wanted to have 5TB of data in single Model I would suggest to rechout to Microsoft to opt for P4/P5
I would recommand to have only required data in your model that will help you to reduce the data size.