Modeling Large Dataset in Desktop

[Anonymous]

Hi,

I am just getting started with Power BI (self-taught) and I can't figure out how to model a dataset that I KNOW is going to be way too big for me to save to my laptop and then publish. I have a PPU license so I'm not too worried about how big it will be with all the data in it. I was hoping to build it by putting some filters into the model and then removing them after publishing but it seems I can't modify a published dataset without bringing it back onto my desktop (literally back to where I started). You would think a quick google search would get me 10 different ways to do it but I'm not finding anything. What's the trick?

Thanks

[parry2k · Accepted solution]

@Anonymous this can give you a good idea. Limit The Amount Of Data You Work With In Power BI Desktop Using Parameters And Deployment Pipelines - Chris Webb's BI Blog (crossjoin.co.uk)

👉 Learn Power BI and Fabric - subscribe to our YT channel - @PowerBIHowTo

If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤️

[parry2k]

@Anonymous That is kind of how it will work. I will try to find a link to share. 

👉 Learn Power BI and Fabric - subscribe to our YT channel - @PowerBIHowTo

If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤️

[parry2k]

@Anonymous you can add a parameter to restrict the rows when you are doing development on the Power BI desktop and once ready, publish it, and in the service, change the parameter value to load all the data. This is the common way to deal with it. Solved: How to limit the dataset during the development - Microsoft Fabric Community

👉 Learn Power BI and Fabric - subscribe to our YT channel - @PowerBIHowTo

If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤️

[Anonymous]

Parry, Thanks. Is there a link to how parameters work? I see within the "Tranform Data" there's a way to create parameters but nothing is obvious how to apply that parameter to a dataset. Once again, my google skills seem to be failing me. If I just place a filter on a column "date is within 30 days" is that basically the same thing? Then once i publish I change it to "date within 5 years"?