cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Helper III
Helper III

PowerQuery/M Code or R script within Power BI

Hi Everyone,

 

I've been a heavy user of PowerQuery to perform all my ETL before passing it onto PowerBI.

As i'm working with millions of rows of data, PowerQuery can get too slow whenever i edit anything as it will go through step by step.
Thus i'm wondering if R Script would be faster to perform the ETL within PowerBI instead of PowerQuery?

I'm also curious if anyone here uses R Script within PowerBI to clean up their data.

Cheers

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
Helper III
Helper III

Re: PowerQuery/M Code or R script within Power BI

@v-ljerr-msft , Thanks for the reply. 

Not too sure if you're aware that if we're running huge dataset with lot of ETL, PowerQuery will rerun all the steps whenever you open it thus making it the query extremely slow.

 

I'm still learning R thus I'm here seeking advice but from what I know, R only execute the required steps and don't rerun the entire query therefore I have the impression that it might be faster as compared to PowerQuery.

 

 

View solution in original post

2 REPLIES 2
Highlighted
Microsoft
Microsoft

Re: PowerQuery/M Code or R script within Power BI

Hi @Rookarumba,




Thus i'm wondering if R Script would be faster to perform the ETL within PowerBI instead of PowerQuery?

Based on my research, R is not a fast language. This is not an accident. R was purposely designed to make data analysis and statistics easier for you to do. It was not designed to make life easier for your computer. So I doubt that using R Script would be faster to perform the ETL within PowerBI instead of PowerQuery. Smiley LOL

 

Regards

Highlighted
Helper III
Helper III

Re: PowerQuery/M Code or R script within Power BI

@v-ljerr-msft , Thanks for the reply. 

Not too sure if you're aware that if we're running huge dataset with lot of ETL, PowerQuery will rerun all the steps whenever you open it thus making it the query extremely slow.

 

I'm still learning R thus I'm here seeking advice but from what I know, R only execute the required steps and don't rerun the entire query therefore I have the impression that it might be faster as compared to PowerQuery.

 

 

View solution in original post

Helpful resources

Announcements
August 2020 Community Challenge: Can You Solve These?

August 2020 Community Challenge: Can You Solve These?

We're excited to announce our first cross-community 'Can You Solve These?' challenge!

Community Blog

Community Blog

Visit our Community Blog for articles, guides, and information created by fellow community members.

Upcoming Events

Upcoming Events

Wondering what events you could join or have an event to promote yourself? Check out our Upcoming Events.

Get Ready for Power BI Dev Camp

Get Ready for Power BI Dev Camp

We are thrilled to announce we will begin running a monthly webinar series named Power BI Dev Camp.

Top Solution Authors
Top Kudoed Authors