Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.
Hello,
I am trying to implement incremental refresh for my large dataset. For the inital load into Power BI Desktop, I am having trouble. My Date column is a text field in the format YYYY-MM-DD. How do I set up the initial load with the RangeStart and RangeEnd parameters?
I have tried changing the format of the column to Date/Time in Power Query and then filtering the the data based on the RangeStart and RangeEnd parameters, but it is still loading beyond the expected number of rows.
Any help is appreciated. Thanks!
Solved! Go to Solution.
@Anonymous
You hit the right article. If your query is not folded, then the Power Query engine needs to bring all the data to perform the transformations. I am not sure what your data source is.
The best option is to ask the data source owner to convert the date field from text to date type in the source itself.
________________________
If my answer was helpful, please click Accept it as the solution to help other members find it useful
Click on the Thumbs-Up icon if you like this reply 🙂
⭕ Subscribe and learn Power BI from these videos
⚪ Website ⚪ LinkedIn ⚪ PBI User Group
@Anonymous , YYYY-MM-DD you should able to convert to date. By changing data type
You can refer this also how to use Day Key
or
https://community.powerbi.com/t5/Desktop/Incremental-refresh-with-ID-YYYYMMDD/td-p/437844
Thanks for the reply @amitchandak . Since the column is text, I'm unable to select a custom filter to filter based on parameters.
@Anonymous , As suggested in my last post, Try to change the data type to text, YYYY-MM-DD should work as a date either via power query data type change or Column tools.
See if that can work
@Anonymous You need to convert the data type to date. Incremental refresh does NOT work on text columns. If you need the column to be text, please duplicate the column, then convert data type.
Right click on the column to duplicate:
Then transform the data type to Date:
Copying DAX from this post? Click here for a hack to quickly replace it with your own table names
Has this post solved your problem? Please Accept as Solution so that others can find it quickly and to let the community know your problem has been solved.
If you found this post helpful, please give Kudos C
I work as a Microsoft trainer and consultant, specialising in Power BI and Power Query.
www.excelwithallison.com
Thanks @AllisonKennedy , I changed this column to Date/Time and was able to load the filtered data to Power BI Desktop. 2 things I noticed:
@Anonymous
For your two things:
Copying DAX from this post? Click here for a hack to quickly replace it with your own table names
Has this post solved your problem? Please Accept as Solution so that others can find it quickly and to let the community know your problem has been solved.
If you found this post helpful, please give Kudos C
I work as a Microsoft trainer and consultant, specialising in Power BI and Power Query.
www.excelwithallison.com
@Anonymous
You hit the right article. If your query is not folded, then the Power Query engine needs to bring all the data to perform the transformations. I am not sure what your data source is.
The best option is to ask the data source owner to convert the date field from text to date type in the source itself.
________________________
If my answer was helpful, please click Accept it as the solution to help other members find it useful
Click on the Thumbs-Up icon if you like this reply 🙂
⭕ Subscribe and learn Power BI from these videos
⚪ Website ⚪ LinkedIn ⚪ PBI User Group