the error message is correct, sometimes you need to combine these simple dax functions to get what you want.
Use Min function to refer the date table, or column that you are using in your measure. But then use the CALCULATE function to change the filter context of your measure so that it takes into account the selected values, perhaps something like:
The ALLSELECTED function gets the context that represents all rows and columns in the query, while keeping explicit filters and contexts other than row and column filters. You can also simply understand that the return value is a table.