Customize colors for legend and axis labels in the stacked column chart

[PSEJR]

Hello

I'm working on a stacked column chart, where I want to customize the colors based on legend information and X-axis information. Here's the furst I've come:

As you can see I have the x-axis split in Budget/Forecast by moth, and in the legend I have "Nature of spending":

What I would like to do is make the colors different for the budget and the forecast. It is not very obvious in the current design, which are two different columns per month. But I can only specify the color based on the legend:

Any idea how to do this? - Without paying for a custom visual developed by third parties?

[amitchandak]

@PSEJR , As of now there is no option because conditional formatting is not allowed the stacked visual after using legend option