I changed one Android Auto setting and Google Maps night mode finally worked like it should