To understand why, we need to look at the term's murky origins and how language evolves.
The short answer is: increasingly, yes, many people consider it problematic, though it has not been universally rejected. is indian summer a derogatory term
As with any potentially dated term, the respectful choice is simply to use one of the many clear, non-stereotyped alternatives. Language changes; this is one change that costs very little and shows awareness of history. To understand why, we need to look at