There are signs the billionaire is becoming unpopular with the very demographic group most likely to buy EVs