Clearly not in start up environments. What do bother some shopkeepers or restaurants owners for example, is when tourists speak english to them very fast and naturally assuming everybody speaks english. But then if you ask first politely "i'm sorry i don't speak french", then you'll only receive warm welcomes.