All the nuance disappears. When talking to someone in a languge that's not easy for them, you discover that idioms and other forms of communication disappear. You need to be extremely direct and specific in order to make yourself understood.
The thing is, just about everyone speaks some form of broken English. It's "broken" because it doesn't match our version. Their language and our language isn't the same one—the other person may think your English is broken too.
Our ability to communicate with one another isn't nearly as sophisticated or error free as we think it is.
You will be misunderstood. If it's critical that we understand you, say it more clearly. Say it twice. Better yet, act it out, live it, make it an action, not merely a concept.