If it wasn't English, don't worry. Even at B1 level and above, most learners still work out what they want to say in their first language and then rebuild it in English. But that translation step slows you down and keeps you from sounding as fluent as you want to be.