I took German in college, and I'd say without hesitation that my German, even right out of college, was worse than your English.

However, I found when I was there that attempting to speak at least a little bit elicited sympathy, and they would answer in English. It was probably easier than finding some German words I would understand.

So yeah, you don't just walk up to someone and start out speaking English.