lol, yep, you probably should. Even simple imperative phrases in english sound harsh in Russian. For example, "hand me the pencil" is translated as "дайте мне карандашь"-literally, "give me the pencil". It's only polite in polite context. If you were only hearing one side of the conversation and weren't used to Russian, it would seem quite rude.
