That's it exactly. You know it's not a nobleman of some sort because they travel with people as their guards for the most part, and they don't take well to people treating them rudely. As such, you would be able to predict that you would be unlikely to anger that man simply by speaking your mind.

[The fact that Lloyd figured it out on his own makes Kratos smile. It's a small smile, but it's there nonetheless.]