Negotiating Lexical Uncertainty and Speaker