In the CommRob project1 we are investigating Robot Assisted Shopping. We are considering the effects on usability when allowing for mixed-initiative dialogue. It is noted that when adding a robotic assistant to a scenario that was previously involving only one agent, two new tasks are created: collaborative interaction, and learning an interface. Evaluation of mixed-initiative dialogue becomes complicated because it is not straightforward to separate the overall task performance from the attributes brought by mixed-initiative interaction.