Concept Sketches Conference Room Voice User Interface

 

Concept Sketches Conference Room Voice User Interface

Project Role: Lead UX


Context

Setting up conferencing systems in meeting rooms is often intimidating for most users. Can we combine a voice user interface with the existing graphical user interface to provide a more accessible and successful experience?

Our team brainstormed ways to leverage Amazon’s Alexa Home Skills to create a multi-modal conference room experience.  

Technology Integrations

  • Television display in conference room

  • Alexa Services and Amazon Echo

  • Calendaring System such as Office 365 Integration

  • Room control system (controllers, switchers, user facing touch panel with graphical user interface)

Discoverability: Each conference room should have a display indicating the ways to interact with Alexa.  

Discoverability: Each conference room should have a display indicating the ways to interact with Alexa.  

Goals

Discoverability: To inform the user that voice commands are available for a given space.

  • Signifiers: To inform the user about room capabilities and commands

    • "What features are available? "

    • "Can I have a video conference?"

    • "What do I say to do ________?"

    •  Comprehensibility: "How am I supposed to say the command so Alexa understands?"

  • Responsive Feedback: How do I know my command was successful/failed?

  • Responsive Feedback: How do I know Alexa is listening? 


Anatomy of an On-Screen Alexa Skill

As a part of the multi-modal experience, we looked to provide feedback and additional controls and assistance through the touch device interfaces found in most meeting rooms.

Alexa Overlay (automatically appears and retreats with user voice commands)

  1. Voice command icon

  2. LED light which flashes to provide additional feedback

  3. What the system “heard” the user say

  4. The command being executed

  5. Help icon - when pressed reveals more information about Alexa and commands

  6. Cancel icon - when pressed will cancel the command

Alexa overlay on the meeting control device

Alexa overlay on the meeting control device

Screen Shot 2021-01-06 at 11.23.46 AM.png

Alexa Extended Help Overlay (appears if the user presses the help icon)

If users selected the help icon they would receive additional information on how to interact with a particular command.


Sample Skill: Start The Meeting

  1. User triggers Alexa by some variance of: "Alexa, can you start the meeting?"
    a. The front LED on the touch panel flashes to indicate it is "listening" 

  2. The touch panel shows what it heard the user say

  3. If successful, the touch panel shows it executing the command

    a. The front LED on the touch panel glows solid green to indicate it was successful.

    b. Alexa responds audibly with some variant of "Starting your Test Meeting now".

  4. The Alex modal retreats after 5 seconds of inactivity

Prototype of Alexa Skill process

Prototype of Alexa Skill process