Conversational AI
Multimodal Design

Learn Languages with Alexa

COMPANY Amazon
ROLE Sr. UX Designer
Duration 15 Months
Launch Mar 2023

Language learning product that offers English language mini-lessons to Spanish users who have little to no understanding of English, with a focus on pronunciation evaluation and guidance

My Impact

Created #1 language learning skill on Alexa with 250k+ monthly users and 10.5 min of user engagement

Background

Learning a language involves multiple facets such as reading, writing, speaking, listening. However, in order to communicate in a language, you needn't know how to read and write. Conversational learning is so different from learning how to read and write and it can be intimidating. You need to get the grammar and the pronunciation right, know sufficient vocabulary of words, frequently used phrases and expressions in real life scenarios.

Although there are plenty of companies trying to solve this very problem, our research showed that language learners found existing tools to be ineffective and limiting. Our findings showed that offline tools such as language classes are expensive and inflexible. On the other hand, online tools lack situational lessons and fail to help learners to improve their pronunication and navigate real-world scenarios confidentally

Learners wanted a product that gave them real-time feedback on their pronunication and navigate real-world scenarios confidentally.

Goal

To help native Spanish speakers improve their English pronunciation skills and help them navigate real-world scenarios.

Role

Led design and research efforts for the language learning experience across the entire Amazon Echo family of devices (Echo, Echo Dot, Echo Show, Echo Spot)

Process

As the unicorn designer on the project, I followed an iterative step-by-step approach throughout the project, right from strategy and research to design, development & testing as outlined below.

UX Research Studies

Conducted 12+ user interviews, designed 8 surveys, and partnered with the Customer Insights team for 3 beta studies including a 5-week long beta study to understand user needs, pain points and evaluate designs

Design Strategy & Ideation

Defined design strategy and developed a 3-year product roadmap by partnering with product managers to ensure a balance of user needs and business requirements. Led 3 ideation sessions, provided design consultation for 2 hackathons for 10+ teams to uncover new ideas and prioritize features

Model Training & Script Writing

Worked with research scientists to understand ML model constraints & wrote scripts for situational & open-ended conversations for model fine-tuning and implementation

Design Prototypes

Designed experiences for product launch and north-star vision that helped streamline conversations and drive decision making. Designed user flows, defined interaction patterns, created design specs & built multimodal prototypes (with text & voice) for experimental studies and implementation.

Collaboration

Collaborated with multiple stakeholders across 7 teams and a 3P language learning partner to deliver the best experience for language learners

Leadership

Influenced leadership decisions by presenting north-star design work to senior executives (VPs and SVPs) for buy-in and redefine language learning

This AI-powered language learning skill offers over 200+ guided English lessons across 50+ themes covering vocabulary, grammar, pronunciation and common expressions, allowing users to learn English in real-world scenarios.

Our overall goal was to make learning a new language less intimidating, more affordable and useful in real-world situations.

Pronunciation Evaluation

Advanced AI-powered pronunciation analysis that provides real-time feedback (audio and visual modalities) and uses an affirmative learning methodology to help learners perfect their English speaking skills and build confidence through positive reinforcement.

Pronunciation Evaluation

Gamified Learning

Interactive practice sessions with scoring systems, achievement badges, and progressive challenges that make learning engaging.

Gamified Learning

Rich library of content

Over 200+ lessons across 50+ themes for different kinds of learners (novice to expert), with recommendations based on skill level, progress and preferences

Affirmative Approach

Results

The product was launched in Spain in Jan 2023 and in the US and Mexico in July 2023 on the entire family of Echo devices with and without screen sizes ranging from 2.5 inches to 15 inches.

Overall, the project resulted in the following outcomes as outlined below.

High satisfaction

Users are most satisfied with pronunciation evaluation and Alexa's pronunciation guidance at a phoneme level

Variety of lessons

Users were impressed by the large collection of lessons that focus on situational learning

Affirmative Teaching

Positive words of encouragement went a long way for learners and kept them motivated

Within months of launch, the skill gained positive media attention and became the most popular language learning skills on the Spanish Alexa App Store with a rating of 4.0/5.0.

250k+ MAU

monthly active users

~3M

interactions

150k+

lessons completed

~10.5 minutes

per session

Media Coverage

Geekwire

"In January 2023, Alexa launched a language-learning experience in Spain that helps Spanish speakers learn beginner-level English..."

CNET

“Following successful launch in Spain, Amazon brings English learning features to Spanish speakers across North America with enhanced pronunciation feedback...”

← Back to Home