The Dolls Have Ears—and Algorithms
Skip to content
Dec 21, 2015

The Dolls Have Ears — and Algorithms

By Alanna Lazarowich | Based on insights from Adam Pah

Toys loaded with the latest machine-learning capabilities undoubtedly made it onto 2015 holiday wish lists. Offerings like Hello Barbie, CogniToys Dino, and Miposaur provide an opportunity to reflect on recent advances in artificial intelligence (AI)—as well as a few challenges.

What three trends do these AI-empowered toys showcase?

1. Advances in Natural Language Processing and Gesture Recognition

Most of us are familiar with natural language processing and voice recognition from our interactions with technologies like Siri. Now AI is being used to reinvent how children interact and communicate with toys.

Take Hello Barbie, a doll that converses, jokes, and plays games. The doll is equipped with a microphone that records and transmits speech from the child, back through Barbie’s wi-fi enabled accessories, to ToyTalk servers. Voice-recognition tools analyze the child’s comments and, from a set of 8,000 lines of prerecorded content select how to respond or initiate conversation. All this occurs in less than one second.

Or consider Miposaur, a toy dinosaur on wheels that moves in response to hand gestures—a feature that may forecast gesture-activated electronics like car ignitions, door locks, alarm clocks, or stoves.

Advances in these areas will continue to transform how people interact with machines, creating more natural and effortless communications that are aligned with how we live our daily lives.

2. Advances in Personalization

Consumers are growing more and more familiar with personalized suggestions and interactions through the use of tools like Neflix’s and Amazon’s recommender engines. We are emerging into an era where products and services, from medical care to consumer products, will be designed and customized to our own unique needs and preferences.

We see these advances reflected in this year’s selection of toys. Although Hello Barbie has limited prerecorded content, it will nonetheless “remember” things about the child in order to customize interactions. For example, if a child tells Hello Barbie that she is an only child, Barbie will no longer ask her about siblings.

Offering even greater personalization is the CogniToys Dino. In addition to remembering a child’s previous interactions, the Dino connects to the cognitive system IBM Watson, allowing children to receive direct responses in real time. If a child tells the Dino that she loves space, the Dino will “push” interesting information in this area.

3. Privacy and Security Challenges

It is becoming increasingly clear, however, that these AI advances come with privacy challenges.

As adults, we are familiar with advertising practices that feed off of our search histories—after researching a gadget online, we may not be surprised by a pop-up ad offering a discount on that gadget. But what if a coupon for a toy arrives in your inbox, or on your doorstep, based on a conversation that your daughter just had with her Hello Barbie?

ToyTalk, Mattel’s partner in creating Hello Barbie, will capture, store, and analyze children’s conversations with the doll—to generate responses, of course, but also for their own research and development purposes.

In addition, Hello Barbie features a Parent Portal that caregivers can use to listen in on the conversations that their children have with Barbie. Parents will also be able to share the video or audio files on social media—which has its own privacy risks. “Our social data is as unique as our DNA, except that there aren’t any strong guidelines on when, how, or who uses it,” says Adam Pah, a clinical associate professor of management and organizations at the Kellogg School and associate director of the Northwestern Institute on Complex Systems (NICO).

Concern over Hello Barbie’s intrusiveness is such that a group has already formed to warn parents of the dangers of the doll, and Campaign for a Commercial-Free Childhood has started a campaign to get it taken off the shelf.

There is also the risk that control over the data will leak beyond the companies currently responsible for that data’s safekeeping. Already, a group of lawyers have established a website and toll-free number for anyone who thinks that their Barbie has been hacked. Anyone who thinks these concerns are overblown should remember the November 2015 hacking of the electronic toymaker VTech—during which profiles, pictures, and audio files from more than 6 million children were exposed.

As artificially intelligent products march from the design lab to the playroom (and indeed every room), they bring with them associated security challenges that need to be carefully identified and addressed.

How long before Santa starts recruiting data scientists and cyber security consultants to his team?

Editor’s Picks

A mentor puts capes on proteges.

Pod­cast: How to Be a Great Mentor

Plus, some valu­able career advice that applies to just about everyone.

Kids decide whether to buy water or soda.

A New Way to Per­suade Kids to Drink More Water and Less Soda

Get­ting chil­dren to make healthy choic­es is tricky — and the wrong mes­sage can backfire.

Computational Social Scientists discuss solutions.

How Can Social Sci­ence Become More Solutions-Oriented?

A con­ver­sa­tion between researchers at Kel­logg and Microsoft explores how behav­ioral sci­ence can best be applied.

An entrepreneur enters an established company.

Buy­ing a Com­pa­ny for Its Tal­ent? Beware of Hid­den Legal Risks.

Acquir­ing anoth­er firm’s trade secrets — even unin­ten­tion­al­ly — could prove costly.


Take 5: Tips for Widen­ing — and Improv­ing — Your Can­di­date Pool

Com­mon bias­es can cause com­pa­nies to over­look a wealth of top talent.

Drug innovation at a pharmaceutical company

Every­one Wants Phar­ma­ceu­ti­cal Break­throughs. What Dri­ves Drug Com­pa­nies to Pur­sue Them?

A new study sug­gests that firms are at their most inno­v­a­tive after a finan­cial windfall.


4 Key Steps to Prepar­ing for a Busi­ness Presentation

Don’t let a lack of prep work sab­o­tage your great ideas.

Healthcare workers meet in a hospital corridor.

Video: How Open Lines of Com­mu­ni­ca­tion Can Improve Health­care Outcomes

Train­ing physi­cians to be bet­ter com­mu­ni­ca­tors builds trust with patients and their loved ones.

A man tries to improve OR scheduling.

Here’s a Bet­ter Way to Sched­ule Surgeries

A new tool could dri­ve sav­ings of 20 per­cent while still keep­ing sur­geons happy.

Voters who do not trust each other.
Politics & Elections

Why Eco­nom­ic Crises Trig­ger Polit­i­cal Turnover in Some Coun­tries but Not Others

The fall­out can hinge on how much a country’s peo­ple trust each other.

A clerk scans brand trademarks.

Build­ing Strong Brands: The Inside Scoop on Brand­ing in the Real World

Tim Calkins’s blog draws lessons from brand mis­steps and triumphs.

two coffee growers harvest beans

How the Cof­fee Indus­try Is Build­ing a Sus­tain­able Sup­ply Chain in an Unsta­ble Region

Three experts dis­cuss the chal­lenges and rewards of sourc­ing cof­fee from the Demo­c­ra­t­ic Repub­lic of Congo.