Money works differently in communities traditionally excluded from formal banking, which makes designing products that really serve their needs a very different kind of challenge. People who live in the last mile often prefer cash because it’s physical. They can see it, touch it, and access it at any time.

While digital money offers many benefits, such as securely sending money over long distances and accessing new forms of credit, many don’t trust it because the places where they can access digital currency have often been too far away.

In 2017, over 500 million adults lived more than three miles from a financial access point in eight emerging markets studied by the Gates Foundation. This may not sound like much of a barrier, but for those living in the last mile, it means having to close their shops, lose a day of earnings, arrange family care, and pay for travel, which can be time-consuming and difficult, especially during rainy seasons. For low-income people, the inaccessibility of financial services has been a deal-breaker for adopting digital money. On the flip side, banks, telecoms, and other companies struggled to reach these customers because their products were not inclusively designed for them, and their distribution models failed to scale in rural areas.

Amid these myriad challenges, IDEO and the Gates Foundation saw an opportunity to introduce innovative ways to provide access to digital financial services even in the most remote areas of the world. And to make bold new bets: Could we design new digital experiences centered around the financial needs of people in the last mile? What would happen if we mobilized hundreds of actors to develop new ways to address financial access at the last mile? What if we took the most exciting financial innovations that worked in East Africa and piloted them in South Asia—and vice versa?

Working with more than 70 partners, including local startups, corporations, including Google, Unilever, Telenor, Standard Chartered, and BNI, as well as IDEO.org’s Women & Money program, LMM adopted a collaborative, ecosystem approach to drive and scale new digital financial products and systems.

A few of the life-changing innovations launched by LMM and its partners include:

• Finja’s intuitive small-business app that helps micro-merchants in Pakistan access flexible, interest-avoiding Islamic credit  to order products from fast-moving consumer goods companies like Unilever. Finja now serves 45,000 merchants and reaches 10.2 million customers.
  ‍
• Accessing government benefits can be a challenge, especially when it’s through a mobile phone, so IDEO helped Indian startup Haqdarshak develop a robust digital experience for its 52,000 community agents to facilitate access for low-income people. The agent network—70 percent of whom are women—now serves more than 7.6 million families and has unlocked $2.2 billion in social benefits for those who need it most.
  ‍
• Making micro-credit nearly instantaneous was a solution that startup Kuunda offered to financial agents in Tanzania. IDEO helped adapt the product to deliver working capital for merchants in Pakistan. Today, Kuunda continues to grow across markets in Africa, totaling 6.1 million active users and distributing $1.1 billion in loans globally.   

While the LMM program officially concluded in 2024, lessons, tools, and case studies from the program are accessible on IDEO’s Financial Futures website. Those looking to catalyze equity and inclusion in digital financial services for the last mile can consult LMM’s Financial Confidence Playbook, the open-source Digital Confidence Toolkit (created in collaboration with Google), or the Gender Evaluation Framework, among other helpful resources.

‍

Over 1.3 billion people worldwide in poor and rural areas are excluded from formal financial services, including savings accounts, credit lines, and insurance, making it harder for them to move out of poverty.

34M

underserved users reached by 100+ new financial products, pilots, and prototypes

70+ LMM partners

including Google, Unilever, Grab, Standard Chartered, Cargill, Airtel, Celo Foundation, and BNI

‍

Multinational CPGs excel at creating popular, mass-market products for large countries. When they enter smaller countries like Peru, they often parachute their brands onto store shelves and skip consumer product testing altogether, largely relying on brand recognition to drive sales. This oversight presented Alicorp and IDEO with an opportunity: flip the script and invite young Peruvian women to work together with them to create a new hair care brand from scratch. Over the course of a four-year transformational journey, IDEO worked closely with Alicorp, adopting a “learn by doing” approach to foster a culture of innovation, launch a new brand, and drive growth for the company through consumer-centric design.

The collaboration began with an inspirational trip 10,000 miles away to Seoul, South Korea, the epicenter of global beauty trends. To expand their thinking, the Alicorp/IDEO team received K-Pop glow-ups and explored other cutting-edge beauty experiences. They were inspired by the Korean market’s unwavering focus on meeting the particular hair care and skin needs of Korean women.

Back in Peru, the team conducted multiple rounds of in-depth interviews with young women, teenagers, beauty influencers, and experts across the country. They learned about their beauty goals, personal care routines, and “mixto” hair texture. They heard about women’s struggles with regional weather—the Andean region’s extreme dryness versus Lima’s humidity and the city’s hard water. The research revealed that Peruvian women wanted natural products that worked hard, wouldn’t harm their hair, and celebrated what made them unique. They wanted a brand that spoke to them honestly and authentically. That represented and empowered them. That didn’t overpromise, underdeliver, or hold up European and American beauty ideals that didn't resonate with Latin American women like the multinationals did.

Armed with these insights, the Alicorp/IDEO team developed tangible brand prototypes for women to respond to during successive rounds of user research, including in a beauty pop-up store in Lima. The team shared various bottle types, ingredient mixtures, and brand positioning options. Should the new brand’s personality be an outspoken feminist or a gal pal? Au naturel or sophisticated? The iterative feedback cycles informed everything from brand strategy and ingredient recommendations to product line-up, brand and product naming, launch strategy, and digital activations.

The final design, Amarás (“you will love”), is a personal care line that centers the needs and aspirations of Peruvian women. Hitting shelves in 2022, its shampoos and conditioners feature local, bio-diverse ingredients, including mangoes, macadamia nuts, and goldenberries, that help address the specific hair texture needs of women in LATAM and the climate realities of the Andean region. The brand’s launch campaign included TV and print ads featuring Peruvian models from every region as well as commissioned murals celebrating local beauty by artists across Peru. Most notably, the unapologetically authentic Peruvian hair care brand became a TikTok sensation, garnering over seven million organic views and more than 300 viral videos from enthusiastic new fans.

Three months after its launch, Amarás seized a 7.5 percent share of the personal care aisle—a remarkable goal it had set for year three.Since then, Alicorp has continued to expand its creative capabilities, designing personal care products tailored to the cultural and beauty needs of Latin American consumers.

Alicorp launched numerous successful brand extensions across its food and home care categories, but was unable to crack the $340M USD hair care product market in its home country of Peru.

7.5%

Amarás’ share of the Peruvian hair care market 3 months after launch—a goal Alicorp had set for year 3

7M+ organic views and 300+ organic fan videos

created on TikTok during Amarás’  launch campaign

Thirty years ago, China-based Jack Technology started as a home sewing machine manufacturer. A decade ago, the innovative global leader began investing in robotics and exploring AI, a decision that positioned it well to address today’s urgent need for smarter manufacturing solutions.

Believing that a new, strategically positioned sub-brand could draw in larger, more premium global manufacturing customers, Jack Technology and IDEO set out to understand their needs. IDEO began by visiting more than a dozen garment factories across China, Vietnam, and Bangladesh, conducting in-depth interviews with factory managers, industrial engineers, pattern-making leaders, and frontline workers. It soon became clear: the apparel manufacturing industry is at a critical juncture. The way apparel manufacturers navigate the promises of intelligent technology—while addressing deep-rooted structural issues like labor shortages and working conditions—will shape the industry's development for years to come.

For premium clothing brands, garment factory compliance and worker well-being are priorities when selecting production partners, so many owners proudly showcased their improvement efforts. They discussed investing in quieter machines and air conditioning, enhancing lighting, adding greenery, and implementing no-overtime policies. Amid rows of identical sewing stations, the IDEO team noticed small human gestures, such as a small vase of flowers. As one operator said, “I just want to uplift myself during work.”

The research helped IDEO identify a core opportunity for differentiation. Create human-centered products and services that further enhance working conditions in large apparel factories, strengthen their ability to attract and retain talent, and drive the industry toward a more sustainable future. Through multiple rounds of co-creation with the Jack Technology team and key apparel-sector stakeholders, a clear brand direction for Aitu began to take shape: “Smart Machines, Uplifting People.”

Guided by this human-centered ethos, IDEO helped build a comprehensive brand system for Aitu. The idea of “uplifting people” and showcasing garment workers’ professionalism and skill is expressed throughout all brand communications, the industrial design of its smart sewing machines, and the interaction and industrial design of a humanoid sewing robot.

In the eyes of factory workers, this is the new work experience Aitu brings to life. Compared with traditional bulky industrial machinery, the clean lines and soft edges of Aitu’s new AI-powered sewing machines feel more like the professional office tools found in bright, organized workplaces. Concave surfaces and soft materials diffuse glare from overhead lighting, reducing eye strain, while clear interaction logic and icon-based visuals accommodate operators with varying levels of skill and education. AI technology, seamlessly embedded in the machine’s core functions, automatically adjusts parameters for different fabrics and tasks, allowing operators to achieve high-precision results with less effort. A soft halo-like light glows whenever the AI-assisted function is active, fostering users’ trust in both the technology and the AI-powered sewing machine as a whole. When hundreds or thousands of Aitu machines are arranged together in a factory, the overall effect is a modern, professional, and high-end work environment.

Working closely with Aitu’s robotics team, IDEO’s final design challenge was to bring a human-machine collaboration to life through a full-scale AI robot, AI10. The robot has an elegant, biomimetic silhouette. Its fabric-like outer finish features design elements commonly found in garment making, such as cutting and stitching lines, giving the robot the approachable look and the feel of a skilled tailor companion who can assist with simple, repetitive tasks. When AI10 is in operation, a circular light ring gently pulses at the sides of the robot’s ears as well as on the paired sewing machine’s display screen, clearly signaling the robot’s activity to its human co-workers.

In September 2025, Jack Technology debuted its new Aitu brand, along with its first AI sewing machine and a humanoid robot prototype, at a launch event at Shanghai Tower and at the China International Sewing Machine & Accessories Show. IFA Berlin, Europe’s largest trade show for consumer electronics, honored Aitu with a Gold Award for AI Product Innovation for seamlessly integrating AI technology and industrial design. Jack Technology’s humanoid robot is expected to go into full-scale production in 2026.

Before AI, the apparel manufacturing industry had experienced little fundamental change since the invention of the lockstitch sewing machine nearly two centuries ago.

2025 Gold Award for AI Product Innovation

from IFA, the world’s largest home and consumer tech event

Alicorp has direct operations in Peru, Bolivia, Ecuador, and Chile, manages export operations in more than 30 countries, and oversees over 150 brands. While its AlaCena sauces are ubiquitous in South America, the brand’s North American market primarily consisted of purchases made via Amazon by Peruvians living abroad. To help the CPG giant expand meaningfully and sustainably onto US grocery shelves—and achieve its ambitious $50 million retail sales goal in five years—Alicorp and IDEO collaborated on multiple projects over a two-year period. The partnership began in early 2020 with consumer research and product strategy, ultimately leading to the development of initial product branding, positioning for launch, and an in-market pilot in late 2021.

‍‍Through a combination of large-scale digital surveys and in-depth, in-person and remote research interviews, IDEO discovered that AlaCena’s Tari and Uchucuta’s hot sauce recipes resonated the most with US consumers. Made from native Aji Amarillo and Rocoto chili peppers ground using a traditional Andean “batán” technique, consumers appreciated their complex flavors and enjoyed how they enhanced, not overpowered, everyday foods like burgers and fries. The sauces’ authentic Peruvian culinary roots were also a key differentiator. In addition to consumers, IDEO consulted with industry experts—including executives from large-scale grocery chains and chief merchants of leading big-box stores—to explore retail and marketing trends and identify potential innovation partners for Alicorp in the US.

Based on the research, IDEO recommended a few changes to ensure a successful launch: Lead with the Tari brand, which was the most memorable and easiest to pronounce, and position it as an “everything sauce.” Change the packaging from a large plastic pouch to a smaller squeeze bottle to better align with consumers’ expectations and stand out on the inside of refrigerator doors. Adjust the product formulation to appeal to mainstream consumers looking for cleaner labels. And visually celebrate Tari’s Peruvian roots through bright colors, traditional textiles, and a llama, an animal closely associated with the Andes Mountains. In addition to these recommendations, IDEO provided a comprehensive go-to-market retail strategy that included potential US regions for launch, retail brokers, distributors, manufacturers, and R&D and pilot retail lab partners, as well as job descriptions for a new North American-based sales team.

While Alicorp worked on reformulation and packaging strategies, IDEO refined Tari’s initial branding strategy. Steeped in Peruvian aesthetics, the brand’s new look and feel featured a vibrant color palette, geometric patterns, and—of course—a friendly llama icon, which could also be found on all in-store point-of-sale items IDEO designed for Tari's pilot launch in late 2021.

The successful 12-week in-market pilot in Tom Thumb grocery stores gave Alicorp the confidence to have its in-house design team make the brand even bolder and more eye catching, and to launch two flavors, Amarillo Pepper and Rocoto Pepper, on Amazon and in over 50 retail stores in late 2024.

Since then, the popular sauces consistently rank among the top 50 percent of the fastest-selling products on US shelves, with 80 percent of sales revenue representing new business. In 2025, Tari expanded its offerings with three additional flavors: Zesty Verde, Tropical Kick, and Smoky Heat. Today, Tari is in transit to 3,000 major grocery stores, including Wegmans, Meijer, Central Market, and The Fresh Market, as well as available for purchase on Amazon.

Alicorp had a vision to expand its beloved and delicious hot sauces to the US market, but needed help fine-tuning the brand and product for an American audience.

3,000

major US grocers, including Wegmans and Meijer, have signed on to sell Tari hot sauces

80%

of Tari’s sales revenue represents new business, a significant expansion of the overall category

Ranked in the top 50%

of the fastest-selling products on US grocery shelves

While we designed a new family of acoustic amps for Fender, we squeezed into an Airstream for two months to better understand the touring musician lifestyle. And when we wanted to better understand the environmental impact of the things we design, we visited a sewage treatment plant to see what happens when a product can't be recycled.

We go after big problems that have never been solved. And by going all in on the unfamiliar and uncomfortable, we’ve come up with creative solutions that we might not have imagined before.

As an industrial designer, I’m a builder. I experience the world with all my senses and apply my tangible building skills to make experiences and systems. Technology inspires me because it's always been an important vehicle to advance our current state. With technology racing forward at an ever increasing pace, some advancements can impact us on an unprecedented scale. As shapers of the future, we must strive to understand the consequences and implications of emerging technology. We do this by asking ourselves uncomfortable questions about possible outcomes during the design process in areas like healthcare, the future of work, and the circular economy.

In order to better understand how emerging technologies could affect our day-to-day life, my colleagues from multiple design disciplines—industrial design, data science, communications, interaction design—and I embarked on an internal IDEO project that could give us some clues. We got curious and asked ourselves, How might the way we’re communicating with each other change with new technology? How might we collaborate together in the future when we can show up in different realities? What could be possible if the digital and physical world blend seamlessly into each other? How will we protect our privacy if we can teach devices our most personal preferences, and what will happen to our data?

We named our project The Discomfort Zone.

In order to explore these uncomfortable, out-there questions, we had to experience them ourselves, and to experience the future we had to build it. Here are the tools that we built:

Personalized Intelligence: by building a camera that can be taught to take the best self portraits based on individualized feedback, we experienced the idea of actively teaching machines our preferences. The user trains it on their ideal lighting, placement, composition, head tilt, and facial expressions. While it may seem like a trivial thing to create, teaching machines to see us how we see ourselves can show us the path to building other devices—like health devices—that the user can teach to adapt to user preferences and feedback.

Complementary Media: a device that can be taught to recognize facial expressions and emotions, then generates an appropriate, customized emotional expression for each user—like a personalized emoji—helped us imagine more depth and expressiveness online using artificial intelligence. This tool can communicate real human emotion, which could lead to improved communication among children, for example.

Shared Realities: a tool, bridging the physical and virtual, that allows workers operating in VR to sense the presence and movements of colleagues around them as if they are on the same plane. An exploration of how virtual and augmented technology might improve collaboration, it allows people to respond to virtual coworkers’ cues without fully disrupting work in the virtual environment.

Network Empathy: code that enables a user to anticipate how large social or interconnected user networks will react to messages before they are posted, bringing deeper understanding and empathy to online communication. With cues from large online networks, smart technology becomes even smarter and empathetic interaction online becomes easier—especially when it is applied to high-profile communications, or at mass scale among networks that might be discussing politics, health, or education.

Meta Identity: code that is invisible to naked eye can be embedded in an object to make it readable by a machine—not unlike a barcode—and give it meaning online. Branding and production methods might evolve toward this physical tagging method, so that users easily learn about physical objects they see, and find them online. Making the physical as searchable as the Internet could further empower consumers to align their purchase decisions with their beliefs and values.

As designers, it is our responsibility to explore the discomfort zone, design holistically, and consider the full range of possibilities of what we create. For example, as much as Network Empathy was intended to be an inclusive tool, it could also be used to manipulate public opinion by predicting the reaction of large audiences. If we use Personalized Intelligence to teach our devices our most personal preferences, what becomes of this new personal data? And who is the owner of this information: the device, the platform, or the individual?

Because technology will serve us on an even more personal level, the stakes are high. Designers are uniquely stationed to be the connectors in an ever more complex ecosystem of stakeholders, and we must ensure the tool leaves the lab and enters an ecosystem with safeguards in place to have a positive impact.

We’re at the dawn of something big and unknown. New technologies are shaping the future in ways we haven’t even thought of yet. Some of them will have extraordinary benefits, while others, through unforeseen capabilities or even sinister intentions, may have unwanted consequences. But as designers, it’s up to us to explore them early, dive into the unfamiliar, and do what we can to shape the future for the better. We’d love for you to join us here in The Discomfort Zone.

The Discomfort Zone was a collaboration among many designers at IDEO. Special thanks to all involved, including the core design team: Leo Marzolf, Jochen Weber, Brooke Thyng, Christian Ramsey, and Nan Tsai.

So much of being a designer is being willing to embrace the uncomfortable. We create new products, experiences and systems for people whose needs are different than ours—sometimes really different.

In one sentence, who are you?

I am an illustrator who enjoys bringing any amount of joy to people through my creations.

What do you do? How did you learn how to do it?

I create different drawings using pencil and ink. The illustrations range from patterns to caricatures, unique creatures, and other one-off ideas. I grew up sketching and doodling and it has continued. When I moved to LA, I was suddenly surrounded by an amazing cadre of artists and creators who constantly inspire me, as well as push me to keep improving myself. That is how I learned my craft and continue to learn, because I believe you never truly finish learning.

What are your 3 favorite possessions?

Miniature Back to the Future 2 hover board; Magnum P.I. Tiki Mug; a drawing of my fiancé and me, which she drew. Not in that order.

What does a typical work session look like?

I have a running list of ideas and sketches that I pull from if I don't have an art show with a specific topic that I am working towards. Usually, I'll do some Google searches on the topic at hand and pull a bunch of reference photos for perusal during the pencil drawing stage. I sketch out the drawing inside a pre-drawn area, such as 4x6 or 5x7. Art that is easy to frame is always a goal of mine, because I love framed art and it drives me mad when I see things tacked onto a wall or cork board. After finalizing the pencil drawing, I'll usually step away for a moment or two to play a video game or watch a show. I like to do something that differentiates the time between stages. Once I come back to the drawing, I pull out all the different micron pens that I think I will use for the piece. I check the nibs, and then I begin inking. I put on dramas in the background to listen to, or things I've seen a ridiculous number of times. West Wing and Parks and Recreation are two such shows.

I don't like to start inking unless I am going to finish a drawing that night. Sometimes, a piece is too large, and I have to break it up over two nights. If that happens, I make sure the pens I've used on the previous night are away from all my other pens. I do this to achieve a consistency within the lines. Once finished, I scan the piece, put it within a predetermined frame, and pack it up for a craft fair or deliver it if it's for an art show. Rinse and repeat as necessary.

How do you get over creative block?

I used to stop drawing and just stew for a bit until it finally passed, which could take a bit of time. As I've gotten older, and ever so slightly more confident in my abilities, I push through it. I just keep drawing. Yes, sometimes the drawings are awful, but as Lauren (my future wife) always says, "sometimes you just have to pass a rat."

How do you see the world in 2078?

A lazy utopia, filled with autonomous everything. Humanity will have moved past Earth and outward into the stars while robots cater to our every whim and we become fat and happy. I could be confusing my vision of the world in 2078 with the timeline in Wall-E—who doesn't yearn for the saccharine dreams of Pixar in 2017. It is tough to image the future right now because at this moment it feels as though we are hanging by a loose wire, and any minute now someone with a spray tan is going to cut the wire and tell us all how huge his ratings are, as we all fall to our collective doom. I hope we make it to 2078, if only so that I can enjoy my hover chair and 128-ounce Slurpee.

What’s number one on your bucket list?

I should say something epic like bungee jumping off of Thomas Jefferson's nose on Mount Rushmore, but honestly, I'd like to have my own artist's studio. Some place I could retreat to and tune out the world and draw silly pictures. That to me is something I want to do before I fade out of this existence.

Who are you creative crushin’ on lately?

I've had a one-sided love affair with Dustin Harbin for a long time. I own two of his original pieces and his diary comics book. The man can use an ink nib like Aaron Sorkin can turn a phrase.

I’ve been creative crushing on Austin Salmi since I saw his doodles, patterns, and adorable characters on Instagram almost two years ago. Austin’s work, learned through practice and osmosis in his job surrounded by artists, has a giggly character about it that fits his intention to hide the ugliness of the world for a moment, and make lovely order out of chaos. I got to learn a bit more about him and his process in this installment of Creative Crushes.

We had just begun work on a project exploring how we might help a medical-liability insurance company increase patient safety by learning from past incidents. As we talked, our conversation shifted away from excitedly imagining ideas for data-driven tools toward ways our work might potentially do harm.

What if our designs ended up raising premiums for doctors and, in turn, healthcare costs for patients? What if they kicked doctors off their insurance? What if doctors stopped reporting adverse events to keep their premiums from rising? There was real potential that our work could result in reduced patient safety or increased cost of care. We could inadvertently build a tool that could be used against the very people we were trying to help.

Today, data systems and algorithms can be deployed at unprecedented scale and speed—and unintended consequences will affect people with that same scale and speed. How can we always make sure we’re putting people first when designing large scale systems? Especially when those systems will change over time and evolve without direct human supervision?

The seed planted during that bar conversation has grown into a set of principles, activities, and now a set of cards that our teams—both data scientists and designers across every other discipline—use to ensure we’re intentionally designing intelligent systems in service of people.

We’re far from the first people to ponder this. We’ve been inspired by organizations like AI Now and Data + Society, books like Weapons of Math Destruction and Technically Wrong, academic communities like FATML and CXI. In particular, we’ve been eagerly following O’Reilly’s series on data ethics (and encourage you to read their free ebook, Ethics and Data Science).

To develop our own set of guiding principles, we started with people. We talked to folks all across the globe: We interviewed IDEO teams about where they found challenges. We spoke to our clients about where they saw intelligent systems go awry. We spoke to the public about where smart designs seemed to cross lines. We observed and read about AI systems that had gone off the rails and worked to understand how this might have been avoided. We learned a lot.

We came up with an original design, iterated on them, and landed on a set of four design principles and ten activities that can help guide an ethically responsible, culturally considerate, and humanistic approach to designing with data. These activities are meant to provoke thought; they’re a vehicle for introducing new ideas and stimulating conversations around ethics throughout the design process.

To start, here are our principles:

1. Data is not truth

Data is human-driven. Humans create, generate, collect, capture, and extend data. The results are often incomplete, and the process of analyzing them can be messy. Data can be biased through what is included or excluded, how it is interpreted, and how it is presented. Unpacking the human influence on data is essential to understanding how it can best serve our needs.

2. Don’t presume the desirability of AI

Just because AI can do something doesn’t mean that it should. When AI is incorporated into a design, designers should continually pay attention to whether people’s needs are changing, or an AI’s behavior is changing.

3. Respect privacy and the collective good

While there are policies and laws that shape the governance, collection, and use of data, we must hold ourselves to a higher standard than “will we get sued?” Consider design, governance of data use for new purposes, and communication of how people’s data will be used.

4. Unintended consequences of AI are opportunities for design

Just as with any design endeavor, we know that we’re not going to get it right the first time. Use unanticipated consequences and new unknowns as starting points for iteration.

To get started with the activities, you can download the cards here. We hope that these activities provoke dialogue and provide concrete tools to help our community ethically design intelligent systems.

Thank you to the larger team who helped make these cards come to life—Ben Healy, Jane Fulton Suri, Jess Freaner, Mike Stringer, Justin Massa, Connie Oh, and KP Gupta, who designed them.

‍

A design researcher, a business designer, and a data scientist were sitting at a bar. It sounds like the setup of a joke, but the conversation was actually quite serious.

As a user experience and interaction designer with a hybrid art and tech background, I’ve long been a fan of the concept of using art and design as a Trojan horse to make tricky concepts accessible. Through intrigue, curiosity, and play, these experiences can bypass our biases and open the door to understanding, without requiring deep comprehension. If you’ve ever visited a children’s science museum and watched kids excitedly engaging with subjects that would bore them to tears in book form, then you’ve seen the power of experience and play at work.

Meet ERNEST

That’s why my colleagues and I created ERNEST, an installation that gives the viewer the job of training a rudimentary artificial intelligence. Using facial and emotional recognition tech, ERNEST shows the user imagery and tries to see how happy it makes them. Our goal for this project was to engage users in a game-like experience to help them understand how machine learning models are trained, and subtly hint at the areas where bias could creep in.

Fellow IDEOer Matt Visco and I wanted to make sure ERNEST didn’t look like a modern computer—we designed it to look vintage. With its old hardware and nostalgic graphics, ERNEST doesn’t feel smart on the surface. Its look is meant to evoke a time when computers carried the promise of a utopian future, prior to mass connectivity and the ubiquitous collection of personal data.

The full installation uses five monitors, two computers, and three Raspberry Pis, which power several video loops that reveal the training data behind ERNEST, and give passersby a sense of the experience even if they don’t engage directly with it.

How it Works

ERNEST uses computer vision to perceive the user ambiently through facial recognition, allowing it to detect when a user is looking at it and how far away they are. When a user gets close enough, ERNEST comes alive and asks the user to help it learn. It then shows the viewer images intended to make the user happy, and gauges their emotional reaction based on their facial expression using a pre-trained model. The facial tracking and emotional data is displayed to the viewer in real time, encouraging users to make faces at ERNEST. Viewers can then validate the accuracy of the model to help ERNEST know if it was correct or not.

(Sound complicated? The video below might make it clearer.)

We installed ERNEST in IDEO San Francisco’s lobby for a couple of months, and also brought it to the San Francisco Art Institute Fort Mason Gallery for the CODAME Intersections exhibition in November 2018.

The Results

Many participants loved to challenge ERNEST, often emoting in varying ways through numerous loops of the game. Once, a group of participants spent nearly 20 minutes playing with ERNEST, takings turns to compare how it perceived each person.

When viewers interact and play with ERNEST, we’re helping them see that machines can have almost human-like perception, reacting differently to different faces, and sometimes being uncannily accurate...or completely wrong. The wrong guesses were in many cases more interesting, and were in fact a very intentional part of the design. We wanted users to see that artificial intelligence is sometimes not as intelligent as we might think.

ERNEST is meant to be a game, but what happens when real-world AI makes the wrong guesses? Or what if those wrong guesses are uneven, indicating an unintentional bias, such as working well for some faces but not others?

We wanted people to realize that designing systems that can ambiently perceive humans without direct input is rife with ethical concerns. And already, systems like these are being deployed at scale. The Guardian predicts emotionally-aware tech is already a $20B industry. Even something seemingly benign like ERNEST causes us to wonder—if an AI is trying to make the viewer happy, who determines what “happy” is? What if bad actors train Ernest to think that disturbing content is “happy?” What if the technology is repurposed to provoke anxiety or anger? What happens if we deploy technology like ERNEST widely?

Of course, ERNEST only scratches the surface of these big ethical questions, but we hope that it helps give people insight into how artificial intelligence thinks, and the ways its thinking can be flawed. The more that we as a society can start to understand these systems, the better we can judge their quality, and work to design them to be in line with our shared human values.

‍

Artificial intelligence and machine learning are among the hottest topics of the tech world, but some of us at the frontier forget that many people feel intimidated—or even afraid of—these technologies. The pop-culture trope of machine intelligence gone rogue has been a part of our cultural psyche for a good 150 years. Think 2001: A Space Odyssey’s HAL 9000, The Terminator’s Skynet, and The Matrix’s... Matrix. Combine that fear with arcane tech-speak like “recurrent neural network” and “generative adversarial network,” and in addition to feeling emotionally intimidating, AI and ML can also feel incomprehensible.

I help organizations cut through complexity by shaping how they show up, through brand strategy, identity, and storytelling.

Working at the intersection of brand and business, I bring an editorial eye and a bias toward making—turning ideas into tangible experiences that people can understand, trust, and believe in.

My work spans government, healthcare, financial services, media, and consumer goods, from launching Gen Z-focused ventures to building innovation labs and reimagining legacy brands. I relish moments of ambiguity and enjoy translating across teams, perspectives, and priorities to move ideas forward.

I started my career in editorial and digital design, shaping cross-platform experiences and identity systems in publishing and agency environments. That foundation still shapes how I work today: I’m detail-oriented, collaborative, and overreliant on the Oxford comma. I hold a BFA in Visual Communication from the School of the Art Institute of Chicago.

For 25 years, I've asked the same question: Who does this design exclude—and what are we going to do about it?

My work spans human-centered strategy, inclusive design, and qualitative research, with clients ranging from Microsoft, Google, and Verizon to the National Science Foundation, and San Francisco Unified School District.

Before IDEO, I taught elementary school in East Palo Alto and spent a decade doing design work with social service organizations—where I learned firsthand what it costs people when systems are built without them in mind.

I am currently writing User Error, a nonfiction book about digital access and the design decisions behind it. I live in Oakland, California.

‍

My expertise spans brand, communication, and product design across tech, education, the arts, and social impact.

I believe great work demands both high-level vision and obsessive attention to detail, and only happens through collaboration.

I bring an inclusive, hands-on approach and a deep understanding of business, which enables me to consistently deliver excellence while always asking why.

Before joining IDEO, I worked at the brand firms Pentagram and VSA Partners. I began my career as a designer, leading teams at the School of the Art Institute of Chicago and the Milwaukee Art Museum. I hold an MFA in graphic design from Maryland Institute College of Art and a BFA in communication design from the Milwaukee Institute of Art & Design, and have taught at some of the best design schools in the US.

I am responsible for IDEO’s long-term success in China and working with clients to use design as a tool to enable growth. Specifically, I have helped Chinese companies design holistic brand solutions through the development of their products, communication, services, and innovation teams, and I have helped multinationals expand their presence and influence in China.

I advise global leaders on developing China-led innovation and capabilities.

In over 15 years in IDEO Shanghai, I have worked on projects that use design to elevate the quality of the experience of healthcare products and services, streamline processes that increase productivity, create spaces and programs that promote and enable inclusive communities, and build next generation mobility solutions that are planet-positive.

Before joining IDEO, I worked at Philips Electronics and the Electrolux Group in Italy, the Netherlands, and Singapore on a number of breakthrough commercial products. I am a member of the Young President Organization in Shanghai.