Reset filters
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Latest work

Transforming a historic music college into a collaborative learning platform

A new campus concept and student experience for Tokyo College of Music.

Read more
Case study
Case Studies
Breakthrough Products
Learning & Work

Since its founding over a century ago, Tokyo College of Music (TCM) has trained countless world-class musicians. Despite its well-established reputation, however, the school was feeling a pressing need to reconsider its role in order to remain relevant in a changing world.

The college had plans to build a second campus in Daikanyama, a prominent area of Tokyo known for being a hotbed for new global trends. Taking advantage of this opportunity, TCM leaders asked IDEO to help them develop a new concept for the school, and to redesign the learning experience while preserving a focus on classical music.

To kick off the research phases of the project, IDEO designers interviewed TCM students, and traveled to London, New York, and Boston visiting educational institutions, music schools, and arts facilities.

The team observed that students at music colleges outside of Japan were giving serious consideration to their career plans at an early stage in their studies, acquiring a variety of skills and mindsets through a well-rounded education. By contrast, TCM students were focused on learning and performing classical music, but tended not to have a clear image of future career opportunities.

IDEO proposed four specific directions for TCM’s new campus, based on an overarching theme of “culture, fields, and people collaborating across boundaries.” The first aim was to foster a business mindset and entrepreneurial spirit among the students that surpassed their classical music training. Next was to increase opportunities for actual performances, collaborations with professionals outside the school, and joint projects. The third aim was to position the college as a platform that would encourage the spontaneous creation of communities within and outside the school. The final aim was to develop students who were digitally savvy and fluent in new technologies, enabling them to continue evolving in response to developments in the real world. These goals are reflected in the various spaces of the school, as well as in the design of the experiences that occur in those spaces.

Between two campus buildings is Music Lane, a path playfully designed to look like piano keys. It connects Daikanyama and Nakameguro, two neighborhoods known as sources of culture and fashion.

The most symbolic of these spaces is the Creative Lab. Originally intended as a library, the space now functions as a platform where people from within and outside the school community can collaborate and generate innovative ideas. The open layout, which encloses a cafeteria for students and faculty, can be altered depending on programming needs. The Creative Lab provides a venue not only for live performances in which the students can polish their improvisational skills, but for holding workshops and other events on topics such as cultural exchange, business, and new technologies.

New furniture and objects were carefully selected to inspire spontaneous encounters and conversation between students from different departments and staff, creating a flow of activity.

The common spaces, used by students and faculty members, help develop cross-disciplinary communities.

Even the landings on the staircases, which tend to be dead space, were designed with this concept in mind. One student commented that the space facilitates meeting new people and creates “opportunities for deeper interaction with students from other departments.” This intentional, open design has transformed the space into a hub within the school and the local community.

Through the new environment and educational opportunities at TCM's Daikanyama campus, students now have stronger opportunities to apply their creative talents in numerous fields worldwide, creating impact informed by the various perspectives, skills, and relationships they have developed at TCM.

A new campus concept and student experience for Tokyo College of Music positions the college as a platform that would encourage the spontaneous creation of communities within and outside the school.
A new campus concept and student experience for Tokyo College of Music.
Tokyo College of Music
Tokyo College of Music
Transforming a historic music college into a collaborative learning platform, music education, campus experience, school cafeteria, school food system, Tokyo College of Music, education innovation, learning experience, future of work, digital transformation, digital experience, digital product design, UX design, business transformation, organizational transformation, culture change, student experience, future of education, understanding user needs, how to design a digital product, innovation, product design, research, transformation, education, learning

Designing a modern digital platform for the constituents of Georgia

Building a more efficient, trustworthy service for Georgia's residents.

Read more
Case study
Case Studies
Strategic Futures
Breakthrough Products
Technology
Public Sector

Georgia is among the most populous states in the American South. It’s a place with a storied past and promising future—on the rise economically, and continuing its powerful cultural impact on music, TV, cuisine, and tourism. Over 10.4 million people call Georgia home, and nearly all of these people will at some point navigate the state’s websites for securing everyday services. Ideally, this online platform would provide unifying and accessible government resources for everyone, whether they’re renewing their vehicle registration, seeking a fishing license, or looking up tax law updates.

The DSGA looked to IDEO to create a brand and design strategy integrating the collaborative, optimistic spirit of the state’s diverse population with a cohesive user experience and a charming, uniquely Georgian voice.

Georgia’s Office of Digital Services (DSGA), part of the Georgia Technology Authority, was challenged with designing a platform to modernize the collective and individual online presence of 80+ state agencies, many of which used visually disconnected formats and color palettes that could leave the public feeling confused. DSGA recognized that they could provide more efficient and higher quality service to the public if they simplified the language, designed the site from the user's point of view, and created a more cohesive look and feel across agencies.

IDEO worked with the DSGA to identify the priorities of Georgia residents who use the various agency websites. On a road trip from Savannah to Atlanta, with stops in Macon and Dublin, the IDEO team immersed themselves in the rich culture of Georgia, connecting with social workers, low-income residents, state agency leadership and civic organizations to learn how Georgia’s digital properties could better address their disparate needs.

The design research underscored that there isn’t just one Georgia—it’s a tapestry of people, geographies and political orientations. Yet several common themes emerged, including:

Georgians want their government to “give it to them straight.” On the redesigned Georgia.gov platform, the people of Georgia can easily search popular topics to get the information they need. This includes learning how to apply for food stamps, renewing a business license, or simply finding out the location of a local office in their area. If a user has remaining questions, they can connect directly with a real human for further assistance, balancing direct information with warmth and a personal touch. User feedback on the site provides the opportunity for continuous design improvement.

Georgians want to take pride in the legacy and the future of their state. IDEO developed an entirely new design system with new navigational elements, fonts, and a color palette inspired by Georgia’s landscapes, all of which can be modified for individual agencies while remaining consistent with the state brand.

With a color palette inspired by the landscape of Georgia, all of the state's individual agencies now exist under a unified state brand.

A distillation of the original Georgia seal adds authority, and new icons anchor the site’s menus and bring more clarity to the search function. The platform was designed to be Section 508 and WCAG 2.0 AA compliant, providing clear and accessible page content that adheres to federal laws and international web standards. To instill trust in Georgia’s online presence, each page also has a header that indicates it’s an official Georgia State website and outlines the uniform features constituents can use to identify this.

The state's logo appears boldly across Georgia's 80+ state agency websites, building trust amongst residents. The logo and branding can also be used on everything from tote bags to signage to business cards.

With improved navigation and easy-to-access prioritized content, Georgia.gov is a much more efficient platform for addressing requests from citizens. The site projects a happy-to-help, citizen-centered approach that aims to empower all Georgians so that they feel confident, informed, and prepared.

Digital Services Georgia
Digital Services Georgia
Designing a modern digital platform for the constituents of Georgia, Digital Services Georgia, technology innovation, digital products, public sector innovation, government services, civic innovation, digital transformation, digital experience, digital product design, UX design, how to design a digital product, innovation, strategy, design strategy, user experience, product design, research, transformation, leadership

A holistic, human-centered approach to managing diabetes care

A digital-first diabetes management system that helped patients get the support they needed when they needed it.

Read more
Case study
Case Studies
Strategic Futures
Breakthrough Products
Health
Technology

According to the Centers for Disease Control and Prevention, nearly 30 million Americans have diabetes, almost 10% of the population. The vast majority of these diagnoses are type 2, which is commonly treated through a combination of medicine, diet, and exercise. Today, one of the major barriers to better outcomes is access to trusted information. As little as 15 percent of people with diabetes receive adequate education from their healthcare providers on managing their disease and making recommended lifestyle changes.

Ascensia Diabetes Care, a global healthcare company, has been a leader in diabetes treatment for over 70 years, known primarily for producing blood glucose meters. IDEO has worked with Ascensia for more than a decade, helping develop and design their CONTOUR NEXT ONE meter in 2016. In 2017, Ascensia engaged IDEO with a new goal of moving the company beyond physical devices. Ascensia envisioned a first-of-its-kind approach to educating and monitoring diabetes patients. In partnership with IDEO, they wanted to build a comprehensive solution—one that would not simply take glucose readings and document food intake, but would consider all factors that impact a person's health.

Through deep collaboration, Ascensia and IDEO built a powerful app-based service. The project began with a strategic vision for the experience and ended with the delivery of an all-encompassing health offering, including training of providers, packaging, app design, content creation, and visual design.

Personalized plans including exercise and nutrition were tailored to the users with the support of one-on-one guidance from a certified diabetes educator.

The patient experience married data and tracking, real-life mentorship, and personalized content. When a patient signed up, they were paired with a Certified Diabetes Educator (CDE) who created a tailored program based on their needs and linked them to relevant articles on topics like cooking, mental wellbeing, and sexual health. The IDEO team led the charge in hiring and training guides, crafting the educational content, and even designing the content management hub.

The data engine behind the app is another one of the program's stand-out qualities. The app pulled data from multiple data sources—exercise bands and glucose meters—to provide constant feedback, track progress, and continually refine the experience. To generate empathy, as well as build the app's initial data set, IDEO's data scientists tested the product on themselves. One designer wore a wrist full of exercise monitors around the office and tracked her blood sugar after every meal.

The app-based service gave those with diabetes access to the right information at the right time and could get their questions answered anytime through chat with their own certified diabetes educator.

The app-based service was tested with 60 people and demonstrated remarkable early results. Only two participants failed to complete the study—a stunning success rate when adherence to therapy for chronic illnesses in developed countries averages around 50%. Additionally, participants reported drastic improvements in both physical and mental health. One recently widowed 70-year-old woman emerged from depression, returned to swimming, and started having regular blood sugar readings.

The project required Ascensia to embrace new ways of working internally, adopt a broader view of their offering, and ultimately expand the way they serve people with diabetes.

A comprehensive kit that introduced users to new, healthy habits in sleep, mood, and more was delivered directly to their door.
Ascensia Diabetes Care
Ascensia Diabetes Care
A holistic, human-centered approach to managing diabetes care, diabetes care, diabetes management, sleep health, sleep analytics, mental health, family mental health, Ascensia Diabetes Care, healthcare, health innovation, patient experience, technology innovation, digital products, digital transformation, digital experience, digital product design, UX design, human centered design, design thinking, customer centricity, systems thinking, systems design, service ecosystem, healthcare design, digital health, patient-centered care, how to design a digital product, innovation, product design, transformation, education, how do we innovate

Creating an out-of-this-world STEM learning experience

Aboard the Verizon Explorer Lab, students can travel to Mars and learn engineering basics along the way.

Read more
Case study
Case Studies
Strategic Futures
Breakthrough Products
Learning & Work
Public Sector

When Mr. Gordon told his fifth grade students they were taking a field trip on a bus, many of them envisioned the city bus that they ride each day to school. But when they saw the Verizon Explorer Lab pull into the school parking lot, they realized a unique experience awaited them. Painted in bright colors, this bus promised something very different from their daily commute.

“Climb aboard, explorers!” says the Lead Explorer. The students walk through the bus’ sliding doors and inside, where instead of rows of seats, they find a sleek research lab. Suddenly, the lights dim. The bus makes a rumbling noise as though it’s about to lift off. And on a large screen, a vision of Earth from space appears. The students listen and point as the video narrator briefs them on NASA’s ongoing search for life in space.

Science education isn’t always this fun. Some kids have a chance to learn through interactive games, immersive experiences, or engaging field trips; but many lack access to rich educational experiences in science, technology, engineering, and math (STEM). As a result, they can be less likely to pursue careers in STEM, though many future jobs will demand mastery of these subjects. This not only impacts a student’s potential and future, but reduces the diversity and number of qualified STEM job applicants.

In under-resourced schools, students are often limited to the scarce tools available for STEM learning in their classrooms. Many kids rarely have a chance to leave their neighborhoods. For these kids, mobile learning experiences that come to their school offer unparalleled exposure to cutting-edge, technologically advanced, and—most importantly—inspiring gateways into these critical academic subjects.

As part of its focus on digital inclusion, Verizon partnered with IDEO to share the excitement of STEM learning with middle schoolers. To facilitate access and discovery of STEM, the team designed a learning experience that takes place on a coach bus and can be scaled to reach kids across the nation.

The team set out to transform the bus into the Verizon Explorer Lab: a futuristic research lab that transports kids to new environments, from outer space to under the sea. As part of the larger Verizon Innovative Learning program, the Verizon Explorer Lab offers delightful and rigorous content that meets national science standards.

A multidisciplinary team comprised of designers across interaction, communication, environments, games, and software partnered with Verizon to bring the Verizon Explorer Lab to life.

The Verizon Explorer Lab is equipped with dozens of screens and tablets displaying Hollywood-quality video and special effects, and the educational content is both scientist and teacher-approved.

To keep the student at the center of the experience, the team designed alongside kids. Their gravitation toward play, interaction, and technology inspired the digital game that students play onboard the bus. When developing the game’s narrative, the designers turned to popular kids’ books and movies. What began as a card game prototype eventually became a 360-degree video and virtual reality expedition to Mars—complete with a custom musical score—that introduces middle schoolers to engineering basics.

After stepping through the bus doors and taking a tour of the solar system, Mr. Gordon’s students receive an emergency call from NASA: They must rescue the missing Curiosity rover, which is dedicated to collecting evidence of life on Mars. Eager to save Curiosity, the students become immersed in the adventure at hand. And through the adventure, they become immersed in science.

Students use tablets to design their own Mars rover. Each rover appears on a large screen and traverses the planet’s extreme terrain. The goal is to collect data that suggests life on Mars, including ice deposits, photos, and more. Students iterate on their rover’s design—wheels, power sources, and sensors—to test if it can stand up against dust storms and craters. The team consulted a NASA planetary scientist to ensure accuracy, as well as educators to establish cohesion with classroom curricula.

Using their own tablet, students iterate on their rover design to help it collect as many samples from Mars’ surface as possible. The team consulted a Martian scientist to ensure every game element—from the rover wheels to the types of sediment on Mars—was accurate.

During the game, students are encouraged to compare designs and learn from each other: One rover may be able to travel long distances and take various photos, while another can carry large quantities of ice and sediment samples but can’t go far because of its size. At the end of the mission, the group finds Curiosity and sends all of the evidence they’ve collectively gathered back to NASA to aid the search for life beyond Earth. Before departing the bus, students watch an animated video that explains various jobs in STEM and encourages kids to pursue one of these careers.

Iterating on their rover’s features teaches students the engineering design loop. With over 200 possible rover designs, students can learn from each other’s creations and collaborate to collectively gather as much data as possible.

The Verizon Explorer Lab teaches students the engineering design loop, the value of collaboration and teamwork, and what a career in STEM might look like. The mission to Mars game is just one of many potential STEM learning opportunities for students and integrated, customizable learning modules for teachers.

Since launch, the Verizon Explorer Lab has traveled to various parts of the United States and reached thousands of kids. It continues to be managed by Learning Undefeated, Verizon’s nonprofit partner. By designing for and with students, it’s possible to create educational experiences that facilitate meaningful learning and genuine fun. The Verizon Explorer Lab represents progress towards a more inclusive future for employers and the STEM field.

Verizon
Verizon
Creating an out-of-this-world STEM learning experience, Verizon, education innovation, learning experience, future of work, public sector innovation, government services, civic innovation, student experience, future of education, innovation, research, prototyping, transformation, education, learning, government

An Artist’s Love Affair with Cute Patterns

Austin Salmi makes a habit of frequenting tiki bars and drawing clean patterns

Read more
Article
Articles

In one sentence, who are you?

I am an illustrator who enjoys bringing any amount of joy to people through my creations.

What do you do? How did you learn how to do it?

I create different drawings using pencil and ink. The illustrations range from patterns to caricatures, unique creatures, and other one-off ideas. I grew up sketching and doodling and it has continued. When I moved to LA, I was suddenly surrounded by an amazing cadre of artists and creators who constantly inspire me, as well as push me to keep improving myself. That is how I learned my craft and continue to learn, because I believe you never truly finish learning.

What are your 3 favorite possessions?

Miniature Back to the Future 2 hover board; Magnum P.I. Tiki Mug; a drawing of my fiancé and me, which she drew. Not in that order.

What does a typical work session look like?

I have a running list of ideas and sketches that I pull from if I don't have an art show with a specific topic that I am working towards. Usually, I'll do some Google searches on the topic at hand and pull a bunch of reference photos for perusal during the pencil drawing stage. I sketch out the drawing inside a pre-drawn area, such as 4x6 or 5x7. Art that is easy to frame is always a goal of mine, because I love framed art and it drives me mad when I see things tacked onto a wall or cork board. After finalizing the pencil drawing, I'll usually step away for a moment or two to play a video game or watch a show. I like to do something that differentiates the time between stages. Once I come back to the drawing, I pull out all the different micron pens that I think I will use for the piece. I check the nibs, and then I begin inking. I put on dramas in the background to listen to, or things I've seen a ridiculous number of times. West Wing and Parks and Recreation are two such shows.

I don't like to start inking unless I am going to finish a drawing that night. Sometimes, a piece is too large, and I have to break it up over two nights. If that happens, I make sure the pens I've used on the previous night are away from all my other pens. I do this to achieve a consistency within the lines. Once finished, I scan the piece, put it within a predetermined frame, and pack it up for a craft fair or deliver it if it's for an art show. Rinse and repeat as necessary.

How do you get over creative block?

I used to stop drawing and just stew for a bit until it finally passed, which could take a bit of time. As I've gotten older, and ever so slightly more confident in my abilities, I push through it. I just keep drawing. Yes, sometimes the drawings are awful, but as Lauren (my future wife) always says, "sometimes you just have to pass a rat."

How do you see the world in 2078?

A lazy utopia, filled with autonomous everything. Humanity will have moved past Earth and outward into the stars while robots cater to our every whim and we become fat and happy. I could be confusing my vision of the world in 2078 with the timeline in Wall-E—who doesn't yearn for the saccharine dreams of Pixar in 2017. It is tough to image the future right now because at this moment it feels as though we are hanging by a loose wire, and any minute now someone with a spray tan is going to cut the wire and tell us all how huge his ratings are, as we all fall to our collective doom. I hope we make it to 2078, if only so that I can enjoy my hover chair and 128-ounce Slurpee.

What’s number one on your bucket list?

I should say something epic like bungee jumping off of Thomas Jefferson's nose on Mount Rushmore, but honestly, I'd like to have my own artist's studio. Some place I could retreat to and tune out the world and draw silly pictures. That to me is something I want to do before I fade out of this existence.

Who are you creative crushin’ on lately?

I've had a one-sided love affair with Dustin Harbin for a long time. I own two of his original pieces and his diary comics book. The man can use an ink nib like Aaron Sorkin can turn a phrase.


I’ve been creative crushing on Austin Salmi since I saw his doodles, patterns, and adorable characters on Instagram almost two years ago. Austin’s work, learned through practice and osmosis in his job surrounded by artists, has a giggly character about it that fits his intention to hide the ugliness of the world for a moment, and make lovely order out of chaos. I got to learn a bit more about him and his process in this installment of Creative Crushes.

No items found.
an artist's love affair with cute patterns, social media, digital experience, storytelling

AI Needs an Ethical Compass. This Tool Can Help.

A new, downloadable set of cards for designing with data

Read more
Article
Articles

We had just begun work on a project exploring how we might help a medical-liability insurance company increase patient safety by learning from past incidents. As we talked, our conversation shifted away from excitedly imagining ideas for data-driven tools toward ways our work might potentially do harm.

What if our designs ended up raising premiums for doctors and, in turn, healthcare costs for patients? What if they kicked doctors off their insurance? What if doctors stopped reporting adverse events to keep their premiums from rising? There was real potential that our work could result in reduced patient safety or increased cost of care. We could inadvertently build a tool that could be used against the very people we were trying to help.

Today, data systems and algorithms can be deployed at unprecedented scale and speed—and unintended consequences will affect people with that same scale and speed. How can we always make sure we’re putting people first when designing large scale systems? Especially when those systems will change over time and evolve without direct human supervision?

The seed planted during that bar conversation has grown into a set of principles, activities, and now a set of cards that our teams—both data scientists and designers across every other discipline—use to ensure we’re intentionally designing intelligent systems in service of people.

We’re far from the first people to ponder this. We’ve been inspired by organizations like AI Now and Data + Society, books like Weapons of Math Destruction and Technically Wrong, academic communities like FATML and CXI. In particular, we’ve been eagerly following O’Reilly’s series on data ethics (and encourage you to read their free ebook, Ethics and Data Science).

To develop our own set of guiding principles, we started with people. We talked to folks all across the globe: We interviewed IDEO teams about where they found challenges. We spoke to our clients about where they saw intelligent systems go awry. We spoke to the public about where smart designs seemed to cross lines. We observed and read about AI systems that had gone off the rails and worked to understand how this might have been avoided. We learned a lot.

We came up with an original design, iterated on them, and landed on a set of four design principles and ten activities that can help guide an ethically responsible, culturally considerate, and humanistic approach to designing with data. These activities are meant to provoke thought; they’re a vehicle for introducing new ideas and stimulating conversations around ethics throughout the design process.

To start, here are our principles:

1. Data is not truth

Data is human-driven. Humans create, generate, collect, capture, and extend data. The results are often incomplete, and the process of analyzing them can be messy. Data can be biased through what is included or excluded, how it is interpreted, and how it is presented. Unpacking the human influence on data is essential to understanding how it can best serve our needs.

2. Don’t presume the desirability of AI

Just because AI can do something doesn’t mean that it should. When AI is incorporated into a design, designers should continually pay attention to whether people’s needs are changing, or an AI’s behavior is changing.

3. Respect privacy and the collective good

While there are policies and laws that shape the governance, collection, and use of data, we must hold ourselves to a higher standard than “will we get sued?” Consider design, governance of data use for new purposes, and communication of how people’s data will be used.

4. Unintended consequences of AI are opportunities for design

Just as with any design endeavor, we know that we’re not going to get it right the first time. Use unanticipated consequences and new unknowns as starting points for iteration.

To get started with the activities, you can download the cards here. We hope that these activities provoke dialogue and provide concrete tools to help our community ethically design intelligent systems.

Thank you to the larger team who helped make these cards come to life—Ben Healy, Jane Fulton Suri, Jess Freaner, Mike Stringer, Justin Massa, Connie Oh, and KP Gupta, who designed them.

A design researcher, a business designer, and a data scientist were sitting at a bar. It sounds like the setup of a joke, but the conversation was actually quite serious.

Technology
AI & Emerging Tech
ai needs an ethical compass this tool can help, technology, digital innovation, ai, emerging technology, artificial intelligence, ai strategy, user research, research, design tools, design methods

No Beards Allowed: Exploring Bias in Facial Recognition AI

How a creative code experiment helped people understand the pros and cons of artificial intelligence

Read more
Article
Articles

As a user experience and interaction designer with a hybrid art and tech background, I’ve long been a fan of the concept of using art and design as a Trojan horse to make tricky concepts accessible. Through intrigue, curiosity, and play, these experiences can bypass our biases and open the door to understanding, without requiring deep comprehension. If you’ve ever visited a children’s science museum and watched kids excitedly engaging with subjects that would bore them to tears in book form, then you’ve seen the power of experience and play at work.

Meet ERNEST

That’s why my colleagues and I created ERNEST, an installation that gives the viewer the job of training a rudimentary artificial intelligence. Using facial and emotional recognition tech, ERNEST shows the user imagery and tries to see how happy it makes them. Our goal for this project was to engage users in a game-like experience to help them understand how machine learning models are trained, and subtly hint at the areas where bias could creep in.

Fellow IDEOer Matt Visco and I wanted to make sure ERNEST didn’t look like a modern computer—we designed it to look vintage. With its old hardware and nostalgic graphics, ERNEST doesn’t feel smart on the surface. Its look is meant to evoke a time when computers carried the promise of a utopian future, prior to mass connectivity and the ubiquitous collection of personal data.

The full installation uses five monitors, two computers, and three Raspberry Pis, which power several video loops that reveal the training data behind ERNEST, and give passersby a sense of the experience even if they don’t engage directly with it.

How it Works

ERNEST uses computer vision to perceive the user ambiently through facial recognition, allowing it to detect when a user is looking at it and how far away they are. When a user gets close enough, ERNEST comes alive and asks the user to help it learn. It then shows the viewer images intended to make the user happy, and gauges their emotional reaction based on their facial expression using a pre-trained model. The facial tracking and emotional data is displayed to the viewer in real time, encouraging users to make faces at ERNEST. Viewers can then validate the accuracy of the model to help ERNEST know if it was correct or not.

(Sound complicated? The video below might make it clearer.)

We installed ERNEST in IDEO San Francisco’s lobby for a couple of months, and also brought it to the San Francisco Art Institute Fort Mason Gallery for the CODAME Intersections exhibition in November 2018.

The Results

Many participants loved to challenge ERNEST, often emoting in varying ways through numerous loops of the game. Once, a group of participants spent nearly 20 minutes playing with ERNEST, takings turns to compare how it perceived each person.

When viewers interact and play with ERNEST, we’re helping them see that machines can have almost human-like perception, reacting differently to different faces, and sometimes being uncannily accurate...or completely wrong. The wrong guesses were in many cases more interesting, and were in fact a very intentional part of the design. We wanted users to see that artificial intelligence is sometimes not as intelligent as we might think.

ERNEST is meant to be a game, but what happens when real-world AI makes the wrong guesses? Or what if those wrong guesses are uneven, indicating an unintentional bias, such as working well for some faces but not others?

IDEOer Ian G., who with his trademark beard, glasses, and cap was almost never properly recognized by ERNEST

We wanted people to realize that designing systems that can ambiently perceive humans without direct input is rife with ethical concerns. And already, systems like these are being deployed at scale. The Guardian predicts emotionally-aware tech is already a $20B industry. Even something seemingly benign like ERNEST causes us to wonder—if an AI is trying to make the viewer happy, who determines what “happy” is? What if bad actors train Ernest to think that disturbing content is “happy?” What if the technology is repurposed to provoke anxiety or anger? What happens if we deploy technology like ERNEST widely?

Of course, ERNEST only scratches the surface of these big ethical questions, but we hope that it helps give people insight into how artificial intelligence thinks, and the ways its thinking can be flawed. The more that we as a society can start to understand these systems, the better we can judge their quality, and work to design them to be in line with our shared human values.

Artificial intelligence and machine learning are among the hottest topics of the tech world, but some of us at the frontier forget that many people feel intimidated—or even afraid of—these technologies. The pop-culture trope of machine intelligence gone rogue has been a part of our cultural psyche for a good 150 years. Think 2001: A Space Odyssey’s HAL 9000, The Terminator’s Skynet, and The Matrix’s... Matrix. Combine that fear with arcane tech-speak like “recurrent neural network” and “generative adversarial network,” and in addition to feeling emotionally intimidating, AI and ML can also feel incomprehensible.

Technology
AI & Emerging Tech
no beards allowed exploring bias in facial recognition ai, no beards allowed, exploring bias in facial recognition ai, technology, digital innovation, ai, emerging technology, artificial intelligence, ai strategy, experimentation, testing new ideas, learning, coding

How to Make Hard Feedback Pay Off

It's not easy to have your work ripped apart, but it's essential to the creative process. Here's how to make it less hard.

Read more
Article
Articles

Feedback is a tricky thing. There’s always going to be differing opinions of right and wrong, and even if it’s explained to you in a calm, clear voice, it can sting like nothing else. But getting feedback on your work is the only way you'll grow. It forces you to rationalize your thinking and creative decision-making, and teaches you to swallow your pride.

I learned the hard way: A few years ago, I designed my first typeface called Emotiv. It was a concept for a messaging app that would help people express their emotions through language (instead of emojis).

Eager to get my work out there, I decided to send a sample to a very well-respected typographer whose work I greatly admired. Given this individual’s reputation (and my lack of experience) I was reluctant to share at first, but with encouragement from friends, I sent it along with an explanation of how it came to be, not really expecting a response.

A few days passed, and much to my surprise, an incredibly lengthy reply fell into my inbox and hit me like a ton of bricks. It was the toughest feedback I’d ever received. Alignment issues, inconsistencies, readability problems, the email went on and on. It felt like my career was ending before it even had a chance to begin. We designers consider our creations extensions of ourselves—meaning that we take the pain of feedback personally.

While I can't offer up permanent thick skin, I have come up with 4 mindset shifts that will help you get—and give—negative feedback in a constructive way:

1. Introduce constraints

The least helpful feedback goes something like, “Hmmm, I’m not sure I like this.” We all have personal tastes, but there is no build-off point from that—no way to develop and improve. Instead, ask the person giving you feedback to be constructive, give their rationale, and ask as many questions as they’d like, rather than give you a gut reaction.

2. Tag team

Rather than putting yourself on the receiving end, get involved in the process. Imagine that the work being critiqued isn’t yours and offer your own thoughts. That will help you stay focused on the work itself. Plus, by making the feedback process more of a collaborative effort, you can understand the work from new angles to make it better together.

3. Be Spock

Do your best to take your emotions out of the equation. Instead of hanging on every negative word, look for unbiased points that will help you better define and execute the work. Even if the person giving you feedback is using words like “I like...”, or “I don’t like…”, those words aren’t aimed at you—they’re aimed at uncovering the fundamental thinking or execution behind the work.

4. Don’t ask for the answer

When the feedback process unearths a problem with your work, it’s tempting to simply ask for a clear solution to the problem. But that won’t push you to go further and explore other possibilities. Solving the problem yourself gives you another opportunity to learn and grow your skills.

Looking back, I now see now that the typographer who crushed me was actually providing a great service. (Honestly, you could tell someone they are terrible at something in considerably fewer words.)

I’d made the same mistake my fellow design student had made in that first class—I reacted as if it was a personal attack on me as a designer. But that feedback prodded me to become much more critical about my own work, studying details that others might not notice, with an eye toward readability and alignment.

Getting negative feedback can hurt. You pour your time and effort into creating something, and with the swiftest of comments, it gets cut down. But receiving it not only makes your work better, it makes you better... especially at giving feedback.

Nothing prepares you for the reality of receiving negative feedback. In one of my first design classes, I watched in horror as a fellow student had his work ripped in two for the first time in front of all of us. Shortly afterwards, he quit the course.

No items found.
how to make hard feedback pay off, creativity, education, learning, feedback, creative feedback, team collaboration

Lindsey Turner

I’m passionate about building brands, products, and experiences that help organizations show up with meaning and momentum.

Read more
Leader
Leaders

I help organizations cut through complexity by shaping how they show up, through brand strategy, identity, and storytelling.

Working at the intersection of brand and business, I bring an editorial eye and a bias toward making—turning ideas into tangible experiences that people can understand, trust, and believe in.

My work spans government, healthcare, financial services, media, and consumer goods, from launching Gen Z-focused ventures to building innovation labs and reimagining legacy brands. I relish moments of ambiguity and enjoy translating across teams, perspectives, and priorities to move ideas forward.

I started my career in editorial and digital design, shaping cross-platform experiences and identity systems in publishing and agency environments. That foundation still shapes how I work today: I’m detail-oriented, collaborative, and overreliant on the Oxford comma. I hold a BFA in Visual Communication from the School of the Art Institute of Chicago.

My tween twins teach me more about technology and gen-alpha than the last decade of trend reports.
Making things that matter
Consumer Products & Retail
Media & Entertainment
AI & Emerging Tech

Rachel Young

My work helps organizations see who their products aren't working for—and build the will and the tools to do something about it

Read more
Leader
Leaders
For 25 years, I've asked the same question: Who does this design exclude—and what are we going to do about it?

My work spans human-centered strategy, inclusive design, and qualitative research, with clients ranging from Microsoft, Google, and Verizon to the National Science Foundation, and San Francisco Unified School District.

Before IDEO, I taught elementary school in East Palo Alto and spent a decade doing design work with social service organizations—where I learned firsthand what it costs people when systems are built without them in mind.

I am currently writing User Error, a nonfiction book about digital access and the design decisions behind it. I live in Oakland, California.

The greatest project to which I’ve ever contributed is raising my two daughters with my husband.
Uncovering unmet needs
Consumer Products & Retail
Learning & Work
Media & Entertainment
Play
Public Sector

Brian Pelsoh

I lead with craft, ensuring our work is creatively excellent: rooted in deep human insight and imagination, while also grounded in the realities of business and technology.

Read more
Leader
Leaders

My expertise spans brand, communication, and product design across tech, education, the arts, and social impact.

I believe great work demands both high-level vision and obsessive attention to detail, and only happens through collaboration.

I bring an inclusive, hands-on approach and a deep understanding of business, which enables me to consistently deliver excellence while always asking why.

Before joining IDEO, I worked at the brand firms Pentagram and VSA Partners. I began my career as a designer, leading teams at the School of the Art Institute of Chicago and the Milwaukee Art Museum. I hold an MFA in graphic design from Maryland Institute College of Art and a BFA in communication design from the Milwaukee Institute of Art & Design, and have taught at some of the best design schools in the US.

I love a good crit.
An inclusive, hands-on approach
Health
Learning & Work
Media & Entertainment
Public Sector
AI & Emerging Tech

Tony Wong

I am responsible for IDEO’s long-term success in China and working with clients to use design as a tool to enable growth.

Read more
Leader
Leaders

I am responsible for IDEO’s long-term success in China and working with clients to use design as a tool to enable growth. Specifically, I have helped Chinese companies design holistic brand solutions through the development of their products, communication, services, and innovation teams, and I have helped multinationals expand their presence and influence in China.

I advise global leaders on developing China-led innovation and capabilities.

In over 15 years in IDEO Shanghai, I have worked on projects that use design to elevate the quality of the experience of healthcare products and services, streamline processes that increase productivity, create spaces and programs that promote and enable inclusive communities, and build next generation mobility solutions that are planet-positive.

Before joining IDEO, I worked at Philips Electronics and the Electrolux Group in Italy, the Netherlands, and Singapore on a number of breakthrough commercial products. I am a member of the Young President Organization in Shanghai.

I have a thing for antique maps.
Developing China-led innovation and capabilities'
Consumer Products & Retail
Food
Learning & Work
Industrial & Manufacturing
Episode image

Building a personal AI for the messiness of life: Sida Li

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

Listen
Podcast
Podcasts

Most AI products today are built for work—a space with clear problems and established systems. One founder noticed a gap: personal life is messier, harder to systematize, and mostly left behind by the AI boom. So she built Cue, a personal AI that lives inside iMessage and group chats, to go where the other tools haven't.

In this episode, Becca Carroll, IDEO's Chief Strategy Officer, talks with Sida Li, co-founder and CEO of Shared Context Lab, about staying anchored to a human need while the technology around her keeps changing shape, why she treats her business model with the same rigor she'd bring to a product, and what it feels like to build a company at this particular, disorienting moment in AI.

The conversation also gets into how Sida makes design decisions: the language Cue uses to describe itself, the tradeoffs behind building inside iMessage instead of a new app, and a real story about a business idea that didn’t pan out.

This is the second in a two-part series profiling founders from IDEO's Startups-in-Residence program. The first conversation is with Johannes Seemann, founder of Sooner, on designing GenAI for the emotional side of money.

Health
AI & Emerging Tech
Technology
Learning & Work
Episode image

Designing GenAI for the emotional side of money: Johannes Seemann

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

Listen
Podcast
Podcasts

Most personal financial tools are built to run the numbers and optimize towards a budget. While that works for some, most people experience money as a lived relationship that does not neatly fit into a spreadsheet. Johannes Seemann and Becca Carroll discuss why money is emotional before it is mathematical, and what a human-centered approach to building a generative AI financial product looks like in practice.

Health
AI & Emerging Tech
Technology
Financial Services
Learning & Work
Episode image

The curious leader's edge in uncertainty: Scott Shigeoka

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

Listen
Podcast
Podcasts

Mina Seetharaman talks with Scott Shigeoka, author of Seek and Head of Curiosity Cultivation at the Eames Institute, about what distinguishes genuinely curious leadership from performative curiosity, how power dynamics shape curiosity, and why practicing curiosity can restore energy rather than drain it.

Learning & Work
Episode image

How constraints make us more creative: David Epstein

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

Listen
Podcast
Podcasts

Mina Seetharaman talks with David Epstein, author of Inside the Box and Range, about why total freedom often produces average work, how leaders can design useful limits on purpose, and what organizations such as General Magic and Pixar reveal about the relationship between boundaries and creativity.

Learning & Work
Nothing’s coming to mind.

Looks like you might be in search of something very specific?

Feel free to drop us a note and we’ll happily help you find what you’re looking for.

Or reset the filters above and try another angle.

If you’d rather just chat than scroll through our site, we’d love to hear from you.

Feel free to include any details or anecdotes about what brought you here today, it will help make sure we get you connected to the best person right away.