

Designing a better onboarding experience for an AI symptom checker at clinics
Enabling doctors to spend less time on paperwork and more on patient care.
D4V is a Tokyo-based early stage Venture Capital in partnership with IDEO. Two years ago, D4V invested in healthcare startup Ubie, which develops a service called AI Monshin Ubie. The digital service was created with the goal of reducing the burden on healthcare professionals working long hours, under harsh conditions. AI Monshin Ubie automates a number of patient registration and documentation processes through digital tools, enabling doctors to spend less of their time on manual paperwork, and to dedicate their valuable skills and attention to the patients themselves. Currently, the service is installed in 200 medical institutions in 41 prefectures across Japan.
With AI Monshin Ubie, patients fill out preliminary forms on a tablet, rather than paper, entering information about their health history and current symptoms directly into their digital medical record. As patients fill out the questionnaire, the Ubie AI generates questions in real-time according to patients’ responses, which results in more appropriate and accurate data. The patient’s responses are automatically formatted for the doctor to review prior to and during the consultation. As a result, doctor consultation times and facility operation times are drastically reduced.
With the Coronavirus raising fears of a possible health system breakdown, Ubie has made improvements to anticipate and possibly prevent in-hospital infections. Until recently, Ubie’s services have been primarily used by large hospitals; but in light of the global health crisis, Ubie approached D4V—who partners with IDEO—to help rethink the onboarding experience and quickly facilitate the introduction of AI Monshin Ubie in regional clinics across Japan. D4V and IDEO have been working with Ubie for many years to collaborate in various areas, including UX, rebranding, international research, and more. Therefore, they had a foundation of knowledge from which to build these new features.
Typically, AI Monshin Ubie has been introduced to new hospital clients through direct, in-depth instructional visits from Ubie sales staff. This approach has worked well for rolling out the product to Japan’s 8,000 large hospitals; but for the 100,000 smaller clinics, Ubie needed a more efficient onboarding method to enable staff to get set up smoothly and independently.
During research, D4V and IDEO team members engaged with many different clinic staff members, including full-time doctors, part-time doctors, nurses and receptionists. The researchers found that staff tend to react skeptically to new tools and services, with a common preconception that they will add to their workload. One clinic director’s first impression of AI Monshin Ubie was, “It looks complicated.” But once he actually used the service, he realized that it was very user-friendly.
The team quickly understood that it was important to remove preconceptions by clearly communicating Ubie’s benefits and ease of use. They created a two-minute animation and designed three separate guidebooks. The animation adopted a friendly tone and expressed empathy for doctors, staff members and patients, highlighting how Ubie can bring benefits to each of them. The animation showed how Ubie fits into the existing workflow and explained complex systems in a straightforward and accessible way.
WATCH: A short video clip explains the benefit of their product and service to avoid the users’ concerns in advance.
The guidebook for doctors and directors explains how Ubie’s AI smooths the patient consultation experience and greatly improves the quality of medical care. It also introduces concrete how-tos around set-up, implementation, and ideal workflow. FAQs were also included, addressing concerns about whether or not elderly people would be able to use it.
Ubie business development leader Kenji Yamada says, “D4V and IDEO have a deep understanding not only of design, but of our entire business. They provide inspiration by bringing experience and knowledge that comes from working with other industries and clients outside of healthcare. We appreciate that they can share the knowledge that they’ve obtained with our business.”


Read the Japanese-language version of the Ubie case study here.
When You Feel Unwell, Ask Ubie: Check your symptoms for free
Learn more about Ubie: Global Company Website


An improved airway intubation system that helps physicians save more lives
The GlideScope Core offers elevated visibility and a seamless workflow for intubation, allowing doctors to better conduct routine procedures and respond to health crises.
In the emergency room, an intervention that’s administered too slowly could cost a patient their life. With COVID-19 fueling a surge in acute respiratory conditions, intubation—a procedure that involves inserting a tube through the mouth or nose and into the airway—is more common than ever. For patients struggling to breathe, the tube can be connected to a ventilator that pumps oxygen to the lungs, keeping them alive.
While a laser-focus on the present is critical for successful patient outcomes, hospitals and physicians often don’t have time to look ahead and anticipate the future of the operating room experience. As technology rapidly improves, there is a ripe opportunity and pressing need to evolve medical equipment to be more innovative and intuitive. Verathon Medical, a global medical device manufacturer, is supporting health care providers at the cutting-edge of care.
Verathon approached IDEO to redesign the existing product system for laryngoscopies and bronchoscopies—procedures that examine parts of the throat through intubation. During these examinations, a tube with a camera embedded in the tip is inserted through the patient’s nose or mouth. The doctor can then see inside the throat on a video monitor, and therefore more easily and quickly intubate and perform the exam.
To create a groundbreaking device, the team observed over a dozen laryngoscopies, bronchoscopies, and intubations. They noticed that many anesthesiologists relied on fixed equipment during the procedures. For example, some had grown accustomed to looking over their shoulder—away from the patient—to view the monitor.
During interviews, physicians and residents expressed difficulties with the current technology, sharing that the small screens aren’t conducive to team viewing or student instruction, and they must often use a separate computer to record patient notes. Others reported frustrating workflows, needing to constantly divert their attention and move their hands between the patient, prep tray, monitor, sterile bin, and disposal bin. These inconveniences and inefficiencies are not only cumbersome, but can increase the risk of infection and fatality.
The team relied on these insights to start designing a next-generation product. Through sketching, storyboarding, and building in real-time alongside doctors and clinic staff, designers quickly teased out additional findings and validated concepts.
This work led to the creation of the GlideScope Core: an all-in-one, portable product system that supports both video laryngoscopies and bronchoscopies. The base of the device—a wheeled cart—has built-in storage units for tools and a disposal bin, offering more mobility and accessibility for medical professionals.

The product’s tagline, “see more, do more,” points to the improvements made to the video system, including a large 10- or 15-inch high-definition touch screen monitor. Displayed images can be enlarged and rotated 180 degrees for improved visualization, team viewing, resident training, and classroom demonstration. To help doctors keep both the patient and monitor in their line of sight, the detachable screen can be secured to an adjustable arm that can be positioned directly over the patient. Additionally, the monitor’s patient annotation feature gives staff access to more of what they need in one device.
The product has been especially valuable for providers and patients during the coronavirus pandemic, when it’s imperative for doctors to keep their distance from patients’ mouths and noses. The GlideScope Core’s movable, detachable, and large, high-definition monitor makes it easier to take this precaution and intubate more quickly. This usefulness is reflected in the 5-fold increase in cart-based device orders for Verathon. While most providers typically order anywhere from 1 to 20 devices for airway procedures, one hospital system requested 600 GlideScope Core systems to meet current intubation demands.
Through modern technology and a focus on human needs, the GlideScope Core supports improved patient outcomes and creates a more seamless operating experience for medical professionals. The product underlines the key but often overlooked fact that often, in order to ensure the healthcare industry is patient-centered, medical device manufacturers and hospitals must also focus on improving the experience of providers.


Transforming a community hospital from the inside out
Designing for caregivers to create world-class care for patients.
Healthcare is notoriously difficult to change. Rules and regulations present complex barriers; health practitioners and organizations often have entrenched ways of working; and lives are literally on the line. Despite these significant barriers, the leaders at Newton-Wellesley Hospital (NWH) boldly committed to improving patient care through a new approach.
NWH is a community teaching medical center in Newton, Massachusetts. Because of its proximity to Boston—a city known for world-class healthcare institutions—NWH needed to differentiate itself. The hospital's new president, Dr. Michael R. Jaff, reached out to IDEO for help: "I knew that providing an unparalleled patient experience would set us apart from our competitors." But, Dr. Jaff’s particular approach was unique. He and Dr. Jodi Larson, Chief Quality and Experience Offer (CQXO), saw an opportunity to drive better patient outcomes through cultural and organizational change.
"You cannot learn any more than when you get to listen to your potential patients say why they would never walk into your place." —Dr. Michael R. Jaff
IDEO partnered with NWH for a year of work together, kicked off by defining the vision for NWH and ramping up to in-hospital prototyping and the launch of several new initiatives. A pilot project with the Women's Imaging Center (WIC) focused on solving departmental and employee challenges to provide a better experience for women getting mammograms.

Fueled by this potential, the WIC team redesigned key work processes and created a set of experience principles that inspired new service prototypes. Guided by principles like "Express mutual gratitude" and "Honor every voice," the WIC team tested ways for patients to acknowledge outstanding caregivers and created tools to gather better feedback from patients and adjust quickly. The experience of designing better services inspired the WIC staff to become ambassadors for the power of design thinking across other departments inside NWH and they continue to build on the work through new prototypes and experiments.
Next, IDEO partnered with NWH’s ambulatory surgery group. They took an analogous research trip to Boston’s Logan airport to see with fresh eyes how other high-touch customer service organizations provide customer value in a complex setting. Insights from the trip were applied through live prototyping of several new experiences inside the hospital, including a pre-surgery visit summary and pre-operation care carts.
Analogous research helped us realize that we can learn from other industries and incorporate some (cool) best practices if we allow ourselves to get over the ‘that would never work in the hospital’ mentality. - Dr. Jodi Larson

One of the most impactful prototypes was Care Modes, a tool to empower the NWH care teams to tailor their approach and interaction with patients based on the patients’ unique needs, beyond simply their clinical requirements. Four distinct approaches were identified for engaging a patient before surgery—Explain, Partner, Embrace, and Encourage. The Care Mode is determined based on the provider's understanding of a patient's degree of self-advocacy and their confidence that surgery is the best solution to their issue.

Historically, care providers have been trained to deliver consistent care above all else. However, Care Modes powerfully acknowledge that patients respond differently to different types of care. The Care Modes empower the team—from surgeon to nurse to anesthesiologist—with a clear framework for how to interact with and provide care for patients so they feel most comfortable. Based on the prototype's success with patients and impact on the staff culture, NWH has incorporated Care Modes into EPIC, the hospital's electronic medical record.
The importance of being patient-centered has been central to the healthcare conversation over the past thirty years; but new explorations reveal that there’s far more potential for innovation and improvement when the provider experience is considered in tandem with the patient’s. Each enables the other, and design for both together yields stronger solutions and better outcomes. IDEO's work with NWH demonstrates this vital shift in user-centered healthcare—one can't design services and experiences for patients without designing for their providers’ culture as well. When these go hand-in-hand, meaningful institutional change in healthcare is more than possible.


Helping a historic museum prepare for the future
Using design thinking to improve access, experience, and culture.
The mission of Chicago's Museum of Science and Industry (MSI) is to inspire children to achieve their full potential in the fields of science, technology, medicine, and engineering. Leaders at MSI realized they needed to drive day-to-day operations and maintain historic exhibits while focusing on where to go next. To prepare for its next decade, MSI worked with IDEO to create a new business focus to support the museum’s aspirations for the future. The plan would allow MSI to respond to the demands of the marketplace and raise the funds to get there.
At the beginning of the project, MSI laid out its priorities: improve equity of access, enhance the museum experience, and create a more innovative culture. To dive into each of these areas, IDEO conducted immersive research with families, teachers, donors, and staff.

IDEO brought together 60-plus donors, board members, and staff members to engage in a design thinking exercise to unpack and address the tensions that come with choosing a new strategic trajectory. Instead of having a standard ballot vote, the IDEO team encouraged participants to get up and vote with their feet, helping the group of stakeholders physically align on the museum’s new direction.
At the end of the research and prototyping phases, MSI and IDEO developed a vision called Provoking Minds, Inspiring Futures, creating six detailed design briefs to equip MSI teams to bring initiatives forward. The briefs laid out everything from recommending a new Department of Next, dedicated to ensuring that the future is at the heart of everything the MSI does, to MSI Runway, a place for experimental, small-scale, and limited-run exhibits. The ideas were brought to life with an interactive exhibit, built quickly with everyday materials like plywood and circuit boards, to demonstrate that creating an inspiring vision of the future doesn’t have to be an expensive endeavor.
The team also focused on insights that highlighted accessibility issues some families brought up early in the design process—travel across the city via public transportation can be lengthy, and the cost of admission to special exhibits could be prohibitive. To address these concerns, IDEO came up with the Mission Accessible brief: Inspired by casino buses, MSI bus stop signs would be posted in various low-income neighborhoods, signaling a way to take kids and families to the museum for free.

During the project, the IDEO team identified some low-hanging fruit, like rethinking ticketing and improving the student field trip experience, and helped the museum create cross-functional innovation teams to apply design thinking skills towards solving those challenges. They researched, brainstormed, and pushed forward new concepts, meeting weekly to share and build on ideas. At the end of the four week period, each team prototyped their ideas—new outdoor programming, software tools for visiting tour groups—and pitched them to each other.
In 2019, two years after the conclusion of the project, the collaboration paid off. With its new strategic plan and additional resources, the museum has renewed its commitment to serving youth, and MSI’s team, including donors, are aligned on a collective vision of the future. MSI raised more funds than in any previous year, including the single largest gift in its history—$125 million, nearly half of its $380 million fundraising goal—that will help ensure the years ahead.


How to motivate a team to pull off the impossible
These life-size origami installations are built by creative leaders at IDEO
As soon as the rain stopped, we got on our bikes to survey the damage. We saw the flowers on the horizon: droopy and sad-looking. Then, suddenly, they started illuminating, one after the other—opening up, blooming. To this day, we still don’t know how they came to life. But the sight was exactly what we had envisioned. Better even.

That was 2014: the official start of FoldHaus Art Collective. Since then, our art installations have become bigger and more audacious. Shrumen Lumen, five massive, origami mushrooms, followed in 2016 (they’re now on exhibit at the Smithsonian American Art Museum), and we most recently built a five-story tall, geodesic sphere covered with 42 origami shells called RadiaLumia.
Each project takes months to design, prototype, and build. Which means I often get asked: Why do you spend your nights and weekends doing this when you have a fulfilling day job as a creative leader?
For me, it means that I get to work with a bunch of other creative types who pitch in to build something beautiful that’s bigger than what any one of us could do on our own. I get to work with my hands in a way that’s rare in my day job, and every project stretches my own sense of what’s possible.
And because FoldHaus projects are always a group effort, we need to broaden the question: Why do any of us—between five and 30 volunteers contribute to our projects on any given weekend—give up sleeping in to solder? Or skip the beach to code LED patterns? As one of the leaders of the group, I have learned a few things about what it takes to build a strong community and take a bold vision from a Post-it to the Playa.
Here are the 5 principles that have helped this team pull off increasingly ambitious projects:

1. Set an audacious—and contagious—vision
Drawing in a team requires not only that you love your idea, but that others do, too. After all, if you’re asking them to volunteer their time, they’ve got to be pulled in week after week, when they could easily be at the taco truck.
Blumen Lumen was a hit because everybody loves flowers. With the Shrumen Lumen, it took some convincing—many worried about associations with 'shrooms at Burning Man. This year, I made sure to test out the RadiaLumia concept with a few key members of the team, so I knew I had broad support. The buy-in worked, and has yielded our biggest team of volunteers by far.
The bottom line: Pressure-test your idea early—before you get too attached to it—so others will want to join up and help you realize the vision.
2. Stand on your own shoulders
Leading people to a grand vision is impressive only if you can actually pull it off. Ladder up from where you (and your team) actually are to where you want to go. And, acknowledge that it may not all happen at once.
Even before our Blumen Lumen, we built three shade structures for Burning Man. One was a disaster, but we learned from it. Now, we ensure that we are leveraging all we mastered the previous year to create the next installation. People are drawn to us because of our bold vision, but they stay with us because they know we have what it takes to make it happen.
The bottom line: Learn from previous outings that you can get over the mountain, so you can ask people to stretch and meet a new challenge.
Folding the origami pieces looks easier than it is.
3. Make it accessible
Part of the fun of leading a creative team is building camaraderie and community. But that can be constrained if a project requires too much specialized knowledge. Ensuring that part of the project is achievable by those without technical or unique skills is key to drawing a crowd when you need it.
On all of our projects, a big part of the effort is folding the plastic origami pieces. That requires pure manual labor, and anyone can be trained to do it, so we hosted all-hands-on-deck build parties every weekend leading up to Burning Man.
The bottom line: If you want to draw a crowd, create easy ways for people to participate without specialized expertise.

4. Leave room for individual passions
When people are motivated to do something, get out of their way and let them go for it. Given the freedom, teammates will create something together that’s more amazing than what a single creative leader could pull off. Set the vision, then let people self-select into groups to get it done.
With RadiaLumia, no one person knows everything that’s going on at every given moment, which is kind of scary but also amazing, because it’s coming together despite—or because—of that!
When we shared the vision at the kickoff meeting in February, there were a bunch of people who’d only just met. Within minutes, they were already troubleshooting light placement. By the end of the afternoon, they’d demonstrated a cool light show—on day one! We now have several self-directed teams that are loosely connected, but working independently.
The bottom line: If you create a compelling enough vision and rough guardrails, you’ll create the conditions for people to self-organize in a way that will surprise you.

5. Embrace ambiguity
The beauty of large-scale creative endeavors is in all of the unknowns. Try to remain flexible about who realizes the vision (and how).
Each year there are moments of extreme uncertainty. Weeks before installing the Shrumen Lumen at Burning Man, the origami kept getting stuck when we tried to pull the stems over the steel substructure that would anchor them to the ground. This was completely unexpected and took two weekends to debug. (Spoiler alert: We fixed it, but not without panic!). Troubleshooting is part of the process.
The bottom line: Expect the unexpected, and look for the beauty and lessons in it rather than the difficulty.
One of the most rewarding parts of FoldHaus is that while I may set the vision, once we pull off a communal project, the whole team feels immense ownership and pride. Being able to share both the process and the result is what makes the late nights and desert rainstorms worth it.
See RadiaLumia come to life at Burning Man 2018.
Also: We’d love to hear about your ambitious team efforts, at Burning Man or elsewhere, using the hashtag #MakerArt.
Special thanks to Amy Bonsall for her massive help crafting this story.
We’d been working 16-hour shifts to install our art piece, a series of 10 larger-than-life, undulating, mechanical origami flowers. It was our first big build at Burning Man, and it took way longer than we expected to set up. After days, the flowers still weren’t working. Then came a torrential rainstorm.


Trust is earned, not machine learned
AI needs to earn our trust, just like any human relationship
Direct feedback that teaches rather than chides requires trust, and trust takes time.
Unlike humans, AI craves to know when it’s wrong. The entire premise behind machine learning is that it learns from failure or success. For example, we may feel that weather algorithms always get it wrong, but they can only improve by comparing their forecast to what actually happened. It’s therefore our job to tell the system when it’s wrong and acknowledge when it gets it right—but that requires a level of trust.
We can often tell if our friends or partners are unhappy with our actions, even if they don’t directly tell us. We can read their facial expressions, subtle changes in their tone of voice, and body language. Machines, however, don’t have that kind of intuition. Until we’re all walking around with some kind of lightweight EEG machine strapped to our head, machines will need to find proxies for how to sense human emotions, desires, and preferences. The obvious way to do this is to just to ask us, but that is manufacturing a transactional relationship, not a trusting one.
All I’m asking AI is for a little respect
A good example of an AI asking for trust rather than earning it can be found in the personal styling services that are popping up. They are doing some amazing things in integrating data science into every component of their business to drive growth. But my experience put me in the awkward position of feeling like I needed to explain myself and share sensitive personal details with someone I’d just met.
Signing up for the subscription service begins with a long and detailed survey about body type and style preferences. I spent a good 30 minutes thoughtfully answering myriad questions to create my style profile, and yet I returned everything that they sent me in the first box. None of it jived with my personal style, and only one thing fit.

I had put the time into creating a relationship with the AI—training it with my intimate information, such as how my body was shaped—and that process had given me a false sense of mutual understanding. If it had just taken a look at my Instagram profile and sent me a box, I would have given it permission to get it all wrong. But its surprisingly clunky and unnatural way of “sensing” my preferences for clothes set an unrealistically high expectation of what was to follow. Questions about slightly nuanced styles of plaid let me to believe that it could understand I like simple patterns—and then it sent me a shirt better fit for my grandfather.
By asking me to train a system before we had established a relationship of trust, the AI had breached it before it had even formed. When I’m in a trusting relationship, I can forgive someone for an error. But this felt different—like I’d been duped into a false sense of intimacy. I’m going to try one more box, but I have a strong hunch I’ll be cancelling my subscription soon.
AI is a relationship
While rare, there are a few AI with whom I’m in a trusting relationship of mutual respect. I relish my moments of training them because they respect my time and provide me with value as I train them—even when the AI is mostly wrong. I’ve come to truly value those moments when they tell me I’m wrong, because they do so in a way that deeply respects my position as a human and their position as a machine.
The format of the playlist is likewise brilliant: I don’t need to rate the songs but simply listen to them or skip them after I’ve heard a bit, and songs that I love get added to my own playlists or saved to my phone. Over time, it learns my preferences and can dish me up even better tunes. There’s no artificiality to training Spotify, and each and every time I train it, there’s value back to me as the user. Most importantly, Spotify has earned my trust through helping me discover a slew of new artists and, in doing so, earned its right to be wrong. (I don’t really love St. Vincent, but I understand why Spotify thinks I would.)

But we’re not the only one doing the teaching. When it comes to “training” humans, Waze and Google Maps are setting the standard. Their features are clearly based on a deep understanding of the common human emotional conditions that we endure during traffic: stress, anxiety, impatience, and a deep temptation to bail on our algorithmically recommended route in favor of our own “shortcuts” (which are almost never shorter).
Maybe the most brilliant bit of human-centered design inside of these navigation apps is how they highlight alternative routes and how much longer they’d take. Instead of having to blindly trust the route the AI has chosen, it considers its own possible fallibility and assures us by showing us the other routes we might be considering. Thinking of bypassing the highway? That’ll take another four minutes. Want to cut through that residential area? Here’s some construction of which you might not be aware.
In this way, Waze and Google Maps serve as a sort of angel on our shoulder, counseling us away from our inner traffic-hating demons. They’re not “AI-splaining” or chiding us for considering alternate routes, but rather giving us the necessary information to make the right decision. They’re rooted in a deep respect of human agency.
At IDEO, we prefer to think of AI as Augmented Intelligence rather than Artificial Intelligence. Taking a human-centered approach to building relationships between AI and humans compels us to meet humans on their terms, building relationships of trust and respect, and always remembering that intelligent systems must exist in service of humanity, not the other way around.
Beautiful, human-centered, human-AI relationships are about understanding human beings and our wonderful, weird intricacies and inconsistencies. They’re about designing the experience of AI around humanity, rather than the other way around. AI can only function well if it learns from its mistakes, and that means establishing trusting relationships with humans so they’ll feel comfortable saying when it’s wrong.
This article was originally published in Quartz Ideas.
Illustrations by Cassandra Fountaine.
It’s awkward to correct a stranger when they’re wrong. How did you feel when Miguel from IT, whom you’ve only met once, told you that “learnings” wasn’t a real word? Or when Robin lectured you about the correct pronunciation of “macaron” at the office holiday party?


Teaching AI to see our best side
Teaching machines to respond to our most personal preferences
But, for the most part, that relationship is passive. And that begs the question, what if we could teach our machines more actively? Could we school them on very specific things that are important to us? That thought became the perfect setup to build a little experiment involving selfies.
A self-portrait or a selfie is actually more than just one picture. It’s one picture out of endless tries which all look pretty much the same ... except that they don’t. At least not to the person taking the self-portrait. That person’s individual aesthetic, packed with subtle and subjective nuances, must be captured at exactly the right moment. Adding to the challenge, it's hard to explain to someone else the way you squint your eyes when you nail your smile or how you purse your lips to look roguish.
Enter Brainchild: a machine learning–based camera that can be taught individual preferences and make them accessible as a function. You can train the camera to understand how you like to see yourself without going through 100 iterations. And most importantly, it allows you to share your sensibility with somebody else.
Brainchild is just a prototype for now, but I'm hoping others will be inspired to build on the idea.


Beautiful, baby, beautiful
Machines are a billion times faster in quantitative tasks than we are. For a long time, the problem was one of not understanding quality. But that has changed with the improvement of so-called deep learning techniques—a subset of AI or machine learning.
By teaching Brainchild how you would like to be portrayed, it can assess the quality of what it sees in real time, and give you haptic feedback when it perceives you looking your best, so you can simply take that one picture.
It also allows others taking a snapshot of you to see you as if through your own eyes. Taking portraits is a very intimate art. Rather than taking the human out of the loop, Brainchild augments this human-to-human interaction by making it more collaborative.

A feel-good feedback loop
The intervals between interacting with machine-learning products and experiencing their learnings are often very long. There are many technical challenges, but more accessibility and immediate feedback would help us teach more actively and develop a better intuition for them. In return, machines could learn better and become more personal.
Brainchild is designed to provide immediate feedback. You teach it how you like to be portrayed, instead of letting it guess, and every picture you take based on its haptic recommendation serves as feedback on how well it learned and how well you taught it. (Plus, it's private. Brainchild works offline and stores all of your information locally, so there's no danger of it being shared.)
Smile!
How does the Brainchild prototype work? There are countless technical parameters we could talk about, but in the most simple terms, it makes use of a so-called transfer learning process based on a fine-tuned convolutional neural network—a technique frequently used in computer vision.
Brainchild needs to be taught five fundamentals:
- What a human face looks like
- How to learn about new faces
- How to isolate the face in a picture
- The way the portrait subject looks normally
- The way the portrait subject looks when they deem themselves looking their best
The first two points require huge amounts of coding, data, number crunching, and time. That’s what consumed most of my time (next to working on the wrong file for a day!).
The third point addresses the fact that when you take a portrait there is always something behind you. To focus only on you without distraction, Brainchild extrudes your face from the background. That is something it learns before you use it.
Then you become the teacher. In order to learn how you look your best, it needs to know how you look normally. So, you feed it a few examples of both, either by taking new snapshots, or by using pictures stored on your phone.
To help Brainchild differentiate between the two picture sets you simply twist the front plate, switching between two learning modes. The serious smiley means every picture you take will teach Brainchild how you look “normally”. Switching to the happy smiley means every picture you take will teach it what it looks like when you look your best. This is how you get to know each other.

As soon as the camera spots you in a way that matches what you taught it about looking good, it will gently vibrate and light up the camera’s trigger button. The vibration and brightness increase the closer your match with your own ideal.
Brainchild doesn’t snap the photo for you, it just signals you at the optimal moment to do so. You can also hand the camera to someone else to capture you in the way you like to be captured. And the more you teach it, the more accurate it becomes.


It might seem mundane to teach a camera how to take a better selfie, but the technology has already inspired one of our clients to rethink parts of a high precision medical device that could dramatically reduce treatment costs for patients, and another software engineer to work on a playful version of FaceID.
I myself am now working on a body pose add-on for fashion photography, and am curious to see all of the other ways we might actively teach our machines and help them augment us in more personal ways.
Instagram: @brain_children
Concept and Technology: Jochen Maria Weber
Visual Design: Tiffany Yuan
Industrial Design: Leo Marzolf
Special thanks: Tobias Toft
We teach our machines every day. Voice assistants learn how to talk to us based on what we say to them. Navigation apps guide us based on the routes we take. Without millions of teachers like you, our machines would be much dumber.


7 ways to design an unforgettable event
How to engage your guests beyond the panel
What do you do when a panel is truly the star of the show? Can you still design meaningful participation from your guests beyond the Q&A?
This was our challenge when IDEO CEO Tim Brown, pioneering social entrepreneur Jacqueline Novogratz (Founder of Acumen), and visionary CEO Carlos Rodriguez-Pastor (CEO of Intercorp and Founder of Innova Schools) sat down for a conversation about design and bravery in our New York office. We knew these three would inspire guests with heroic stories of using design to create change at scale and challenging orthodoxies. But could we keep the crowd inspired after the conversation ended?
Our best bet, we decided, was to design a series of activities that would send guests on a heroic journey of their own—from hearing the call to adventure to facing fears to celebrating triumph over adversity. The result? A happy swirl of exploration and discovery, with guests staying late to gather around the hands-on exhibits like family in the kitchen at the holidays.
Here are seven ways to leverage a panel discussion and design an event they’ll never forget.
1. A moment to unwind
Create a ritual to help guests wash away the baggage of the day and be present for all that follows. We invited guests to partake in a sonic shower, an immersion in music that stretches the ears and awakens the senses.
Try this: An aromatherapy bar for deep breaths of invigorating or relaxing scents.
2. Active imagining
Even the most thought-provoking panels amount to a type of passive contemplation for listeners. Follow a panel with a prompt to actively imagine. We asked guests to hear the call of service, by imagining they were a person they serve and writing in that person’s voice in response to questions like, “What would it take for you to feel confident about the future?”
Try this: A finish-the-doodle mural wall or a listening booth with a guided meditation.
3. Space to be vulnerable
Offer your guests the surprising jolt of inspiration that comes from being vulnerable and naming your fears. We designed an anonymous confessional, tricked out with blacklight and digital wizardry, where guests wrote their fears on a private screen, then watched their words magically appear on a monitor in type for party guests to see.
Try this: Pair strangers up using matching name tags and asking them to find each other and swap secrets.
We designed an anonymous confessional to help guests embrace vulnerability.
4. Fast-tracked inspiration
Inspiration can also be fast and light. We sent guests on a tour of themed rooms devoted to New York’s legendary cultural movements—Punk, BeBop, Hip Hop, the Beats, and the Harlem Renaissance. Each room was chock-a-block with images, sound, and strips of paper bearing anthemic words from the movement. It was a blast of culture felt through the senses.
Try this: Give guests a deck of cards created from your favorite inspirational Instagram memes.
Guests were invited to tour the most iconic cultural movements in New York history.
5. Skin in the game
Putting one’s body on the line—through movement, physical sensation, or embodied action—is the ultimate form of engagement. For our biggest test of bravery, we dared guests to stick their arm through a hole in a black screen to blindly receive a semi-permanent Jagua-ink tattoo from an artist on the other side. No requests or restrictions permitted.
Try this: Ask guests to enter a space through one of two thresholds marked by declarations of identity, like “I’m an artist” or “I’m an activist.”
The ultimate trust exercise—blindly allowing a stranger to draw on your skin with semi-permanent ink.
6. Making
Who doesn’t like to roll up their sleeves and craft something fun? Making gives your guests an outlet for any new, creative ideas your event has inspired. We handed guests shortbread cookies, pipette bags full of icing, and examples of exquisite cookie decoration to emulate.
Try this: A collage-making table with old magazines, construction paper, scissors, and glue sticks.
7. Silly celebration
Even the most buttoned-up among us appreciate the chance to let their hair down. We gave permission to get silly with an IDEO designer’s GIF Dance Party, accompanied by another designing spinning live music. Guests grooved in front of a camera for a few seconds, then watched their avatar populate a digital dance floor on monitors throughout the space.
Try this: A box of masks and capes and the promise of a free drink for anyone who orders as a superhero.
We asked guests to get jiggy with it, and they obliged.
To summarize: Get creative. Get physical. Get weird. Your guests will thank you for it.
Got an idea for an out-of-the-box event activity? Share it with us on Twitter using the hashtag #DisruptThePanel.
Ever attend a conference? Then it won’t surprise you to know that every event planner out there wants to disrupt the panel conversation. (We’ve been experimenting with the format for years and sometimes a panel is still the best choice.)


Lindsey Turner
I’m passionate about building brands, products, and experiences that help organizations show up with meaning and momentum.
I help organizations cut through complexity by shaping how they show up, through brand strategy, identity, and storytelling.
Working at the intersection of brand and business, I bring an editorial eye and a bias toward making—turning ideas into tangible experiences that people can understand, trust, and believe in.
My work spans government, healthcare, financial services, media, and consumer goods, from launching Gen Z-focused ventures to building innovation labs and reimagining legacy brands. I relish moments of ambiguity and enjoy translating across teams, perspectives, and priorities to move ideas forward.
I started my career in editorial and digital design, shaping cross-platform experiences and identity systems in publishing and agency environments. That foundation still shapes how I work today: I’m detail-oriented, collaborative, and overreliant on the Oxford comma. I hold a BFA in Visual Communication from the School of the Art Institute of Chicago.


Rachel Young
My work helps organizations see who their products aren't working for—and build the will and the tools to do something about it
For 25 years, I've asked the same question: Who does this design exclude—and what are we going to do about it?
My work spans human-centered strategy, inclusive design, and qualitative research, with clients ranging from Microsoft, Google, and Verizon to the National Science Foundation, and San Francisco Unified School District.
Before IDEO, I taught elementary school in East Palo Alto and spent a decade doing design work with social service organizations—where I learned firsthand what it costs people when systems are built without them in mind.
I am currently writing User Error, a nonfiction book about digital access and the design decisions behind it. I live in Oakland, California.


Brian Pelsoh
I lead with craft, ensuring our work is creatively excellent: rooted in deep human insight and imagination, while also grounded in the realities of business and technology.
My expertise spans brand, communication, and product design across tech, education, the arts, and social impact.
I believe great work demands both high-level vision and obsessive attention to detail, and only happens through collaboration.
I bring an inclusive, hands-on approach and a deep understanding of business, which enables me to consistently deliver excellence while always asking why.
Before joining IDEO, I worked at the brand firms Pentagram and VSA Partners. I began my career as a designer, leading teams at the School of the Art Institute of Chicago and the Milwaukee Art Museum. I hold an MFA in graphic design from Maryland Institute College of Art and a BFA in communication design from the Milwaukee Institute of Art & Design, and have taught at some of the best design schools in the US.


Tony Wong
I am responsible for IDEO’s long-term success in China and working with clients to use design as a tool to enable growth.
I am responsible for IDEO’s long-term success in China and working with clients to use design as a tool to enable growth. Specifically, I have helped Chinese companies design holistic brand solutions through the development of their products, communication, services, and innovation teams, and I have helped multinationals expand their presence and influence in China.
I advise global leaders on developing China-led innovation and capabilities.
In over 15 years in IDEO Shanghai, I have worked on projects that use design to elevate the quality of the experience of healthcare products and services, streamline processes that increase productivity, create spaces and programs that promote and enable inclusive communities, and build next generation mobility solutions that are planet-positive.
Before joining IDEO, I worked at Philips Electronics and the Electrolux Group in Italy, the Netherlands, and Singapore on a number of breakthrough commercial products. I am a member of the Young President Organization in Shanghai.
How to use AI as an editor, not a writer
Ed White shares how he uses AI as an editor—not a writer—to sharpen storytelling, rehearse ideas, and preserve the productive friction that makes creative work better.
Ed White has a rule he's tested on his own writing: hold yourself as the writer, and let AI be your editor. Ed is a Senior Design Director at IDEO's London studio, where he co-leads the firm's AI portfolio across Europe. Before IDEO, he spent 12 years as a writer and editor at the Financial Times, Wired, and Contagious. So when he talks about when to use AI for storytelling and when not to, it comes from two decades of crafting his storytelling skills.
In this episode, Mina Seetharaman talks with Ed about two specific tools he uses to keep AI in an editor's seat: a "roasting agent" prompted to critique his drafts without any sugarcoating, and a simulated audience he rehearses pitches on before the real thing. They also get into what Ed is hearing from design leaders at Anthropic, Lovable, Shopify, and Google Creative Lab about how creative work is changing, and why he thinks the friction of writing something yourself is worth protecting rather than automating away.
Building a personal AI for the messiness of life: Sida Li
Becca Carroll talks with Cue co-founder Sida Li about designing a personal AI for the messiness of everyday life—not just work. They explore how Sida stays anchored to human needs while navigating fast-changing technology, product tradeoffs, business-model experimentation, and the realities of building an AI company today.
Most AI products today are built for work—a space with clear problems and established systems. One founder noticed a gap: personal life is messier, harder to systematize, and mostly left behind by the AI boom. So she built Cue, a personal AI that lives inside iMessage and group chats, to go where the other tools haven't.
In this episode, Becca Carroll, IDEO's Chief Strategy Officer, talks with Sida Li, co-founder and CEO of Shared Context Lab, about staying anchored to a human need while the technology around her keeps changing shape, why she treats her business model with the same rigor she'd bring to a product, and what it feels like to build a company at this particular, disorienting moment in AI.
The conversation also gets into how Sida makes design decisions: the language Cue uses to describe itself, the tradeoffs behind building inside iMessage instead of a new app, and a real story about a business idea that didn’t pan out.
This is the second in a two-part series profiling founders from IDEO's Startups-in-Residence program. The first conversation is with Johannes Seemann, founder of Sooner, on designing GenAI for the emotional side of money.
Designing GenAI for the emotional side of money: Johannes Seemann
Designing financial tools around the feelings that shape money decisions.
Most personal financial tools are built to run the numbers and optimize towards a budget. While that works for some, most people experience money as a lived relationship that does not neatly fit into a spreadsheet. Johannes Seemann and Becca Carroll discuss why money is emotional before it is mathematical, and what a human-centered approach to building a generative AI financial product looks like in practice.
The curious leader's edge in uncertainty: Scott Shigeoka
How genuine curiosity helps leaders navigate uncertainty with greater confidence.
Mina Seetharaman talks with Scott Shigeoka, author of Seek and Head of Curiosity Cultivation at the Eames Institute, about what distinguishes genuinely curious leadership from performative curiosity, how power dynamics shape curiosity, and why practicing curiosity can restore energy rather than drain it.
Looks like you might be in search of something very specific?
Or reset the filters above and try another angle.
Here’s some random inspiration

Podcasts about creative leadership

Articles about the power of prototyping
