D4V is a Tokyo-based early stage Venture Capital in partnership with IDEO. Two years ago, D4V invested in healthcare startup Ubie, which develops a service called AI Monshin Ubie. The digital service was created with the goal of reducing the burden on healthcare professionals working long hours, under harsh conditions. AI Monshin Ubie automates a number of patient registration and documentation processes through digital tools, enabling doctors to spend less of their time on manual paperwork, and to dedicate their valuable skills and attention to the patients themselves. Currently, the service is installed in 200 medical institutions in 41 prefectures across Japan.

With AI Monshin Ubie, patients fill out preliminary forms on a tablet, rather than paper, entering information about their health history and current symptoms directly into their digital medical record. As patients fill out the questionnaire, the Ubie AI generates questions in real-time according to patients’ responses, which results in more appropriate and accurate data. The patient’s responses are automatically formatted for the doctor to review prior to and during the consultation. As a result, doctor consultation times and facility operation times are drastically reduced.

With the Coronavirus raising fears of a possible health system breakdown, Ubie has made improvements to anticipate and possibly prevent in-hospital infections. Until recently, Ubie’s services have been primarily used by large hospitals; but in light of the global health crisis, Ubie approached D4V—who partners with IDEO—to help rethink the onboarding experience and quickly facilitate the introduction of AI Monshin Ubie in regional clinics across Japan. D4V and IDEO have been working with Ubie for many years to collaborate in various areas, including UX, rebranding, international research, and more. Therefore, they had a foundation of knowledge from which to build these new features.

Typically, AI Monshin Ubie has been introduced to new hospital clients through direct, in-depth instructional visits from Ubie sales staff. This approach has worked well for rolling out the product to Japan’s 8,000 large hospitals; but for the 100,000 smaller clinics, Ubie needed a more efficient onboarding method to enable staff to get set up smoothly and independently.

During research, D4V and IDEO team members engaged with many different clinic staff members, including full-time doctors, part-time doctors, nurses and receptionists. The researchers found that staff tend to react skeptically to new tools and services, with a common preconception that they will add to their workload. One clinic director’s first impression of AI Monshin Ubie was, “It looks complicated.” But once he actually used the service, he realized that it was very user-friendly.

The team quickly understood that it was important to remove preconceptions by clearly communicating Ubie’s benefits and ease of use. They created a two-minute animation and designed three separate guidebooks. The animation adopted a friendly tone and expressed empathy for doctors, staff members and patients, highlighting how Ubie can bring benefits to each of them. The animation showed how Ubie fits into the existing workflow and explained complex systems in a straightforward and accessible way.

WATCH: A short video clip explains the benefit of their product and service to avoid the users’ concerns in advance.

The guidebook for doctors and directors explains how Ubie’s AI smooths the patient consultation experience and greatly improves the quality of medical care. It also introduces concrete how-tos around set-up, implementation, and ideal workflow. FAQs were also included, addressing concerns about whether or not elderly people would be able to use it.

Ubie business development leader Kenji Yamada says, “D4V and IDEO have a deep understanding not only of design, but of our entire business. They provide inspiration by bringing experience and knowledge that comes from working with other industries and clients outside of healthcare. We appreciate that they can share the knowledge that they’ve obtained with our business.”

Read the Japanese-language version of the Ubie case study here.
When You Feel Unwell, Ask Ubie: Check your symptoms for free
Learn more about Ubie: Global Company Website

In the emergency room, an intervention that’s administered too slowly could cost a patient their life. With COVID-19 fueling a surge in acute respiratory conditions, intubation—a procedure that involves inserting a tube through the mouth or nose and into the airway—is more common than ever. For patients struggling to breathe, the tube can be connected to a ventilator that pumps oxygen to the lungs, keeping them alive.

While a laser-focus on the present is critical for successful patient outcomes, hospitals and physicians often don’t have time to look ahead and anticipate the future of the operating room experience. As technology rapidly improves, there is a ripe opportunity and pressing need to evolve medical equipment to be more innovative and intuitive. Verathon Medical, a global medical device manufacturer, is supporting health care providers at the cutting-edge of care.

Verathon approached IDEO to redesign the existing product system for laryngoscopies and bronchoscopies—procedures that examine parts of the throat through intubation. During these examinations, a tube with a camera embedded in the tip is inserted through the patient’s nose or mouth. The doctor can then see inside the throat on a video monitor, and therefore more easily and quickly intubate and perform the exam.

To create a groundbreaking device, the team observed over a dozen laryngoscopies, bronchoscopies, and intubations. They noticed that many anesthesiologists relied on fixed equipment during the procedures. For example, some had grown accustomed to looking over their shoulder—away from the patient—to view the monitor.

During interviews, physicians and residents expressed difficulties with the current technology, sharing that the small screens aren’t conducive to team viewing or student instruction, and they must often use a separate computer to record patient notes. Others reported frustrating workflows, needing to constantly divert their attention and move their hands between the patient, prep tray, monitor, sterile bin, and disposal bin. These inconveniences and inefficiencies are not only cumbersome, but can increase the risk of infection and fatality.

The team relied on these insights to start designing a next-generation product. Through sketching, storyboarding, and building in real-time alongside doctors and clinic staff, designers quickly teased out additional findings and validated concepts.

This work led to the creation of the GlideScope Core: an all-in-one, portable product system that supports both video laryngoscopies and bronchoscopies. The base of the device—a wheeled cart—has built-in storage units for tools and a disposal bin, offering more mobility and accessibility for medical professionals.

The product’s tagline, “see more, do more,” points to the improvements made to the video system, including a large 10- or 15-inch high-definition touch screen monitor. Displayed images can be enlarged and rotated 180 degrees for improved visualization, team viewing, resident training, and classroom demonstration. To help doctors keep both the patient and monitor in their line of sight, the detachable screen can be secured to an adjustable arm that can be positioned directly over the patient. Additionally, the monitor’s patient annotation feature gives staff access to more of what they need in one device.

The product has been especially valuable for providers and patients during the coronavirus pandemic, when it’s imperative for doctors to keep their distance from patients’ mouths and noses. The GlideScope Core’s movable, detachable, and large, high-definition monitor makes it easier to take this precaution and intubate more quickly. This usefulness is reflected in the 5-fold increase in cart-based device orders for Verathon. While most providers typically order anywhere from 1 to 20 devices for airway procedures, one hospital system requested 600 GlideScope Core systems to meet current intubation demands.

Through modern technology and a focus on human needs, the GlideScope Core supports improved patient outcomes and creates a more seamless operating experience for medical professionals. The product underlines the key but often overlooked fact that often, in order to ensure the healthcare industry is patient-centered, medical device manufacturers and hospitals must also focus on improving the experience of providers.

Healthcare is notoriously difficult to change. Rules and regulations present complex barriers; health practitioners and organizations often have entrenched ways of working; and lives are literally on the line. Despite these significant barriers, the leaders at Newton-Wellesley Hospital (NWH) boldly committed to improving patient care through a new approach.

NWH is a community teaching medical center in Newton, Massachusetts. Because of its proximity to Boston—a city known for world-class healthcare institutions—NWH needed to differentiate itself. The hospital's new president, Dr. Michael R. Jaff, reached out to IDEO for help: "I knew that providing an unparalleled patient experience would set us apart from our competitors." But, Dr. Jaff’s particular approach was unique. He and Dr. Jodi Larson, Chief Quality and Experience Offer (CQXO), saw an opportunity to drive better patient outcomes through cultural and organizational change.

"You cannot learn any more than when you get to listen to your potential patients say why they would never walk into your place." —Dr. Michael R. Jaff

IDEO partnered with NWH for a year of work together, kicked off by defining the vision for NWH and ramping up to in-hospital prototyping and the launch of several new initiatives. A pilot project with the Women's Imaging Center (WIC) focused on solving departmental and employee challenges to provide a better experience for women getting mammograms.

Fueled by this potential, the WIC team redesigned key work processes and created a set of experience principles that inspired new service prototypes. Guided by principles like "Express mutual gratitude" and "Honor every voice," the WIC team tested ways for patients to acknowledge outstanding caregivers and created tools to gather better feedback from patients and adjust quickly. The experience of designing better services inspired the WIC staff to become ambassadors for the power of design thinking across other departments inside NWH and they continue to build on the work through new prototypes and experiments.

Next, IDEO partnered with NWH’s ambulatory surgery group. They took an analogous research trip to Boston’s Logan airport to see with fresh eyes how other high-touch customer service organizations provide customer value in a complex setting. Insights from the trip were applied through live prototyping of several new experiences inside the hospital, including a pre-surgery visit summary and pre-operation care carts.

Analogous research helped us realize that we can learn from other industries and incorporate some (cool) best practices if we allow ourselves to get over the ‘that would never work in the hospital’ mentality. - Dr. Jodi Larson

One of the most impactful prototypes was Care Modes, a tool to empower the NWH care teams to tailor their approach and interaction with patients based on the patients’ unique needs, beyond simply their clinical requirements. Four distinct approaches were identified for engaging a patient before surgery—Explain, Partner, Embrace, and Encourage. The Care Mode is determined based on the provider's understanding of a patient's degree of self-advocacy and their confidence that surgery is the best solution to their issue.

Historically, care providers have been trained to deliver consistent care above all else. However, Care Modes powerfully acknowledge that patients respond differently to different types of care. The Care Modes empower the team—from surgeon to nurse to anesthesiologist—with a clear framework for how to interact with and provide care for patients so they feel most comfortable. Based on the prototype's success with patients and impact on the staff culture, NWH has incorporated Care Modes into EPIC, the hospital's electronic medical record.

The importance of being patient-centered has been central to the healthcare conversation over the past thirty years; but new explorations reveal that there’s far more potential for innovation and improvement when the provider experience is considered in tandem with the patient’s. Each enables the other, and design for both together yields stronger solutions and better outcomes. IDEO's work with NWH demonstrates this vital shift in user-centered healthcare—one can't design services and experiences for patients without designing for their providers’ culture as well. When these go hand-in-hand, meaningful institutional change in healthcare is more than possible.

The mission of Chicago's Museum of Science and Industry (MSI) is to inspire children to achieve their full potential in the fields of science, technology, medicine, and engineering. Leaders at MSI realized they needed to drive day-to-day operations and maintain historic exhibits while focusing on where to go next. To prepare for its next decade, MSI worked with IDEO to create a new business focus to support the museum’s aspirations for the future. The plan would allow MSI to respond to the demands of the marketplace and raise the funds to get there.

At the beginning of the project, MSI laid out its priorities: improve equity of access, enhance the museum experience, and create a more innovative culture. To dive into each of these areas, IDEO conducted immersive research with families, teachers, donors, and staff.

IDEO brought together 60-plus donors, board members, and staff members to engage in a design thinking exercise to unpack and address the tensions that come with choosing a new strategic trajectory. Instead of having a standard ballot vote, the IDEO team encouraged participants to get up and vote with their feet, helping the group of stakeholders physically align on the museum’s new direction.

At the end of the research and prototyping phases, MSI and IDEO developed a vision called Provoking Minds, Inspiring Futures, creating six detailed design briefs to equip MSI teams to bring initiatives forward. The briefs laid out everything from recommending a new Department of Next, dedicated to ensuring that the future is at the heart of everything the MSI does, to MSI Runway, a place for experimental, small-scale, and limited-run exhibits. The ideas were brought to life with an interactive exhibit, built quickly with everyday materials like plywood and circuit boards, to demonstrate that creating an inspiring vision of the future doesn’t have to be an expensive endeavor.

The team also focused on insights that highlighted accessibility issues some families brought up early in the design process—travel across the city via public transportation can be lengthy, and the cost of admission to special exhibits could be prohibitive. To address these concerns, IDEO came up with the Mission Accessible brief: Inspired by casino buses, MSI bus stop signs would be posted in various low-income neighborhoods, signaling a way to take kids and families to the museum for free.

During the project, the IDEO team identified some low-hanging fruit, like rethinking ticketing and improving the student field trip experience, and helped the museum create cross-functional innovation teams to apply design thinking skills towards solving those challenges. They researched, brainstormed, and pushed forward new concepts, meeting weekly to share and build on ideas. At the end of the four week period, each team prototyped their ideas—new outdoor programming, software tools for visiting tour groups—and pitched them to each other.

In 2019, two years after the conclusion of the project, the collaboration paid off. With its new strategic plan and additional resources, the museum has renewed its commitment to serving youth, and MSI’s team, including donors, are aligned on a collective vision of the future. MSI raised more funds than in any previous year, including the single largest gift in its history—$125 million, nearly half of its $380 million fundraising goal—that will help ensure the years ahead.

Direct feedback that teaches rather than chides requires trust, and trust takes time.

Unlike humans, AI craves to know when it’s wrong. The entire premise behind machine learning is that it learns from failure or success. For example, we may feel that weather algorithms always get it wrong, but they can only improve by comparing their forecast to what actually happened. It’s therefore our job to tell the system when it’s wrong and acknowledge when it gets it right—but that requires a level of trust.

We can often tell if our friends or partners are unhappy with our actions, even if they don’t directly tell us. We can read their facial expressions, subtle changes in their tone of voice, and body language. Machines, however, don’t have that kind of intuition. Until we’re all walking around with some kind of lightweight EEG machine strapped to our head, machines will need to find proxies for how to sense human emotions, desires, and preferences. The obvious way to do this is to just to ask us, but that is manufacturing a transactional relationship, not a trusting one.

All I’m asking AI is for a little respect

A good example of an AI asking for trust rather than earning it can be found in the personal styling services that are popping up. They are doing some amazing things in integrating data science into every component of their business to drive growth. But my experience put me in the awkward position of feeling like I needed to explain myself and share sensitive personal details with someone I’d just met.

Signing up for the subscription service begins with a long and detailed survey about body type and style preferences. I spent a good 30 minutes thoughtfully answering myriad questions to create my style profile, and yet I returned everything that they sent me in the first box. None of it jived with my personal style, and only one thing fit.

I had put the time into creating a relationship with the AI—training it with my intimate information, such as how my body was shaped—and that process had given me a false sense of mutual understanding. If it had just taken a look at my Instagram profile and sent me a box, I would have given it permission to get it all wrong. But its surprisingly clunky and unnatural way of “sensing” my preferences for clothes set an unrealistically high expectation of what was to follow. Questions about slightly nuanced styles of plaid let me to believe that it could understand I like simple patterns—and then it sent me a shirt better fit for my grandfather.

By asking me to train a system before we had established a relationship of trust, the AI had breached it before it had even formed. When I’m in a trusting relationship, I can forgive someone for an error. But this felt different—like I’d been duped into a false sense of intimacy. I’m going to try one more box, but I have a strong hunch I’ll be cancelling my subscription soon.

AI is a relationship

While rare, there are a few AI with whom I’m in a trusting relationship of mutual respect. I relish my moments of training them because they respect my time and provide me with value as I train them—even when the AI is mostly wrong. I’ve come to truly value those moments when they tell me I’m wrong, because they do so in a way that deeply respects my position as a human and their position as a machine.

The format of the playlist is likewise brilliant: I don’t need to rate the songs but simply listen to them or skip them after I’ve heard a bit, and songs that I love get added to my own playlists or saved to my phone. Over time, it learns my preferences and can dish me up even better tunes. There’s no artificiality to training Spotify, and each and every time I train it, there’s value back to me as the user. Most importantly, Spotify has earned my trust through helping me discover a slew of new artists and, in doing so, earned its right to be wrong. (I don’t really love St. Vincent, but I understand why Spotify thinks I would.)

But we’re not the only one doing the teaching. When it comes to “training” humans, Waze and Google Maps are setting the standard. Their features are clearly based on a deep understanding of the common human emotional conditions that we endure during traffic: stress, anxiety, impatience, and a deep temptation to bail on our algorithmically recommended route in favor of our own “shortcuts” (which are almost never shorter).

Maybe the most brilliant bit of human-centered design inside of these navigation apps is how they highlight alternative routes and how much longer they’d take. Instead of having to blindly trust the route the AI has chosen, it considers its own possible fallibility and assures us by showing us the other routes we might be considering. Thinking of bypassing the highway? That’ll take another four minutes. Want to cut through that residential area? Here’s some construction of which you might not be aware.

In this way, Waze and Google Maps serve as a sort of angel on our shoulder, counseling us away from our inner traffic-hating demons. They’re not “AI-splaining” or chiding us for considering alternate routes, but rather giving us the necessary information to make the right decision. They’re rooted in a deep respect of human agency.

At IDEO, we prefer to think of AI as Augmented Intelligence rather than Artificial Intelligence. Taking a human-centered approach to building relationships between AI and humans compels us to meet humans on their terms, building relationships of trust and respect, and always remembering that intelligent systems must exist in service of humanity, not the other way around.

Beautiful, human-centered, human-AI relationships are about understanding human beings and our wonderful, weird intricacies and inconsistencies. They’re about designing the experience of AI around humanity, rather than the other way around. AI can only function well if it learns from its mistakes, and that means establishing trusting relationships with humans so they’ll feel comfortable saying when it’s wrong.

This article was originally published in Quartz Ideas.

Illustrations by Cassandra Fountaine.

‍

It’s awkward to correct a stranger when they’re wrong. How did you feel when Miguel from IT, whom you’ve only met once, told you that “learnings” wasn’t a real word? Or when Robin lectured you about the correct pronunciation of “macaron” at the office holiday party?

But, for the most part, that relationship is passive. And that begs the question, what if we could teach our machines more actively? Could we school them on very specific things that are important to us? That thought became the perfect setup to build a little experiment involving selfies.

A self-portrait or a selfie is actually more than just one picture. It’s one picture out of endless tries which all look pretty much the same ... except that they don’t. At least not to the person taking the self-portrait. That person’s individual aesthetic, packed with subtle and subjective nuances, must be captured at exactly the right moment. Adding to the challenge, it's hard to explain to someone else the way you squint your eyes when you nail your smile or how you purse your lips to look roguish.

Enter Brainchild: a machine learning–based camera that can be taught individual preferences and make them accessible as a function. You can train the camera to understand how you like to see yourself without going through 100 iterations. And most importantly, it allows you to share your sensibility with somebody else.

Brainchild is just a prototype for now, but I'm hoping others will be inspired to build on the idea.

Beautiful, baby, beautiful

Machines are a billion times faster in quantitative tasks than we are. For a long time, the problem was one of not understanding quality. But that has changed with the improvement of so-called deep learning techniques—a subset of AI or machine learning.

By teaching Brainchild how you would like to be portrayed, it can assess the quality of what it sees in real time, and give you haptic feedback when it perceives you looking your best, so you can simply take that one picture.

It also allows others taking a snapshot of you to see you as if through your own eyes. Taking portraits is a very intimate art. Rather than taking the human out of the loop, Brainchild augments this human-to-human interaction by making it more collaborative.

A feel-good feedback loop

The intervals between interacting with machine-learning products and experiencing their learnings are often very long. There are many technical challenges, but more accessibility and immediate feedback would help us teach more actively and develop a better intuition for them. In return, machines could learn better and become more personal.

Brainchild is designed to provide immediate feedback. You teach it how you like to be portrayed, instead of letting it guess, and every picture you take based on its haptic recommendation serves as feedback on how well it learned and how well you taught it. (Plus, it's private. Brainchild works offline and stores all of your information locally, so there's no danger of it being shared.)

Smile!

How does the Brainchild prototype work? There are countless technical parameters we could talk about, but in the most simple terms, it makes use of a so-called transfer learning process based on a fine-tuned convolutional neural network—a technique frequently used in computer vision.

Brainchild needs to be taught five fundamentals:

1. What a human face looks like
2. How to learn about new faces
3. How to isolate the face in a picture
4. The way the portrait subject looks normally
5. The way the portrait subject looks when they deem themselves looking their best

The first two points require huge amounts of coding, data, number crunching, and time. That’s what consumed most of my time (next to working on the wrong file for a day!).

The third point addresses the fact that when you take a portrait there is always something behind you. To focus only on you without distraction, Brainchild extrudes your face from the background. That is something it learns before you use it.

Then you become the teacher. In order to learn how you look your best, it needs to know how you look normally. So, you feed it a few examples of both, either by taking new snapshots, or by using pictures stored on your phone.

To help Brainchild differentiate between the two picture sets you simply twist the front plate, switching between two learning modes. The serious smiley means every picture you take will teach Brainchild how you look “normally”. Switching to the happy smiley means every picture you take will teach it what it looks like when you look your best. This is how you get to know each other.

As soon as the camera spots you in a way that matches what you taught it about looking good, it will gently vibrate and light up the camera’s trigger button. The vibration and brightness increase the closer your match with your own ideal.

Brainchild doesn’t snap the photo for you, it just signals you at the optimal moment to do so. You can also hand the camera to someone else to capture you in the way you like to be captured. And the more you teach it, the more accurate it becomes.

It might seem mundane to teach a camera how to take a better selfie, but the technology has already inspired one of our clients to rethink parts of a high precision medical device that could dramatically reduce treatment costs for patients, and another software engineer to work on a playful version of FaceID.

I myself am now working on a body pose add-on for fashion photography, and am curious to see all of the other ways we might actively teach our machines and help them augment us in more personal ways.

Instagram: @brain_children
Concept and Technology: Jochen Maria Weber
Visual Design: Tiffany Yuan
Industrial Design: Leo Marzolf
Special thanks: Tobias Toft

We teach our machines every day. Voice assistants learn how to talk to us based on what we say to them. Navigation apps guide us based on the routes we take. Without millions of teachers like you, our machines would be much dumber.

What do you do when a panel is truly the star of the show? Can you still design meaningful participation from your guests beyond the Q&A?

This was our challenge when IDEO CEO Tim Brown, pioneering social entrepreneur Jacqueline Novogratz (Founder of Acumen), and visionary CEO Carlos Rodriguez-Pastor (CEO of Intercorp and Founder of Innova Schools) sat down for a conversation about design and bravery in our New York office. We knew these three would inspire guests with heroic stories of using design to create change at scale and challenging orthodoxies. But could we keep the crowd inspired after the conversation ended?

Our best bet, we decided, was to design a series of activities that would send guests on a heroic journey of their own—from hearing the call to adventure to facing fears to celebrating triumph over adversity. The result? A happy swirl of exploration and discovery, with guests staying late to gather around the hands-on exhibits like family in the kitchen at the holidays.

Here are seven ways to leverage a panel discussion and design an event they’ll never forget.

1. A moment to unwind

Create a ritual to help guests wash away the baggage of the day and be present for all that follows. We invited guests to partake in a sonic shower, an immersion in music that stretches the ears and awakens the senses.

Try this: An aromatherapy bar for deep breaths of invigorating or relaxing scents.

2. Active imagining

Even the most thought-provoking panels amount to a type of passive contemplation for listeners. Follow a panel with a prompt to actively imagine. We asked guests to hear the call of service, by imagining they were a person they serve and writing in that person’s voice in response to questions like, “What would it take for you to feel confident about the future?”

Try this: A finish-the-doodle mural wall or a listening booth with a guided meditation.

3. Space to be vulnerable

Offer your guests the surprising jolt of inspiration that comes from being vulnerable and naming your fears. We designed an anonymous confessional, tricked out with blacklight and digital wizardry, where guests wrote their fears on a private screen, then watched their words magically appear on a monitor in type for party guests to see.

Try this: Pair strangers up using matching name tags and asking them to find each other and swap secrets.

We designed an anonymous confessional to help guests embrace vulnerability.

4. Fast-tracked inspiration

Inspiration can also be fast and light. We sent guests on a tour of themed rooms devoted to New York’s legendary cultural movements—Punk, BeBop, Hip Hop, the Beats, and the Harlem Renaissance. Each room was chock-a-block with images, sound, and strips of paper bearing anthemic words from the movement. It was a blast of culture felt through the senses.

Try this: Give guests a deck of cards created from your favorite inspirational Instagram memes.

Guests were invited to tour the most iconic cultural movements in New York history.

5. Skin in the game

Putting one’s body on the line—through movement, physical sensation, or embodied action—is the ultimate form of engagement. For our biggest test of bravery, we dared guests to stick their arm through a hole in a black screen to blindly receive a semi-permanent Jagua-ink tattoo from an artist on the other side. No requests or restrictions permitted.

Try this: Ask guests to enter a space through one of two thresholds marked by declarations of identity, like “I’m an artist” or “I’m an activist.”

The ultimate trust exercise—blindly allowing a stranger to draw on your skin with semi-permanent ink.

6. Making

Who doesn’t like to roll up their sleeves and craft something fun? Making gives your guests an outlet for any new, creative ideas your event has inspired. We handed guests shortbread cookies, pipette bags full of icing, and examples of exquisite cookie decoration to emulate.

Try this: A collage-making table with old magazines, construction paper, scissors, and glue sticks.

7. Silly celebration

Even the most buttoned-up among us appreciate the chance to let their hair down. We gave permission to get silly with an IDEO designer’s GIF Dance Party, accompanied by another designing spinning live music. Guests grooved in front of a camera for a few seconds, then watched their avatar populate a digital dance floor on monitors throughout the space.

Try this: A box of masks and capes and the promise of a free drink for anyone who orders as a superhero.

We asked guests to get jiggy with it, and they obliged.

To summarize: Get creative. Get physical. Get weird. Your guests will thank you for it.

Got an idea for an out-of-the-box event activity? Share it with us on Twitter using the hashtag #DisruptThePanel.

Ever attend a conference? Then it won’t surprise you to know that every event planner out there wants to disrupt the panel conversation. (We’ve been experimenting with the format for years and sometimes a panel is still the best choice.)

There was a lot to celebrate. We’d launched an innovation lab and piloted new products as part of a larger, multi-year collaboration to expand the organization’s human-centered design capabilities and enable culture change.

And our collaboration had revealed something crucial: In order for the product to be successful we also needed to support the underlying organization, which meant looking more holistically at strategy, process, tools, and incentives.

That became an opportunity for me, an interaction and product designer by training, to apply my trade through an organizational lens. It turned out that the prototyping methods that I had learned could also be applied to people and processes. By experimenting, responding to feedback, and iterating, we could help nudge behavior change within the organization.

Here are the five big lessons I took away:

1. Speak their language

We were working with product managers, engineers, and designers, so instead of explaining what we planned to change with academic research and abstract frameworks, we used language they already understood. We were going to run scrappy experiments, learn quickly, and iterate. If the ideas didn’t work, we’d pivot and try something new. But instead of prototyping products, we were experimenting with people and processes.

Big insight: Meet people where they are. Ground organizational design in a familiar context, and make it tangible in order to build trust.

2. When facing big change, start small

Behavior change is hard. So, we started with small experiments. What was the least that we needed to design in order to learn—the minimum viable product (or MVP)—and to help nudge new behaviors? In one instance, to test our hypothesis on the need for a company-wide training program, we started by creating a workshop for one multi-disciplinary team of 10. Its success soon paved the way for a broader rollout.

Big insight: Organizational change doesn’t have to begin with big initiatives. Starting small with prototypes can lead to big learnings and start to shift behavior.

3. Measure impact in creative ways

Email surveys are an obvious way to take the pulse and determine whether experiments are resonating with individuals, but they can easily fall to the bottom of a priority list. We tested more lightweight, in-the-moment feedback methods. After prototyping a beer and knowledge-sharing gathering, we asked attendees to place a magnet on a board to indicate their responses to a few questions, like: “Would you come again?” and “Did you learn something?” It was an easy and immediate way to figure out if the idea was worth evolving.

Big insight: Simple and in-the-moment measurement tools can be enough proof of concept to move forward quickly.

4. Find the right ambassadors

Early on, I was determined to get all of the senior executives involved in our prototypes. What was I thinking? Their understandably divided attention and packed calendars made that next to impossible. In the end, some young, energetic community managers were the ones who embraced our ideas and helped push them forward. Not only did they have the time and passion for the projects, but they were also trusted leaders within the company. Community managers helped us organize an informal gathering of product people to share methods over beers. (Yes, beer again. When in Germany!) We asked a VP to simply show up. When he saw the overwhelming attendance and impact on the community, he became one of our biggest advocates. Teams that had been working in silos started to meet regularly. The more we demonstrated quick wins, the more senior leaders got on board to encourage new behaviors throughout the organization.

Big insight: The best agents of change may not be the most senior folks. Look for individuals with passion and social capital.

5. Make it stick

There are two things that we did that helped ensure that our ideas lived on after we were gone. First, we found owners within the organization who would commit to moving our ideas forward. Second, we helped create an internal group dedicated to maintaining momentum. This group provides leadership training and coaches teams to ensure both a top-down and bottom-up approach to behavior change.

Big insight: Prototypes are just the beginning. Organizational transformation requires dedicated owners and a multi-layered strategy.

It all adds up to a set of behaviors: Get scrappy, get tangible, find your people, and learn by doing. It never hurts to do some reflection from a rooftop, too.

‍

Not long ago, a coworker and I found ourselves contemplating the eclectic Berlin skyline. We were on the rooftop of our client’s office—a leading European brand in online retail—and thinking back on what we’d learned from embedding with them for a year.

I help organizations cut through complexity by shaping how they show up, through brand strategy, identity, and storytelling.

Working at the intersection of brand and business, I bring an editorial eye and a bias toward making—turning ideas into tangible experiences that people can understand, trust, and believe in.

My work spans government, healthcare, financial services, media, and consumer goods, from launching Gen Z-focused ventures to building innovation labs and reimagining legacy brands. I relish moments of ambiguity and enjoy translating across teams, perspectives, and priorities to move ideas forward.

I started my career in editorial and digital design, shaping cross-platform experiences and identity systems in publishing and agency environments. That foundation still shapes how I work today: I’m detail-oriented, collaborative, and overreliant on the Oxford comma. I hold a BFA in Visual Communication from the School of the Art Institute of Chicago.

For 25 years, I've asked the same question: Who does this design exclude—and what are we going to do about it?

My work spans human-centered strategy, inclusive design, and qualitative research, with clients ranging from Microsoft, Google, and Verizon to the National Science Foundation, and San Francisco Unified School District.

Before IDEO, I taught elementary school in East Palo Alto and spent a decade doing design work with social service organizations—where I learned firsthand what it costs people when systems are built without them in mind.

I am currently writing User Error, a nonfiction book about digital access and the design decisions behind it. I live in Oakland, California.

‍

My expertise spans brand, communication, and product design across tech, education, the arts, and social impact.

I believe great work demands both high-level vision and obsessive attention to detail, and only happens through collaboration.

I bring an inclusive, hands-on approach and a deep understanding of business, which enables me to consistently deliver excellence while always asking why.

Before joining IDEO, I worked at the brand firms Pentagram and VSA Partners. I began my career as a designer, leading teams at the School of the Art Institute of Chicago and the Milwaukee Art Museum. I hold an MFA in graphic design from Maryland Institute College of Art and a BFA in communication design from the Milwaukee Institute of Art & Design, and have taught at some of the best design schools in the US.

I am responsible for IDEO’s long-term success in China and working with clients to use design as a tool to enable growth. Specifically, I have helped Chinese companies design holistic brand solutions through the development of their products, communication, services, and innovation teams, and I have helped multinationals expand their presence and influence in China.

I advise global leaders on developing China-led innovation and capabilities.

In over 15 years in IDEO Shanghai, I have worked on projects that use design to elevate the quality of the experience of healthcare products and services, streamline processes that increase productivity, create spaces and programs that promote and enable inclusive communities, and build next generation mobility solutions that are planet-positive.

Before joining IDEO, I worked at Philips Electronics and the Electrolux Group in Italy, the Netherlands, and Singapore on a number of breakthrough commercial products. I am a member of the Young President Organization in Shanghai.

Most AI products today are built for work—a space with clear problems and established systems. One founder noticed a gap: personal life is messier, harder to systematize, and mostly left behind by the AI boom. So she built Cue, a personal AI that lives inside iMessage and group chats, to go where the other tools haven't.

‍

In this episode, Becca Carroll, IDEO's Chief Strategy Officer, talks with Sida Li, co-founder and CEO of Shared Context Lab, about staying anchored to a human need while the technology around her keeps changing shape, why she treats her business model with the same rigor she'd bring to a product, and what it feels like to build a company at this particular, disorienting moment in AI.

‍

The conversation also gets into how Sida makes design decisions: the language Cue uses to describe itself, the tradeoffs behind building inside iMessage instead of a new app, and a real story about a business idea that didn’t pan out.

‍

This is the second in a two-part series profiling founders from IDEO's Startups-in-Residence program. The first conversation is with Johannes Seemann, founder of Sooner, on designing GenAI for the emotional side of money.

Most personal financial tools are built to run the numbers and optimize towards a budget. While that works for some, most people experience money as a lived relationship that does not neatly fit into a spreadsheet. Johannes Seemann and Becca Carroll discuss why money is emotional before it is mathematical, and what a human-centered approach to building a generative AI financial product looks like in practice.

Mina Seetharaman talks with Scott Shigeoka, author of Seek and Head of Curiosity Cultivation at the Eames Institute, about what distinguishes genuinely curious leadership from performative curiosity, how power dynamics shape curiosity, and why practicing curiosity can restore energy rather than drain it.

Mina Seetharaman talks with David Epstein, author of Inside the Box and Range, about why total freedom often produces average work, how leaders can design useful limits on purpose, and what organizations such as General Magic and Pixar reveal about the relationship between boundaries and creativity.