D4V is a Tokyo-based early stage Venture Capital in partnership with IDEO. Two years ago, D4V invested in healthcare startup Ubie, which develops a service called AI Monshin Ubie. The digital service was created with the goal of reducing the burden on healthcare professionals working long hours, under harsh conditions. AI Monshin Ubie automates a number of patient registration and documentation processes through digital tools, enabling doctors to spend less of their time on manual paperwork, and to dedicate their valuable skills and attention to the patients themselves. Currently, the service is installed in 200 medical institutions in 41 prefectures across Japan.

With AI Monshin Ubie, patients fill out preliminary forms on a tablet, rather than paper, entering information about their health history and current symptoms directly into their digital medical record. As patients fill out the questionnaire, the Ubie AI generates questions in real-time according to patients’ responses, which results in more appropriate and accurate data. The patient’s responses are automatically formatted for the doctor to review prior to and during the consultation. As a result, doctor consultation times and facility operation times are drastically reduced.

With the Coronavirus raising fears of a possible health system breakdown, Ubie has made improvements to anticipate and possibly prevent in-hospital infections. Until recently, Ubie’s services have been primarily used by large hospitals; but in light of the global health crisis, Ubie approached D4V—who partners with IDEO—to help rethink the onboarding experience and quickly facilitate the introduction of AI Monshin Ubie in regional clinics across Japan. D4V and IDEO have been working with Ubie for many years to collaborate in various areas, including UX, rebranding, international research, and more. Therefore, they had a foundation of knowledge from which to build these new features.

Typically, AI Monshin Ubie has been introduced to new hospital clients through direct, in-depth instructional visits from Ubie sales staff. This approach has worked well for rolling out the product to Japan’s 8,000 large hospitals; but for the 100,000 smaller clinics, Ubie needed a more efficient onboarding method to enable staff to get set up smoothly and independently.

During research, D4V and IDEO team members engaged with many different clinic staff members, including full-time doctors, part-time doctors, nurses and receptionists. The researchers found that staff tend to react skeptically to new tools and services, with a common preconception that they will add to their workload. One clinic director’s first impression of AI Monshin Ubie was, “It looks complicated.” But once he actually used the service, he realized that it was very user-friendly.

The team quickly understood that it was important to remove preconceptions by clearly communicating Ubie’s benefits and ease of use. They created a two-minute animation and designed three separate guidebooks. The animation adopted a friendly tone and expressed empathy for doctors, staff members and patients, highlighting how Ubie can bring benefits to each of them. The animation showed how Ubie fits into the existing workflow and explained complex systems in a straightforward and accessible way.

WATCH: A short video clip explains the benefit of their product and service to avoid the users’ concerns in advance.

The guidebook for doctors and directors explains how Ubie’s AI smooths the patient consultation experience and greatly improves the quality of medical care. It also introduces concrete how-tos around set-up, implementation, and ideal workflow. FAQs were also included, addressing concerns about whether or not elderly people would be able to use it.

Ubie business development leader Kenji Yamada says, “D4V and IDEO have a deep understanding not only of design, but of our entire business. They provide inspiration by bringing experience and knowledge that comes from working with other industries and clients outside of healthcare. We appreciate that they can share the knowledge that they’ve obtained with our business.”

Read the Japanese-language version of the Ubie case study here.
When You Feel Unwell, Ask Ubie: Check your symptoms for free
Learn more about Ubie: Global Company Website

In the emergency room, an intervention that’s administered too slowly could cost a patient their life. With COVID-19 fueling a surge in acute respiratory conditions, intubation—a procedure that involves inserting a tube through the mouth or nose and into the airway—is more common than ever. For patients struggling to breathe, the tube can be connected to a ventilator that pumps oxygen to the lungs, keeping them alive.

While a laser-focus on the present is critical for successful patient outcomes, hospitals and physicians often don’t have time to look ahead and anticipate the future of the operating room experience. As technology rapidly improves, there is a ripe opportunity and pressing need to evolve medical equipment to be more innovative and intuitive. Verathon Medical, a global medical device manufacturer, is supporting health care providers at the cutting-edge of care.

Verathon approached IDEO to redesign the existing product system for laryngoscopies and bronchoscopies—procedures that examine parts of the throat through intubation. During these examinations, a tube with a camera embedded in the tip is inserted through the patient’s nose or mouth. The doctor can then see inside the throat on a video monitor, and therefore more easily and quickly intubate and perform the exam.

To create a groundbreaking device, the team observed over a dozen laryngoscopies, bronchoscopies, and intubations. They noticed that many anesthesiologists relied on fixed equipment during the procedures. For example, some had grown accustomed to looking over their shoulder—away from the patient—to view the monitor.

During interviews, physicians and residents expressed difficulties with the current technology, sharing that the small screens aren’t conducive to team viewing or student instruction, and they must often use a separate computer to record patient notes. Others reported frustrating workflows, needing to constantly divert their attention and move their hands between the patient, prep tray, monitor, sterile bin, and disposal bin. These inconveniences and inefficiencies are not only cumbersome, but can increase the risk of infection and fatality.

The team relied on these insights to start designing a next-generation product. Through sketching, storyboarding, and building in real-time alongside doctors and clinic staff, designers quickly teased out additional findings and validated concepts.

This work led to the creation of the GlideScope Core: an all-in-one, portable product system that supports both video laryngoscopies and bronchoscopies. The base of the device—a wheeled cart—has built-in storage units for tools and a disposal bin, offering more mobility and accessibility for medical professionals.

The product’s tagline, “see more, do more,” points to the improvements made to the video system, including a large 10- or 15-inch high-definition touch screen monitor. Displayed images can be enlarged and rotated 180 degrees for improved visualization, team viewing, resident training, and classroom demonstration. To help doctors keep both the patient and monitor in their line of sight, the detachable screen can be secured to an adjustable arm that can be positioned directly over the patient. Additionally, the monitor’s patient annotation feature gives staff access to more of what they need in one device.

The product has been especially valuable for providers and patients during the coronavirus pandemic, when it’s imperative for doctors to keep their distance from patients’ mouths and noses. The GlideScope Core’s movable, detachable, and large, high-definition monitor makes it easier to take this precaution and intubate more quickly. This usefulness is reflected in the 5-fold increase in cart-based device orders for Verathon. While most providers typically order anywhere from 1 to 20 devices for airway procedures, one hospital system requested 600 GlideScope Core systems to meet current intubation demands.

Through modern technology and a focus on human needs, the GlideScope Core supports improved patient outcomes and creates a more seamless operating experience for medical professionals. The product underlines the key but often overlooked fact that often, in order to ensure the healthcare industry is patient-centered, medical device manufacturers and hospitals must also focus on improving the experience of providers.

Healthcare is notoriously difficult to change. Rules and regulations present complex barriers; health practitioners and organizations often have entrenched ways of working; and lives are literally on the line. Despite these significant barriers, the leaders at Newton-Wellesley Hospital (NWH) boldly committed to improving patient care through a new approach.

NWH is a community teaching medical center in Newton, Massachusetts. Because of its proximity to Boston—a city known for world-class healthcare institutions—NWH needed to differentiate itself. The hospital's new president, Dr. Michael R. Jaff, reached out to IDEO for help: "I knew that providing an unparalleled patient experience would set us apart from our competitors." But, Dr. Jaff’s particular approach was unique. He and Dr. Jodi Larson, Chief Quality and Experience Offer (CQXO), saw an opportunity to drive better patient outcomes through cultural and organizational change.

"You cannot learn any more than when you get to listen to your potential patients say why they would never walk into your place." —Dr. Michael R. Jaff

IDEO partnered with NWH for a year of work together, kicked off by defining the vision for NWH and ramping up to in-hospital prototyping and the launch of several new initiatives. A pilot project with the Women's Imaging Center (WIC) focused on solving departmental and employee challenges to provide a better experience for women getting mammograms.

Fueled by this potential, the WIC team redesigned key work processes and created a set of experience principles that inspired new service prototypes. Guided by principles like "Express mutual gratitude" and "Honor every voice," the WIC team tested ways for patients to acknowledge outstanding caregivers and created tools to gather better feedback from patients and adjust quickly. The experience of designing better services inspired the WIC staff to become ambassadors for the power of design thinking across other departments inside NWH and they continue to build on the work through new prototypes and experiments.

Next, IDEO partnered with NWH’s ambulatory surgery group. They took an analogous research trip to Boston’s Logan airport to see with fresh eyes how other high-touch customer service organizations provide customer value in a complex setting. Insights from the trip were applied through live prototyping of several new experiences inside the hospital, including a pre-surgery visit summary and pre-operation care carts.

Analogous research helped us realize that we can learn from other industries and incorporate some (cool) best practices if we allow ourselves to get over the ‘that would never work in the hospital’ mentality. - Dr. Jodi Larson

One of the most impactful prototypes was Care Modes, a tool to empower the NWH care teams to tailor their approach and interaction with patients based on the patients’ unique needs, beyond simply their clinical requirements. Four distinct approaches were identified for engaging a patient before surgery—Explain, Partner, Embrace, and Encourage. The Care Mode is determined based on the provider's understanding of a patient's degree of self-advocacy and their confidence that surgery is the best solution to their issue.

Historically, care providers have been trained to deliver consistent care above all else. However, Care Modes powerfully acknowledge that patients respond differently to different types of care. The Care Modes empower the team—from surgeon to nurse to anesthesiologist—with a clear framework for how to interact with and provide care for patients so they feel most comfortable. Based on the prototype's success with patients and impact on the staff culture, NWH has incorporated Care Modes into EPIC, the hospital's electronic medical record.

The importance of being patient-centered has been central to the healthcare conversation over the past thirty years; but new explorations reveal that there’s far more potential for innovation and improvement when the provider experience is considered in tandem with the patient’s. Each enables the other, and design for both together yields stronger solutions and better outcomes. IDEO's work with NWH demonstrates this vital shift in user-centered healthcare—one can't design services and experiences for patients without designing for their providers’ culture as well. When these go hand-in-hand, meaningful institutional change in healthcare is more than possible.

The mission of Chicago's Museum of Science and Industry (MSI) is to inspire children to achieve their full potential in the fields of science, technology, medicine, and engineering. Leaders at MSI realized they needed to drive day-to-day operations and maintain historic exhibits while focusing on where to go next. To prepare for its next decade, MSI worked with IDEO to create a new business focus to support the museum’s aspirations for the future. The plan would allow MSI to respond to the demands of the marketplace and raise the funds to get there.

At the beginning of the project, MSI laid out its priorities: improve equity of access, enhance the museum experience, and create a more innovative culture. To dive into each of these areas, IDEO conducted immersive research with families, teachers, donors, and staff.

IDEO brought together 60-plus donors, board members, and staff members to engage in a design thinking exercise to unpack and address the tensions that come with choosing a new strategic trajectory. Instead of having a standard ballot vote, the IDEO team encouraged participants to get up and vote with their feet, helping the group of stakeholders physically align on the museum’s new direction.

At the end of the research and prototyping phases, MSI and IDEO developed a vision called Provoking Minds, Inspiring Futures, creating six detailed design briefs to equip MSI teams to bring initiatives forward. The briefs laid out everything from recommending a new Department of Next, dedicated to ensuring that the future is at the heart of everything the MSI does, to MSI Runway, a place for experimental, small-scale, and limited-run exhibits. The ideas were brought to life with an interactive exhibit, built quickly with everyday materials like plywood and circuit boards, to demonstrate that creating an inspiring vision of the future doesn’t have to be an expensive endeavor.

The team also focused on insights that highlighted accessibility issues some families brought up early in the design process—travel across the city via public transportation can be lengthy, and the cost of admission to special exhibits could be prohibitive. To address these concerns, IDEO came up with the Mission Accessible brief: Inspired by casino buses, MSI bus stop signs would be posted in various low-income neighborhoods, signaling a way to take kids and families to the museum for free.

During the project, the IDEO team identified some low-hanging fruit, like rethinking ticketing and improving the student field trip experience, and helped the museum create cross-functional innovation teams to apply design thinking skills towards solving those challenges. They researched, brainstormed, and pushed forward new concepts, meeting weekly to share and build on ideas. At the end of the four week period, each team prototyped their ideas—new outdoor programming, software tools for visiting tour groups—and pitched them to each other.

In 2019, two years after the conclusion of the project, the collaboration paid off. With its new strategic plan and additional resources, the museum has renewed its commitment to serving youth, and MSI’s team, including donors, are aligned on a collective vision of the future. MSI raised more funds than in any previous year, including the single largest gift in its history—$125 million, nearly half of its $380 million fundraising goal—that will help ensure the years ahead.

I didn’t start out working at an enlightened company—I started out working in the art world, in upscale art galleries, private art clubs, and various museums. My surroundings were beautiful, but I was miserable. The politics and sexism were intense. I never felt like I could speak my mind.

Luckily, I eventually landed at IDEO. For the past 10-plus years, I’ve helped create events, experiences, and rituals that keep our studio culture healthy and our designers happy. Now, I’m Co-Director of the experience team in Chicago. Our mission: Design for belonging.

My team and I use tools like our studio space, food, events, experiences, and rituals to help make everyone who comes through our doors feel welcome, supported, and empowered to do the best work of their lives. We do things like throw spur-of-the moment pop-ups that break up the afternoon, and plan group lunches so people will eat together—like a family—instead of having sad lunches alone at their desks. We even plan crafting sessions and inspirational field trips.

Not convinced that thoughtful extras like spa water and storytelling events can actually help fuel the ideas that drive revenue? Consider the case of Uber.

Remember Travis Kalanick, the former CEO?

The deposed chief executive set the tone for the company’s culture. Under him, Uber flouted local laws and criticized competitors in its quest for success. Thanks to the company’s pervasive “bro” culture, sexual harassment and discrimination were rampant. Employees were pitted against one another, and management turned a blind eye to infractions from top performers.

Contrast Kalanick’s approach to leadership and culture to Microsoft CEO Satya Nadella, who took the company’s reins in 2014. He inherited a company lacking innovation—and relevance. Microsoft’s stock performance was flat. His goal was to shift the culture from “know-it-all” to “learn-it-all.” “Microsoft’s culture had been rigid,” he wrote in his book, Hit Refresh. “Each employee had to prove that he or she was the smartest person in the room. The culture change I wanted was centered on exercising a growth mindset every day.”

Three years later, not only are employees happier, more innovative, and empathic, but the company has generated more than $250 billion in market value—more than Uber, Airbnb, Netflix, Spotify, Snapchat, and WeWork—combined.

As an experience director, I’m laser-focused on making sure employees feel safe to fail and explore, that they feel connected to others, and that they have what they need to solve problems and come up with innovative solutions. My job is to set the conditions for great work.

So how do you actually do that? Here are five ways to jump-start your company culture.

1. Define and build on your company’s cultural values

Values are the compass that an organization uses to select staff members, reward current employees, and make business decisions. If you’re just starting a company and need to define your values from scratch, Greenhouse, the company that designed the recruiting software IDEO uses, has a helpful culture mapping exercise to help get you started. Need further inspiration? Check out Google’s values: “Focus on the user and all else will follow.” “It’s best to do one thing really, really well.” “Fast is better than slow.” “Great just isn’t good enough.”

2. Leverage naturally-occurring behaviors

Put on your anthropologist hat. What interesting or unusual things are people already doing around the office that you could build on? (It’s faster and easier to build on existing behaviors than to encourage new ones.) At one company, I noticed people were wary of talking to strangers. Unfortunately, since it was a co-working space, almost everyone was a stranger. I also observed that people would use the kitchen as a shortcut to the bathroom, and that it was a neutral zone—no one group owned it. High foot traffic + no ownership = opportunity to spark casual conversation and community! You can do what I did—look for unused spaces in your own workplace and use questions on Post-it Notes to spur random conversations—or move shared resources like printers or snacks to the middle of the space instead of tucking them away in a corner.

3. Identify and empower cultural mavens

As an experience director, I’m always look for new collaborators. Though some cultural experiences can come from the top down, others work better when they come from the bottom up. They feel more authentic. I’m always trying to identify new cultural mavens within our organization, and I empower them by giving them some time, money, or resources to bring their ideas to life. For example, at IDEO, we noticed a few of our designers were natural teachers and always went out of their way to show others how to learn a new skill. This aligned perfectly with two of our company values—“Learn from Failure” and “Make Others Successful”—so we gave those designers a budget and set them free to build on their ideas. Now we regularly have Nerd Nights where people learn to code, and Shop Class where we make things like concrete planters and leather wallets.

4. Prioritize face-to-face interactions

Digital tools are efficient, sure, but the only way to build authentic, human relationships is face-to-face. Period. When you find yourself using a digital tool to communicate with an individual or a group, think: Could this be done in person instead? Am I hiding behind this tool, this emoji? Encourage others to get out from behind their screens, too. One easy way? Get people to eat their meals together.

5. Design meaningful rituals

We participate in rituals in institutions, politics, and religion all the time. But they’re not commonly talked about in the world of business, even though they’re a simple way to make cultural values tangible. At IDEO, I was part of a team that started IDEO Stories, a Moth-like live storytelling event designed to help teach our designers how to tell better project stories. After the first event, it became clear it wasn’t just a good way to learn a new skill—it was a way to celebrate an individual’s unique backstory and unite the community.

For the last seven years in Chicago, we’ve also held an Annual Studio Awards party, an Oscars-inspired evening where the community votes on award-worthy project work from the past year. Categories are tweaked each year to incentivize emerging behaviors that are beneficial to our business.

Have ideas for rituals of your own? Share them with us on Twitter, so we can inspire each other.

Often, people want to write culture off as a slew of perks you might find at tech companies. But really, culture is about creating an environment that makes it possible for people to work together to come up with innovative products and ideas—the same products and ideas that drive revenue.

We met a beer and sausage vendor in Germany who keeps an array of hats stored on his gearshift, a humorous-looking makeshift hat hook. When we asked him more about it he explained that he often sells his wares at football games, so it’s important that he wear the right football club’s hat. “One time, when I wore the wrong one by accident, they called me an ass and tipped the van over,” he said. “You always have to howl with the wolves.”

Human-centered design requires us to observe human behavior with beginner's eyes, so that we can spot the innate ways people interact with the world around them. We call these intuitive and unconscious reactions Thoughtless Acts, and IDEO designers collect photos of them to inspire their work.

You can’t beat the smell of fresh ink, the texture and weight of high-quality paper, and the sound as you flip through the pages. When holding a magazine, I’m not simply reading it—I’m immersed in it.

I asked my fellow designers which publications they find the most exciting, and I’ve included a few of my favorites, too:

1. Apartamento

Yes, I suppose it’s an interior design magazine, but instead of focusing on beautiful, minimalist, multi-million-dollar houses (not that there's anything wrong with that), Apartamento covers real, lived-in homes and the creative people who occupy them. Raw portrait photography, cluttered spaces, and intimate interviews show how people really choose to live. Based in Barcelona, Spain, it’s survived through subscription revenue and a higher newsstand price, and has bucked the trend of featuring numerous ads or sponsored content. Plus, its perfect novel size, centered layout, patterned spine, and chunky typography are delightfully raw and unfussy. —Lindsey Turner, IDEO Cambridge

2. B

B magazine is published in South Korea. Every issue, it takes an advertisement-free, documentary approach to a single iconic brand. It’s covered many amazing brands, from the luxury to the mundane, including LEGO, Ray-Ban, and Bic. Each issue goes deep into the people, history, evolution, products, experiences, and philosophies of the brand it covers. Fans and collectors are also often included. I recommend it to anyone who likes branding and brand strategy, or just loves products and design. The many ways it looks at a brand and all its expressions goes far beyond simple identity and logo. —Clark Scheffy, IDEO San Francisco

3. Banana

In 2014, first generation Asian-Americans Vicky Ho and Kathleen Tso launched Banana magazine, a lifestyle magazine dedicated to exploring the intersection of Eastern and Western cultures. Ho and Tso are not claiming to be experts in Asian culture, but rather are discovering it right alongside their readers. Their goal is to understand what this third identity—neither Asian nor American, but Asian-American—means. As a designer, I think it’s fascinating to understand how cultures can blend together. With the growing influence of Asian countries on design trends, this magazine is relevant, vibrant, and bold, and offers great graphic design inspiration. —Coline Prevost, IDEO Palo Alto

4. [BranD]

[BranD] is a Hong Kong-based magazine that explores communication design in visual art, advertising, products, graphic design, and architecture. It brings together designers, artists, art directors, marketing specialists, and business-minded people of all stripes to share new ways to express ideas and brands visually. I'm an avid reader of [BranD] for inspiration in my craft; it's a great vehicle to stay connected to the ways other designers are stretching their own skills and building their crafts in a discipline—comms design—that is always evolving. —Joshua Lavra, IDEO San Francisco

5. Cat People

Cat People is an English-Japanese bilingual magazine featuring interviews and works by cat-obsessed artists, designers, photographers, and writers. It’s only in its first issue, but it’s already sold out. I’m very excited for future editions because this magazine promises magnificent inspiration for design and feline die-hards (like me). —Camden Foley, IDEO Palo Alto

6. Cereal

Cereal is a biannual travel and style magazine based in the United Kingdom. Each issue highlights engaging interviews and stories about unique design, art, and fashion on a specific theme, such as sustainability or desire. I’ve followed this magazine since its inception in 2016 and have every issue to date. Cereal’s publisher offers beautiful magazines, city guides, art prints, and even a children’s book—all with some of the best photography and design I’ve ever seen. —Camden Foley, IDEO Palo Alto

7. The Collective Quarterly

The Collective Quarterly is a magazine about travel and creativity across the U.S. The magazine staff—a rotating team of writers, photographers, illustrators, and other creatives—visits small towns or regions around the country to interview artists, creators, and other cornerstones of local life. As a photographer, the exceptional photography caught my eye, particularly that of one of the co-founders, who still shoots film photos like I do. It’s inspired me to get out with my camera more often. I recommend the magazine to anyone who seeks a deeper appreciation of creativity in intimate communities, hopes to explore non-urban corners of the country, or wants to bask in the magic of film photos. —Tara Safaie, IDEO San Francisco

8. Drift

Back when I was a barista, my mornings were spent adjusting the espresso machine's grind and my tamp to each bean's age and provenance. I learned that coffee is ubiquitous, yet highly circumstantial; you can find it in virtually any city, and yet each urban environment and its inhabitants have radically different rituals, cultures, and methods of consumption for this most essential drink. Drift transports its readers to different cities and their respective coffee cultures, allowing readers to intimately engage with new adventures in new places through a common cup of joe. —Adam Cristobal, IDEO Palo Alto

9. The Gourmand

As we reach the peak of our food media zeitgeist, The Gourmand has emerged as one of the leading alternative voices in the space, covering everything from new ways of visualizing food emoji to Georgia O'Keeffe's strict diet. Boasting both witty writing and distinct art direction, the magazine offers a unique perspective and inspirational fodder to foodies, designers, and creatives of all stripes as we look for more visually appetizing ways to engage with the world. —Adam Cristobal, IDEO Palo Alto

10. Offscreen

Offscreen is a print magazine published three times a year, as well as a weekly newsletter, that takes a thoughtful, human-centred approach to technology. It’s is a slow counterbalance to the fast pace of popular media, exploring creativity and design through introspective writing and thoughtful human stories. Offscreen is a proponent of the “slow web,” celebrating the idea that not all that is instant and convenient is necessarily good for us. —Nathan Paterson, IDEO Tokyo

11. Surface

Surface is a New York magazine that covers a little of everything—design, architecture, fashion, culture, and travel. I picked it up because I judge magazines by their covers. Each cover features a great close-up portrait of a creative person—an architect, musician, industrial designer, etc. The portrait is paired with restrained, Swiss-style black typography and a grid well versed in white space. The magazine examines culture through the lens of design and has a whiff of one of my favorite blogs, Sight Unseen. It's conspicuous consumption for sure, but sometimes that's what magazines are for. —Lindsey Turner, IDEO Cambridge

Next time you want to explore cutting-edge design—or just enjoy a little eye candy—crack the cover of one of these magazines for an inspiring read.

‍

Thanks to the digital revolution, fewer and fewer of us are getting our hands on paper copies of books, magazines, or newspapers these days. Online subscriptions and digital versions can fill the void, but sometimes, picking up a glossy magazine is simply the best way to absorb inspiration.

As a data scientist, this idea got my gears turning: What if I could use machine learning to build a laugh-detecting algorithm?

Prototyping is a great way to explore how emerging technologies will play a role in our connected future. But instead of focusing on how we will teach our machines to sense human behavior, I’m interested in designing what we will do with the information our devices are learning. In a world filled with machines that learn and interact with us, it’s important that they are able to respond to all parts of our humanity—including the things that make us laugh.

I wanted to see what kind of laugh detection prototype I could build in a few weeks. Here’s how I did it:

1. Building the algorithm

To build the laugh-detecting algorithm, I knew that I wanted to use deep learning, so I turned to Keras, a programming library which makes creating neural networks fast and simple. To train the laugh detector, I needed to use sequences of audio as the input and predict whether or not laughter would result as the output. Fortunately, I found Audioset, a collection of over two million 10-second audio clips with labels from over 6,000 categories. Using a subset of the Audioset collection that is half laughter and half speech, I was able to get a laughter detection model running with 87 percent accuracy within a few days.

After creating a training dataset, I got started on the machine learning challenge. The Audioset data does not contain the extracted raw audio, only a 128-length feature vector for each second of input, which is created using a convolutional network operating on the raw audio spectrogram. These feature vectors will be the input for the machine learning algorithm, and the output will be a binary label of whether the input contained laughter. Since I am working with a relatively large dataset, I wanted to use some deep learning methods, so I turned to keras, an API that makes creating and training neural networks extremely simple, while still leveraging the computational efficiency of optimized tensor computation libraries like TensorFlow and Theano.

Since the model input is sequential, I wanted to try a recurrent neural network first. I started with a single layer LSTM model that quickly converged to 87% accuracy. Learning from the code in a very similar project, I found that applying batch normalization to the LSTM input was very important for getting the model to converge. One of the headaches of deep learning is that seemingly trivial details like this can have a large impact on convergence. I was happy with the performance of my first LSTM model, but I decided to try out a couple more options before moving on. I tried a 3-layer LSTM (because if one layer is good, three must be better), then I tried a simple logistic regression model to see if the fancy RNN architecture made a difference. The models performed with 88% and 86% accuracy, respectively, which showed me that, in this case, more layers did not equate to more power.

Ultimately, I ended up choosing the single layer LSTM, even though it was larger than the logistic regression model, because it was able to handle variable length input. The training data was all sequences that were 10 seconds long, but I wanted the laughter detector to be able to respond quicker than that. While the logistic regression could only operate on input that was the same length as the training data, the LSTM model can still operate on any input length, as long as it is split into one-second chunks.

To take the trained model and run it as a live laugh detector, I put together a python script that pulled together a few different steps. First, the audio is captured from the microphone using pyaudio and chunked into three-second clips. (The length of these clips is an adjustable parameter.) The raw audio is then fed into the pre-trained vggish network and converted to a sequence of feature vectors with the same parameters I used for creating the Audioset training data. The sequence is then fed into the trained LSTM model, and the laughter prediction score is returned and written to a timestamped .csv file. By default, the raw audio is then discarded, and only the score is saved. That way, there are no concerns about storing or transmitting anyone’s private conversations. By running the audio capture and processing in separate threads, I was able to run this continuously without any lag on my laptop.

2. Designing the experience

Once I had the ability to measure laughter, I had to tackle the real design challenge: How do we implement the laugh detector in project spaces without making it seem obnoxious or creepy?

I enlisted the help of a few smart colleagues to approach the challenge from multiple angles: a software designer experienced in designing for play, an environments designer to explore how the detector would show up in a project space, and a communication designer who’s written on the science of laughter.

We had a brainstorm around what we might be able to do with a laughter detector, and the ideas poured in. Perhaps we could use laughter as a weekly indicator of morale (similar to Bhutan’s gross national happiness), or host a competition between project teams for who laughed the most? If we could determine when people are laughing, maybe we could figure out why they are laughing, too. We could determine when laughter is genuine or just polite, which jokes are the funniest, or even measure who is laughed at the most.

Some of the more wild ideas included a gif of an IDEO Chicago director Jon Wettersten (below) who laughs along with us, or an alert that would play videos of clowns if we went too long without laughing.

Ultimately, we wanted to select ideas that would give teams insight into their laughter, but not be too intrusive or prescriptive.

Information systems shouldn’t overwhelm users—particularly when that information concerns people’s moods. There are times when it’s appropriate to not be laughing; you don’t want your smartwatch telling you to laugh more during your grandma’s funeral. And if we were to build a device that listens for laughter, we'd need to make sure that we communicate and maintain people’s expectations of privacy.

With all this in mind, we narrowed it down to two concepts that we would take forward into the prototyping phase.

3. Hatching prototypes

The first thing we made was a simple information dashboard built in Dash. We referred to this design as a “FitBit for laughter,” as it was meant to help teams set goals and measure their progress towards those goals.

This raised the the question, what if you could track your emotional health in the same way that you tracked your physical health? What kind of goals would you set? What would your “laughter workout” look like?

To start, we measured laughs by time of day over a period of 24 hours, laughs per day over the past week, and how close teams are to achieving a daily “laugh quota.”

The second prototype used the output of the laugh detector to control the color and intensity of a Hue lightbulb. When there is a lot of laughter in a room, the light glows a bright yellow to mirror the warmth that laughter brings to a space. When there is less laughter, it transitions to a dim blue to help teams stay calm and focused. In this way, the environment responds to the activities and emotion of its inhabitants.

What if the smart systems we create could react not only to a user’s presence or interaction, but adapt to the user’s mood? How might we design smart systems or spaces that are emotionally responsive?

4. User testing

We wanted to see how people would react to the laugh-bulb, so we got a few colleagues to sit down and test it out. The original plan was to play funny videos to stimulate laughter, but as soon as people sat down, they started joking so much, the videos were unnecessary.

Laughter is a reinforcing behavior; when you laugh, the people around you laugh too, creating a virtuous cycle that can leave you laughing until you’re sore. Seeing the light grow brighter as the room fills with laughter adds energy to that cycle. The group that came in to test the laugh-bulb ended up laughing so much that you could hear them throughout the studio.

WATCH: Testing the laugh-bulb prototype.

Next up, I’d love to put these prototypes in front of more people to see whether quantifying laughter can affect their mood. And I'm left wondering, which emotional or mental health signals could be measured and recorded next?

As more aspects of our lives are recorded, we are going to be able to quantify and improve our lives in ways we can’t yet imagine. Let’s design these systems not just to make us smarter, but to make us more joyful, too.

Play goes hand in hand with innovation. I learned this from Brendan Boyle, director of IDEO's Play Lab, who says that if you measure the amount of laughter in a project space, the teams who chuckle most are also the most successful.

I help organizations cut through complexity by shaping how they show up, through brand strategy, identity, and storytelling.

Working at the intersection of brand and business, I bring an editorial eye and a bias toward making—turning ideas into tangible experiences that people can understand, trust, and believe in.

My work spans government, healthcare, financial services, media, and consumer goods, from launching Gen Z-focused ventures to building innovation labs and reimagining legacy brands. I relish moments of ambiguity and enjoy translating across teams, perspectives, and priorities to move ideas forward.

I started my career in editorial and digital design, shaping cross-platform experiences and identity systems in publishing and agency environments. That foundation still shapes how I work today: I’m detail-oriented, collaborative, and overreliant on the Oxford comma. I hold a BFA in Visual Communication from the School of the Art Institute of Chicago.

For 25 years, I've asked the same question: Who does this design exclude—and what are we going to do about it?

My work spans human-centered strategy, inclusive design, and qualitative research, with clients ranging from Microsoft, Google, and Verizon to the National Science Foundation, and San Francisco Unified School District.

Before IDEO, I taught elementary school in East Palo Alto and spent a decade doing design work with social service organizations—where I learned firsthand what it costs people when systems are built without them in mind.

I am currently writing User Error, a nonfiction book about digital access and the design decisions behind it. I live in Oakland, California.

‍

My expertise spans brand, communication, and product design across tech, education, the arts, and social impact.

I believe great work demands both high-level vision and obsessive attention to detail, and only happens through collaboration.

I bring an inclusive, hands-on approach and a deep understanding of business, which enables me to consistently deliver excellence while always asking why.

Before joining IDEO, I worked at the brand firms Pentagram and VSA Partners. I began my career as a designer, leading teams at the School of the Art Institute of Chicago and the Milwaukee Art Museum. I hold an MFA in graphic design from Maryland Institute College of Art and a BFA in communication design from the Milwaukee Institute of Art & Design, and have taught at some of the best design schools in the US.

I am responsible for IDEO’s long-term success in China and working with clients to use design as a tool to enable growth. Specifically, I have helped Chinese companies design holistic brand solutions through the development of their products, communication, services, and innovation teams, and I have helped multinationals expand their presence and influence in China.

I advise global leaders on developing China-led innovation and capabilities.

In over 15 years in IDEO Shanghai, I have worked on projects that use design to elevate the quality of the experience of healthcare products and services, streamline processes that increase productivity, create spaces and programs that promote and enable inclusive communities, and build next generation mobility solutions that are planet-positive.

Before joining IDEO, I worked at Philips Electronics and the Electrolux Group in Italy, the Netherlands, and Singapore on a number of breakthrough commercial products. I am a member of the Young President Organization in Shanghai.