Over more than a century of leadership in the food and beverage industry, The J.M Smucker Company has expanded its range of products to maintain its relevance and address market demand. Today, the company leads numerous categories, with beloved products like Jif, Milk-Bone, and Folgers, which are the top choices of millions of Americans. By growing and diversifying their brands over the decades, Smucker has successfully weathered major shifts in consumer habits and technology. Today, though, CPG companies are experiencing unprecedented disruption, and leaders at Smucker understand that the escalating pace of change will require more than just new products.

Geoff Tanner, Senior Vice President, Growth & Consumer Engagement at The J.M. Smucker Company recognized the need to identify new market opportunities and establish practices that put innovation and growth at the heart of their business. And he saw the potential to bring those goals to life through his relationship with IDEO.

WATCH: Balancing innovation and efficiency through design has helped Geoff Tanner, Senior Vice President, Growth & Consumer Engagement at The J.M. Smucker Company, brave the unfamiliar, transform organizations, and ultimately bring game-changing ideas to market faster.

Geoff has stewarded a close partnership with IDEO for over a decade and throughout roles at numerous organizations. Together, Geoff and IDEO have worked on 25 projects, beginning while Geoff was VP of Marketing at Big Heart Pet Brands, and continuing on throughout his career at The J.M. Smucker Company. By working with IDEO to adopt a design thinking approach, Geoff has enabled collaboration across teams and empowered his organizations to find new ways of working that result in measurable business impact. For The J.M. Smucker Company, the partnership has brought creativity and human-centered design to the forefront of its operations, strengthening its ability to bring new products and brands to market and create a pipeline of growth.

WATCH: The J.M. Smucker Company has shifted to embrace growth and innovation as a mindset throughout the organization to bring more consistency to the innovation process.

Looking to the past to creatively connect with the future

As an example of this, Geoff and The J.M. Smucker Company suggested to IDEO that they explore how Folgers, America’s leading at-home coffee brand, might resonate more deeply with a millennial audience. Design research revealed that the mindset of today’s millennial coffee drinkers aligned with Folgers entrepreneurial brand roots. The teams collaborated to create a new concept: a brand called 1850 and an end-to-end, go-to-market product experience, including packaging, retail, and merchandise. 1850 hit shelves in 2018 and has since been reported by IRI Advantage as the top launch in the Coffee Category for 2019.

Frankly, I don’t think innovation gets any easier. You just get a little more comfortable with the discomfort, and that’s when the work starts to get consistently better.

Geoff Tanner, Senior Vice President, Growth & Consumer Engagement, The J.M. Smucker Company

Creating an innovation pipeline that’s inspired by consumers’ needs

With 1850 underway, Geoff and The J.M. Smucker Company continued to invest in human-centered design to drive new offerings. The next collaboration with IDEO explored how Jif, the iconic peanut butter brand, could extend beyond the jar and become more readily accessible and appealing to busy parents who want to feel confident about the snacks they give their kids.

The design team was moved by the challenges that parents face: They want the best for their kids, but struggle to choose between what’s wholesome and what’s convenient on a daily basis. The ideal foods are filling, nutritious, and energizing, but often take more time to prepare and aren’t backpack or carpool-friendly. On the other hand, more convenient options tend to be full of empty carbs. Based on this insight, IDEO and Jif decided to tackle the snack-time parenting struggle. The IDEO and Jif teams worked side-by-side to prototype multiple product ideas and formats and tested them with on-the-go families to ultimately create Power Ups.

Available at over 200 retailers worldwide and online at Amazon, Jif Power Ups make wholesome, delicious grab-and-go snacking possible for kids and parents alike, across products ranging from Soft Baked Bars to Creamy Clusters, which are filled with peanut butter and rolled in whole grain oats. All are made with peanuts as the first ingredient and contain no high fructose corn syrup. Since going to market in 2018, Jif Power Ups has been named the top innovation launch in the Snack Bars category by IRI Market Advantage.

Design thinking underpins everything we do.

Geoff Tanner, Senior Vice President & Corporate Officer, Growth & Consumer Engagement, The J.M. Smucker Company

WATCH: The J.M. Smucker Company is on a transformational journey, committed to three pillars of growth: Lead in the best categories, build brands consumers love, and be everywhere.

The J.M. Smucker Company has experienced accelerated growth and speed to market by testing bold new ideas and evolving the role of innovation at the company. Design thinking and consumer empathy have permeated the organization’s new product development process, making it easier to uncover sharp, human-centered insights that lead to thoughtful and uniquely differentiated brands in a competitive, ever-shifting, and overcrowded industry. The work has fueled Geoff’s vision to inspire a culture of innovation at the company so that it can move at the speed of consumers and remain a best-in-class family of brands for future generations.

It’s a Thursday afternoon in Oakland, California. A line of lunchtime diners snakes out the door of dosa by DOSA. Upon entering, eaters are greeted by the smell of tangy dosa—a large paper-thin crepe made from a fermented batter of rice and lentils—and sweet, spicy chai. Turquoise chairs pop against a floor-to-ceiling mural by Oakland artist Namita Kapoor that transports diners to Chandni Chowk, one of the busiest markets in Old Delhi, as if enjoying their food at a local vendor.

In 2003, Emily and Anjan Mitra spent their honeymoon in India, savoring the street food of Anjan’s childhood in Mumbai (often still called Bombay). After returning to San Francisco, they found themselves longing for those distinctive flavors and dishes. Realizing that most Bay Area diners had never seen nor tasted these foods, Emily and Anjan founded DOSA, an upscale, full-service restaurant that introduced the Bay Area to Southern Indian cuisine. Locals came to try the unique, plant-forward dishes, and left with satisfied bellies and a broader understanding of Indian culture.

The entrepreneurs envisioned a brand extension of DOSA: a counter-service restaurant that could scale nationally. The hospitality venture, called dosa by DOSA, would offer healthful Indian street food made from local and seasonal ingredients. Emily and Anjan also set out to expand their existing product line-up—including cold lassi beverages, simmering sauces, and grab-and-go-meals—to national grocers and retailers and needed launch-ready packaging that was convenient, eye-catching, and environmentally-friendly. The new expression would enable consumers to experience dosa by DOSA and Southern India in a variety of forms and places. Emily and Anjan partnered with IDEO to establish a cohesive and consistent brand experience, from the restaurant and to-go meals to retail stores and mobile delivery.

In close partnership with the founders, their staff, Feldman Architecture and MPADA, IDEO set out to bring dosa by DOSA to life and help it scale through brand, environment, and experience design. This included creating everything from the logo and packaging to the menu and operations strategy, with each element tying back to the founders’ vision of sharing Indian heritage and traditions through cuisine.

The group began by seeking cultural inspiration for dosa by DOSA’s brand identity system—the logo, colors, values, fonts, and messaging—to guide future designs. They were inspired by Indian truck drivers who decorate their trucks with garlands, signs, or flags that engage other drivers or bring luck. The dosa by DOSA logo design and its wood-cut typeface are inspired by the dimensionality of this homespun art form, while the vibrant, eclectic colors reflect the streets and textures of urban Mumbai.

The goal of opening people’s minds to Indian cooking and culture extends to the packaging, which meets customers’ needs and playfully educates them. The food containers—made from recycled and compostable material—feature brightly patterned labels reminiscent of the trucks. Some have built-in compartments suited to multiple dipping chutneys, making it convenient to sample a variety of Indian flavors. Paper tray covers resembling Mumbai newspapers offer eating tips like “Be civilized. Eat with your hands,” encouraging diners to experience an Indian custom.

The vibrant brand comes to life across an array of packaging, including cold cups printed with the phrase “thanda thanda pani”—meaning “cold cold water”—which comes from a popular Indian parody of the Vanilla Ice song "Ice Ice Baby."

To design the diner experience and restaurant environment in a way that invites curiosity about the culture and cuisine, the team started with diners: They identified key moments in their experience like entering, waiting in line, and paying. The floor plan, furniture, lighting, signage, and menu were designed around these touchpoints. For example, while customers wait in line, they can watch dosa being prepared, as if they’re eager and hungry travelers awaiting street food.

The dosa by DOSA menu includes distinctive items like coconut kale mung bean salad and hot masala chai made with caramelized milk—the way Anjan’s mother prepared it. To help the restaurant scale, the team created a preliminary furniture, fixtures, and equipment (FF&E) budget, 3D renderings of the space, and an operations strategy for the founders and their employees.

The dosa by DOSA flagship launched in January 2018 in Oakland, California. The IDEO brand guidelines have enabled the dosa by DOSA team to independently and easily shepherd new product lines to market, including salads, wraps, curry bowls, samosas, and simmer sauces. The brand’s packaged food launched in over 200 natural food stores in 24 months—including over 100 Whole Foods locations—as well as online retailers and delivery services like Good Eggs and Caviar. These items and the restaurant have helped Emily and Anjan realize their vision of bringing the flavor and spirit of Southern Indian cuisine to new communities around the world.

In recent years, due to shifts in Japan’s demographics, the food industry has faced challenges such as a decrease in market size and a shrinking number of producers. As a result, social impact opportunities abound in this field.

When Japanese software company NJC (Nippon Jimuki Co. Ltd.) approached IDEO seeking to identify new business opportunities that would build on the company’s core strengths, the food and agriculture industry rose up as a promising area of focus.

NJC is a well-established software company that has spent over 50 years helping to build backend business systems for small to medium enterprises. NJC works across healthcare, retail, and food and beverage, computerizing core processes to support and improve operations.

In partnership with IDEO, NJC explored its strengths and potential as an organization, as well as the ideas and visions of the employees, and emerged with the goal of using their capabilities to address large-scale issues facing regional farmers.

During research across Japan, local growers described challenges with multi-layered supply chains and analog systems, which led to “overwork for minimal profit,” as well as a gap between supply and demand. Because agricultural wholesalers lacked clear information in advance on the status of crops or the volume to be harvested, they struggled to negotiate with buyers, which led to wasted food On the other hand, the farmers who grow the crops are engaged in manual labor, and do not always have the energy to focus on business aspects such as efficiency or the pursuit of increased profitability, which leads to a diminished interest in farming among young people.

One question that emerged through research was why agricultural producers weren’t utilizing IT. This evolved into “How can profitability be improved for all stakeholders?” and, “How might we create a system that will provide useful data without creating a burden for either farmers or agricultural wholesalers?”

The result was fudoloop.

fudoloop is an app that enables farmers and wholesalers to conduct business more profitably by bringing transparency to the fluctuating produce market. Through fudoloop, wholesalers receive information from farmers a day in advance, and can coordinate the various requests of buyers, such as order size, production location and other special requests. As a result, wholesalers can function as “community managers,” doing business with both producers and buyers at a more appropriate price point.

NJC aims for fudoloop to be the first step in a cycle that brings value to all stakeholders, from farmers to wholesalers, retailers and even customers, by redefining the “middleman” role of produce wholesalers.

The population of Tokyo’s metropolitan area is twice as big as New York, and the daily influx of workers from the suburbs increases that number sixfold. Congestion on trains traveling through the center of Tokyo during commuting hours is said to reach somewhere close to 200 percent of the trains’ capacity.

East Japan Railway Company (known as JR East) is the world’s largest railway company by revenue, operating 12,000 trains daily and serving 6.4 billion passengers per year.

In March 2014, JR East leveraged their extensive operations and passenger data to publish a consumer app that provided train location information, congestion status, air conditioning temperature, and wayfinding tools.

The app was downloaded more than 3.8 million times; however, its features and usability proved unsatisfactory to users. In an attempt to be comprehensive in addressing passenger needs, the app was weighed down with data and worked sluggishly. Competitors’ apps were named above JR East in customer satisfaction surveys, highlighting the company’s need to address the tool’s usability.

JR East’s Technical Division approached IDEO to help design an attractive and consistent user-centered experience through its digital ecosystem. With a team of interaction designers, they launched a project to create a new version of their app.

During the research phase, the IDEO team observed passengers’ behaviors and decision-making processes and noticed that people were using several apps at once to get more personalized and complete information.

The team created a set of paper-based prototypes to test how users would react to various functionalities. Surprisingly, users ranked versions with limited functionalities higher than those with a broad range of features.

This insight informed a new prototype that enabled a customized user experience based on traveler needs. Wayfinding proved to be the most frequently selected feature, so the new app was designed around helping passenger navigate during their trips.

Although JR East had traditionally outsourced their app development, IDEO encouraged them to organize their own internal team. In cooperation with Pivotal—a frequent IDEO partner familiar with human-centered approaches—the internal team was trained in agile development and built the new app themselves. A prototype was released in November 2017 as “Go! by Train.” It was so successful in the market that the earlier JR East app was replaced entirely with the content of the new design.

JR East's internal development team was recognized by the company for their exceptional output, and will be integral to the company's human-centered digital transformation going forward.

I didn’t start out working at an enlightened company—I started out working in the art world, in upscale art galleries, private art clubs, and various museums. My surroundings were beautiful, but I was miserable. The politics and sexism were intense. I never felt like I could speak my mind.

Luckily, I eventually landed at IDEO. For the past 10-plus years, I’ve helped create events, experiences, and rituals that keep our studio culture healthy and our designers happy. Now, I’m Co-Director of the experience team in Chicago. Our mission: Design for belonging.

My team and I use tools like our studio space, food, events, experiences, and rituals to help make everyone who comes through our doors feel welcome, supported, and empowered to do the best work of their lives. We do things like throw spur-of-the moment pop-ups that break up the afternoon, and plan group lunches so people will eat together—like a family—instead of having sad lunches alone at their desks. We even plan crafting sessions and inspirational field trips.

Not convinced that thoughtful extras like spa water and storytelling events can actually help fuel the ideas that drive revenue? Consider the case of Uber.

Remember Travis Kalanick, the former CEO?

The deposed chief executive set the tone for the company’s culture. Under him, Uber flouted local laws and criticized competitors in its quest for success. Thanks to the company’s pervasive “bro” culture, sexual harassment and discrimination were rampant. Employees were pitted against one another, and management turned a blind eye to infractions from top performers.

Contrast Kalanick’s approach to leadership and culture to Microsoft CEO Satya Nadella, who took the company’s reins in 2014. He inherited a company lacking innovation—and relevance. Microsoft’s stock performance was flat. His goal was to shift the culture from “know-it-all” to “learn-it-all.” “Microsoft’s culture had been rigid,” he wrote in his book, Hit Refresh. “Each employee had to prove that he or she was the smartest person in the room. The culture change I wanted was centered on exercising a growth mindset every day.”

Three years later, not only are employees happier, more innovative, and empathic, but the company has generated more than $250 billion in market value—more than Uber, Airbnb, Netflix, Spotify, Snapchat, and WeWork—combined.

As an experience director, I’m laser-focused on making sure employees feel safe to fail and explore, that they feel connected to others, and that they have what they need to solve problems and come up with innovative solutions. My job is to set the conditions for great work.

So how do you actually do that? Here are five ways to jump-start your company culture.

1. Define and build on your company’s cultural values

Values are the compass that an organization uses to select staff members, reward current employees, and make business decisions. If you’re just starting a company and need to define your values from scratch, Greenhouse, the company that designed the recruiting software IDEO uses, has a helpful culture mapping exercise to help get you started. Need further inspiration? Check out Google’s values: “Focus on the user and all else will follow.” “It’s best to do one thing really, really well.” “Fast is better than slow.” “Great just isn’t good enough.”

2. Leverage naturally-occurring behaviors

Put on your anthropologist hat. What interesting or unusual things are people already doing around the office that you could build on? (It’s faster and easier to build on existing behaviors than to encourage new ones.) At one company, I noticed people were wary of talking to strangers. Unfortunately, since it was a co-working space, almost everyone was a stranger. I also observed that people would use the kitchen as a shortcut to the bathroom, and that it was a neutral zone—no one group owned it. High foot traffic + no ownership = opportunity to spark casual conversation and community! You can do what I did—look for unused spaces in your own workplace and use questions on Post-it Notes to spur random conversations—or move shared resources like printers or snacks to the middle of the space instead of tucking them away in a corner.

3. Identify and empower cultural mavens

As an experience director, I’m always look for new collaborators. Though some cultural experiences can come from the top down, others work better when they come from the bottom up. They feel more authentic. I’m always trying to identify new cultural mavens within our organization, and I empower them by giving them some time, money, or resources to bring their ideas to life. For example, at IDEO, we noticed a few of our designers were natural teachers and always went out of their way to show others how to learn a new skill. This aligned perfectly with two of our company values—“Learn from Failure” and “Make Others Successful”—so we gave those designers a budget and set them free to build on their ideas. Now we regularly have Nerd Nights where people learn to code, and Shop Class where we make things like concrete planters and leather wallets.

4. Prioritize face-to-face interactions

Digital tools are efficient, sure, but the only way to build authentic, human relationships is face-to-face. Period. When you find yourself using a digital tool to communicate with an individual or a group, think: Could this be done in person instead? Am I hiding behind this tool, this emoji? Encourage others to get out from behind their screens, too. One easy way? Get people to eat their meals together.

5. Design meaningful rituals

We participate in rituals in institutions, politics, and religion all the time. But they’re not commonly talked about in the world of business, even though they’re a simple way to make cultural values tangible. At IDEO, I was part of a team that started IDEO Stories, a Moth-like live storytelling event designed to help teach our designers how to tell better project stories. After the first event, it became clear it wasn’t just a good way to learn a new skill—it was a way to celebrate an individual’s unique backstory and unite the community.

For the last seven years in Chicago, we’ve also held an Annual Studio Awards party, an Oscars-inspired evening where the community votes on award-worthy project work from the past year. Categories are tweaked each year to incentivize emerging behaviors that are beneficial to our business.

Have ideas for rituals of your own? Share them with us on Twitter, so we can inspire each other.

Often, people want to write culture off as a slew of perks you might find at tech companies. But really, culture is about creating an environment that makes it possible for people to work together to come up with innovative products and ideas—the same products and ideas that drive revenue.

We met a beer and sausage vendor in Germany who keeps an array of hats stored on his gearshift, a humorous-looking makeshift hat hook. When we asked him more about it he explained that he often sells his wares at football games, so it’s important that he wear the right football club’s hat. “One time, when I wore the wrong one by accident, they called me an ass and tipped the van over,” he said. “You always have to howl with the wolves.”

Human-centered design requires us to observe human behavior with beginner's eyes, so that we can spot the innate ways people interact with the world around them. We call these intuitive and unconscious reactions Thoughtless Acts, and IDEO designers collect photos of them to inspire their work.

You can’t beat the smell of fresh ink, the texture and weight of high-quality paper, and the sound as you flip through the pages. When holding a magazine, I’m not simply reading it—I’m immersed in it.

I asked my fellow designers which publications they find the most exciting, and I’ve included a few of my favorites, too:

1. Apartamento

Yes, I suppose it’s an interior design magazine, but instead of focusing on beautiful, minimalist, multi-million-dollar houses (not that there's anything wrong with that), Apartamento covers real, lived-in homes and the creative people who occupy them. Raw portrait photography, cluttered spaces, and intimate interviews show how people really choose to live. Based in Barcelona, Spain, it’s survived through subscription revenue and a higher newsstand price, and has bucked the trend of featuring numerous ads or sponsored content. Plus, its perfect novel size, centered layout, patterned spine, and chunky typography are delightfully raw and unfussy. —Lindsey Turner, IDEO Cambridge

2. B

B magazine is published in South Korea. Every issue, it takes an advertisement-free, documentary approach to a single iconic brand. It’s covered many amazing brands, from the luxury to the mundane, including LEGO, Ray-Ban, and Bic. Each issue goes deep into the people, history, evolution, products, experiences, and philosophies of the brand it covers. Fans and collectors are also often included. I recommend it to anyone who likes branding and brand strategy, or just loves products and design. The many ways it looks at a brand and all its expressions goes far beyond simple identity and logo. —Clark Scheffy, IDEO San Francisco

3. Banana

In 2014, first generation Asian-Americans Vicky Ho and Kathleen Tso launched Banana magazine, a lifestyle magazine dedicated to exploring the intersection of Eastern and Western cultures. Ho and Tso are not claiming to be experts in Asian culture, but rather are discovering it right alongside their readers. Their goal is to understand what this third identity—neither Asian nor American, but Asian-American—means. As a designer, I think it’s fascinating to understand how cultures can blend together. With the growing influence of Asian countries on design trends, this magazine is relevant, vibrant, and bold, and offers great graphic design inspiration. —Coline Prevost, IDEO Palo Alto

4. [BranD]

[BranD] is a Hong Kong-based magazine that explores communication design in visual art, advertising, products, graphic design, and architecture. It brings together designers, artists, art directors, marketing specialists, and business-minded people of all stripes to share new ways to express ideas and brands visually. I'm an avid reader of [BranD] for inspiration in my craft; it's a great vehicle to stay connected to the ways other designers are stretching their own skills and building their crafts in a discipline—comms design—that is always evolving. —Joshua Lavra, IDEO San Francisco

5. Cat People

Cat People is an English-Japanese bilingual magazine featuring interviews and works by cat-obsessed artists, designers, photographers, and writers. It’s only in its first issue, but it’s already sold out. I’m very excited for future editions because this magazine promises magnificent inspiration for design and feline die-hards (like me). —Camden Foley, IDEO Palo Alto

6. Cereal

Cereal is a biannual travel and style magazine based in the United Kingdom. Each issue highlights engaging interviews and stories about unique design, art, and fashion on a specific theme, such as sustainability or desire. I’ve followed this magazine since its inception in 2016 and have every issue to date. Cereal’s publisher offers beautiful magazines, city guides, art prints, and even a children’s book—all with some of the best photography and design I’ve ever seen. —Camden Foley, IDEO Palo Alto

7. The Collective Quarterly

The Collective Quarterly is a magazine about travel and creativity across the U.S. The magazine staff—a rotating team of writers, photographers, illustrators, and other creatives—visits small towns or regions around the country to interview artists, creators, and other cornerstones of local life. As a photographer, the exceptional photography caught my eye, particularly that of one of the co-founders, who still shoots film photos like I do. It’s inspired me to get out with my camera more often. I recommend the magazine to anyone who seeks a deeper appreciation of creativity in intimate communities, hopes to explore non-urban corners of the country, or wants to bask in the magic of film photos. —Tara Safaie, IDEO San Francisco

8. Drift

Back when I was a barista, my mornings were spent adjusting the espresso machine's grind and my tamp to each bean's age and provenance. I learned that coffee is ubiquitous, yet highly circumstantial; you can find it in virtually any city, and yet each urban environment and its inhabitants have radically different rituals, cultures, and methods of consumption for this most essential drink. Drift transports its readers to different cities and their respective coffee cultures, allowing readers to intimately engage with new adventures in new places through a common cup of joe. —Adam Cristobal, IDEO Palo Alto

9. The Gourmand

As we reach the peak of our food media zeitgeist, The Gourmand has emerged as one of the leading alternative voices in the space, covering everything from new ways of visualizing food emoji to Georgia O'Keeffe's strict diet. Boasting both witty writing and distinct art direction, the magazine offers a unique perspective and inspirational fodder to foodies, designers, and creatives of all stripes as we look for more visually appetizing ways to engage with the world. —Adam Cristobal, IDEO Palo Alto

10. Offscreen

Offscreen is a print magazine published three times a year, as well as a weekly newsletter, that takes a thoughtful, human-centred approach to technology. It’s is a slow counterbalance to the fast pace of popular media, exploring creativity and design through introspective writing and thoughtful human stories. Offscreen is a proponent of the “slow web,” celebrating the idea that not all that is instant and convenient is necessarily good for us. —Nathan Paterson, IDEO Tokyo

11. Surface

Surface is a New York magazine that covers a little of everything—design, architecture, fashion, culture, and travel. I picked it up because I judge magazines by their covers. Each cover features a great close-up portrait of a creative person—an architect, musician, industrial designer, etc. The portrait is paired with restrained, Swiss-style black typography and a grid well versed in white space. The magazine examines culture through the lens of design and has a whiff of one of my favorite blogs, Sight Unseen. It's conspicuous consumption for sure, but sometimes that's what magazines are for. —Lindsey Turner, IDEO Cambridge

Next time you want to explore cutting-edge design—or just enjoy a little eye candy—crack the cover of one of these magazines for an inspiring read.

‍

Thanks to the digital revolution, fewer and fewer of us are getting our hands on paper copies of books, magazines, or newspapers these days. Online subscriptions and digital versions can fill the void, but sometimes, picking up a glossy magazine is simply the best way to absorb inspiration.

As a data scientist, this idea got my gears turning: What if I could use machine learning to build a laugh-detecting algorithm?

Prototyping is a great way to explore how emerging technologies will play a role in our connected future. But instead of focusing on how we will teach our machines to sense human behavior, I’m interested in designing what we will do with the information our devices are learning. In a world filled with machines that learn and interact with us, it’s important that they are able to respond to all parts of our humanity—including the things that make us laugh.

I wanted to see what kind of laugh detection prototype I could build in a few weeks. Here’s how I did it:

1. Building the algorithm

To build the laugh-detecting algorithm, I knew that I wanted to use deep learning, so I turned to Keras, a programming library which makes creating neural networks fast and simple. To train the laugh detector, I needed to use sequences of audio as the input and predict whether or not laughter would result as the output. Fortunately, I found Audioset, a collection of over two million 10-second audio clips with labels from over 6,000 categories. Using a subset of the Audioset collection that is half laughter and half speech, I was able to get a laughter detection model running with 87 percent accuracy within a few days.

After creating a training dataset, I got started on the machine learning challenge. The Audioset data does not contain the extracted raw audio, only a 128-length feature vector for each second of input, which is created using a convolutional network operating on the raw audio spectrogram. These feature vectors will be the input for the machine learning algorithm, and the output will be a binary label of whether the input contained laughter. Since I am working with a relatively large dataset, I wanted to use some deep learning methods, so I turned to keras, an API that makes creating and training neural networks extremely simple, while still leveraging the computational efficiency of optimized tensor computation libraries like TensorFlow and Theano.

Since the model input is sequential, I wanted to try a recurrent neural network first. I started with a single layer LSTM model that quickly converged to 87% accuracy. Learning from the code in a very similar project, I found that applying batch normalization to the LSTM input was very important for getting the model to converge. One of the headaches of deep learning is that seemingly trivial details like this can have a large impact on convergence. I was happy with the performance of my first LSTM model, but I decided to try out a couple more options before moving on. I tried a 3-layer LSTM (because if one layer is good, three must be better), then I tried a simple logistic regression model to see if the fancy RNN architecture made a difference. The models performed with 88% and 86% accuracy, respectively, which showed me that, in this case, more layers did not equate to more power.

Ultimately, I ended up choosing the single layer LSTM, even though it was larger than the logistic regression model, because it was able to handle variable length input. The training data was all sequences that were 10 seconds long, but I wanted the laughter detector to be able to respond quicker than that. While the logistic regression could only operate on input that was the same length as the training data, the LSTM model can still operate on any input length, as long as it is split into one-second chunks.

To take the trained model and run it as a live laugh detector, I put together a python script that pulled together a few different steps. First, the audio is captured from the microphone using pyaudio and chunked into three-second clips. (The length of these clips is an adjustable parameter.) The raw audio is then fed into the pre-trained vggish network and converted to a sequence of feature vectors with the same parameters I used for creating the Audioset training data. The sequence is then fed into the trained LSTM model, and the laughter prediction score is returned and written to a timestamped .csv file. By default, the raw audio is then discarded, and only the score is saved. That way, there are no concerns about storing or transmitting anyone’s private conversations. By running the audio capture and processing in separate threads, I was able to run this continuously without any lag on my laptop.

2. Designing the experience

Once I had the ability to measure laughter, I had to tackle the real design challenge: How do we implement the laugh detector in project spaces without making it seem obnoxious or creepy?

I enlisted the help of a few smart colleagues to approach the challenge from multiple angles: a software designer experienced in designing for play, an environments designer to explore how the detector would show up in a project space, and a communication designer who’s written on the science of laughter.

We had a brainstorm around what we might be able to do with a laughter detector, and the ideas poured in. Perhaps we could use laughter as a weekly indicator of morale (similar to Bhutan’s gross national happiness), or host a competition between project teams for who laughed the most? If we could determine when people are laughing, maybe we could figure out why they are laughing, too. We could determine when laughter is genuine or just polite, which jokes are the funniest, or even measure who is laughed at the most.

Some of the more wild ideas included a gif of an IDEO Chicago director Jon Wettersten (below) who laughs along with us, or an alert that would play videos of clowns if we went too long without laughing.

Ultimately, we wanted to select ideas that would give teams insight into their laughter, but not be too intrusive or prescriptive.

Information systems shouldn’t overwhelm users—particularly when that information concerns people’s moods. There are times when it’s appropriate to not be laughing; you don’t want your smartwatch telling you to laugh more during your grandma’s funeral. And if we were to build a device that listens for laughter, we'd need to make sure that we communicate and maintain people’s expectations of privacy.

With all this in mind, we narrowed it down to two concepts that we would take forward into the prototyping phase.

3. Hatching prototypes

The first thing we made was a simple information dashboard built in Dash. We referred to this design as a “FitBit for laughter,” as it was meant to help teams set goals and measure their progress towards those goals.

This raised the the question, what if you could track your emotional health in the same way that you tracked your physical health? What kind of goals would you set? What would your “laughter workout” look like?

To start, we measured laughs by time of day over a period of 24 hours, laughs per day over the past week, and how close teams are to achieving a daily “laugh quota.”

The second prototype used the output of the laugh detector to control the color and intensity of a Hue lightbulb. When there is a lot of laughter in a room, the light glows a bright yellow to mirror the warmth that laughter brings to a space. When there is less laughter, it transitions to a dim blue to help teams stay calm and focused. In this way, the environment responds to the activities and emotion of its inhabitants.

What if the smart systems we create could react not only to a user’s presence or interaction, but adapt to the user’s mood? How might we design smart systems or spaces that are emotionally responsive?

4. User testing

We wanted to see how people would react to the laugh-bulb, so we got a few colleagues to sit down and test it out. The original plan was to play funny videos to stimulate laughter, but as soon as people sat down, they started joking so much, the videos were unnecessary.

Laughter is a reinforcing behavior; when you laugh, the people around you laugh too, creating a virtuous cycle that can leave you laughing until you’re sore. Seeing the light grow brighter as the room fills with laughter adds energy to that cycle. The group that came in to test the laugh-bulb ended up laughing so much that you could hear them throughout the studio.

WATCH: Testing the laugh-bulb prototype.

Next up, I’d love to put these prototypes in front of more people to see whether quantifying laughter can affect their mood. And I'm left wondering, which emotional or mental health signals could be measured and recorded next?

As more aspects of our lives are recorded, we are going to be able to quantify and improve our lives in ways we can’t yet imagine. Let’s design these systems not just to make us smarter, but to make us more joyful, too.

Play goes hand in hand with innovation. I learned this from Brendan Boyle, director of IDEO's Play Lab, who says that if you measure the amount of laughter in a project space, the teams who chuckle most are also the most successful.

I help organizations cut through complexity by shaping how they show up, through brand strategy, identity, and storytelling.

Working at the intersection of brand and business, I bring an editorial eye and a bias toward making—turning ideas into tangible experiences that people can understand, trust, and believe in.

My work spans government, healthcare, financial services, media, and consumer goods, from launching Gen Z-focused ventures to building innovation labs and reimagining legacy brands. I relish moments of ambiguity and enjoy translating across teams, perspectives, and priorities to move ideas forward.

I started my career in editorial and digital design, shaping cross-platform experiences and identity systems in publishing and agency environments. That foundation still shapes how I work today: I’m detail-oriented, collaborative, and overreliant on the Oxford comma. I hold a BFA in Visual Communication from the School of the Art Institute of Chicago.

For 25 years, I've asked the same question: Who does this design exclude—and what are we going to do about it?

My work spans human-centered strategy, inclusive design, and qualitative research, with clients ranging from Microsoft, Google, and Verizon to the National Science Foundation, and San Francisco Unified School District.

Before IDEO, I taught elementary school in East Palo Alto and spent a decade doing design work with social service organizations—where I learned firsthand what it costs people when systems are built without them in mind.

I am currently writing User Error, a nonfiction book about digital access and the design decisions behind it. I live in Oakland, California.

‍

My expertise spans brand, communication, and product design across tech, education, the arts, and social impact.

I believe great work demands both high-level vision and obsessive attention to detail, and only happens through collaboration.

I bring an inclusive, hands-on approach and a deep understanding of business, which enables me to consistently deliver excellence while always asking why.

Before joining IDEO, I worked at the brand firms Pentagram and VSA Partners. I began my career as a designer, leading teams at the School of the Art Institute of Chicago and the Milwaukee Art Museum. I hold an MFA in graphic design from Maryland Institute College of Art and a BFA in communication design from the Milwaukee Institute of Art & Design, and have taught at some of the best design schools in the US.

I am responsible for IDEO’s long-term success in China and working with clients to use design as a tool to enable growth. Specifically, I have helped Chinese companies design holistic brand solutions through the development of their products, communication, services, and innovation teams, and I have helped multinationals expand their presence and influence in China.

I advise global leaders on developing China-led innovation and capabilities.

In over 15 years in IDEO Shanghai, I have worked on projects that use design to elevate the quality of the experience of healthcare products and services, streamline processes that increase productivity, create spaces and programs that promote and enable inclusive communities, and build next generation mobility solutions that are planet-positive.

Before joining IDEO, I worked at Philips Electronics and the Electrolux Group in Italy, the Netherlands, and Singapore on a number of breakthrough commercial products. I am a member of the Young President Organization in Shanghai.