In 2017, IDEO acquired longtime partner Datascope and integrated the company’s data scientists and engineers. Datascope team members aren’t just passionate data scientists; they’re human-centered designers who happen to work with data, as illustrated by successful collaborations like this one:

If Procter and Gamble (P&G) were a city, it would be the size of Boulder, Colorado. The company employs more than 100,000 people in 70 countries. Its research and development team is made up of more than 20,000 specialists working across locations, languages, and areas of expertise, from cleaning chemicals to paper products to over-the-counter medications.

P&G approached Datascope to help the company connect these researchers to one another and the rest of the organization. In working with P&G leaders, Datascope found that the company needed a better way to access and leverage employee expertise. Managers routinely got requests from researchers looking to work with others in their subject areas, but didn’t know how to identify the right partners or set them up for fruitful collaboration.

Datascope gathered internal data, including unstructured research data on the scientists’ interests and who they partner with most often. The team used that information to develop two new systems that bridge the gap for P&G researchers and managers. The first is an internal search engine that lets managers quickly find and connect the right experts across P&G offices worldwide. The second is a data visualization tool that highlights subject areas ripe for more collaboration among experts and research teams, who may already be asking similar questions. This intelligent tool can surface relevant, timely information managers need to connect their teams.

P&G already had a practice of collecting information for product research, but it wasn’t until Datascope came on the scene that the company took advantage of large, multi-layered data sets and made them more intelligent, so leaders could expand P&G’s expertise through new global partnerships.

In 2017, IDEO acquired longtime partner Datascope and integrated the company’s data scientists and engineers. Datascope team members aren’t just passionate data scientists; they’re human-centered designers who happen to work with data, as illustrated by successful collaborations like this one:

The second a smartphone debuts, buyers, bloggers, and journalists begin writing comments and reviews—and users start troubleshooting. Motorola Mobility wanted to tap into this river of data, but didn’t have the right tools to collect and respond to it.

Motorola’s design, engineering, and service teams hoped to identify product problems early, address them quickly through customer support, and ultimately fix them in future releases.

So Datascope built a custom engine that aggregates and analyzes feedback from hundreds of millions of phrases and internet references, drawn from consumer sites, user forums, news coverage, social media feeds, and product reviews. The tool parses key, product-specific information and routes it to the right Motorola teams: hardware, software, connectivity, and interface design, to name a few.

The analytics and visualization engine not only studies product performance in real time, but it also uses algorithms to gauge customers’ emotional reactions: Do they like the phone or hate it? Do they have complaints? Are they recommending it to friends?

Datascope’s tool translates all this data into simplified to-dos that are sent to the correct service and repair staff before user issues can mar a product launch or even the company’s reputation. And as engineers discover more about how a phone performs in the real world, they learn how to avoid making similar mistakes in the future.

The tool proved valuable as soon as it launched in 2012: When Motorola released the RAZR M smartphone, customers had a hard time figuring out how to use wifi and voice features at the same time and lodged complaints online. The engine recognized the pattern of complaints and alerted Motorola's customer support team, which was able to post responses with clear instructions in every relevant forum, turning a potential customer satisfaction problem into a positive interaction.

Motorola continued to use the engine to address issues in later releases of the RAZR M. The advance warning made engineers’ lives easier, while better handsets and software made for a more seamless customer experience. Improvements were also evident in the RAZR M’s well-reviewed next generation, the RAZR MAXX.

Based on the tool’s success, Motorola used it to improve the company’s supply chain and product development process. And beginning in 2014, with the Moto 360 smartwatch, Datascope’s analytics engine has been used to gauge performance and public sentiment not just for new smartphones, but for Motorola Mobility’s entire line of products.

For most parents, ensuring their child’s proper nourishment is a top priority. But that’s not always easy, especially for parents on the go. Plum Organics, an organic baby food company, set out to solve that problem by providing families with pureed fruits and veggies in pouches, making it easy for them to feed their babies. Plum approached IDEO for help designing a non-pouch package that could showcase the vibrancy of the ingredients within.

By conducting research and in-person interviews with families, Plum set out to ensure that the new product was both desirable and functional for parents and their babies. By joining families in their homes, IDEO was able to gather essential insights that helped inform prototypes and the final design, like the fact that nothing can replace the feeling of making an intimate connection with a child through spoon feeding; that baby food is often wasted if a parent can’t remember how long a product has been in the fridge; that families struggle with how to spoon-feed their children on the go without making a mess, and that both parents and retailers were concerned that baby food jars don’t stack securely on shelves.

With those insights in mind, the team designed a transparent bowl that allows consumers to see the natural color of Plum’s vibrant, organic food. A resealable lid makes it easy for parents to store food between feedings, and the container includes a feature that allows them to track the day that they opened the pack to ensure that they don’t end up throwing away perfectly good food. Lastly, the new package is easily and safely stackable and includes a divot in the lid for parents to rest a spoon on, making for a much cleaner and more sanitary feeding experience.

Baby Bowls for Plum are now available at retailers nationwide and are a natural evolution for the brand, helping Plum continue to provide high-quality, organic baby food for consumers and their children, even if they’re eating on the go.

Accessing our genetic code is as easy as spitting in a tube, but how can we benefit from all that DNA data? IDEO surveyed more than 1,000 Americans about the gene sequencing services they want. "Give me things I can act on,” one respondent said. “Give me advice, action plans, apps, and tools. Information is just air until I can put it to use." As it turns out, tools that can translate our genetic information into better life choices—to improve our health, chart our family history, or even find an effective exercise routine—are hard to come by.

Inspired to organize and apply the wealth of genetic data in all of us, Helix envisioned the first online platform for products that offer insights based on a person’s unique DNA sequence. The startup’s founders approached IDEO to help them get to launch by identifying their future market segments and designing their brand and product offering.

Helix sequences all 22,000 of your genes from one saliva sample—sent in a mail-in kit—and hosts a marketplace of products developed by trusted brands and innovative developers that explore your health, ancestry, entertainment, family, fitness, and nutrition. Similar to the Apple app store, Helix lets you pay individually for the products you want and is a platform for developers to launch new offerings over time. After you've provided a DNA sample once, every product in the Helix store is made available to you on-demand. So, as new products are launched and new discoveries are made in the field of genomics, the data from your original sample is all you’ll need to keep exploring your personal genetic insights.

IDEO engaged a range of users, including early adopters of at-home genetic tests and “quantified self” enthusiasts, and surveyed potential Helix customers across the country. That qualitative and quantitative research validated Helix’s “app store” business model and provided key insights into the products people were most interested in.

Through the partnership, Helix uncovered what users need most from a genomics company:

• to prioritize the accuracy and privacy of DNA test results
• to encourage a sense of discovery and exploration of our genes
• to celebrate each individual’s unique qualities

A team of ethnographers, data scientists, and designers at IDEO helped direct the startup’s brand approach (including its name, Helix) and crafted a blueprint for how the company connects with customers and presents its product. The Helix store launched in July 2017.

Our DNA used to be a mystery—something we guessed at by observing our parents. Now, easy access to our genetic code—and the tools to truly understand it—arrives on our doorstep.

Spirit is a simulated AI, a provocation created by IDEO’s London Studio in response to a commission from the Design Museum. It asked designers and their teams—including Yves Behar of fuseproject and furniture designer Konstantin Grcic—to contribute to a project on the future of aging as a sequel to an exhibit of the same topic that they hosted 30 years earlier. The museum asked IDEO to explore what community might look like in the year 2047.

For our project, we aimed to start a dialogue about the role emerging technologies might play in the way people connect as a community. In the future, we may no longer need to drive our children to school, speak with anybody to go grocery shopping, or visit a human doctor. Technology often makes us more independent, and less reliant on human contact and support. To counter the social isolation that may arise, we developed the concept of a free and open-source social AI, a system built to foster strong and healthy communities by strengthening social bonds and keeping people active and mentally stimulated.

Creating the Exhibit

We designed the interactive part of the exhibition for three reasons: We wanted to give visitors a glimpse of what it would be like to interact with an artificial entity; we wanted to see how people would feel about the interaction; and, obviously, we like playful experimentation and prototyping.

Current AI technology is in its infancy when it comes to having a real dialogue with a human being. But just as autonomous cars learn with every mile they drive, these technologies will learn the more they interact with people. Current popular AI products (Siri, Alexa, etc.) listen to user commands and respond. We found it interesting to reverse that by having our Spirit actively ask visitors questions, and rather intimate ones, including: What makes you happiest? What would you be scared of forgetting? Would you trust an artificial intelligence to choose your friends? If you lived to 120, how many partners would you want to have?

The exhibit had two states: An idle state where visitors were encouraged to talk to Spirit and it displayed selected quotes from previous visitors and visualized the data it gathered through a generative visual design, and an interactive state.

The interactive dialogue state took place inside an audio booth. The system greeted visitors with an audiovisual message and a stylized speech-bubble that mediated the conversation. The system then asked different questions, engaging in deeper conversation over time. For example, Spirit might ask, "What makes you happiest," and the answers could vary from "rich relationships" to "when it stops raining," "playing football," or "creating new things and solving problems." Each answer created a new pebble in the visualization, the color, size, and shape of which were determined by an analysis of the length and the emotion of the response. When the visitor finished answering, the pebble merged into a sea of pebbles representing all of the interactions collected so far.

Visual interface design and data visualization by Studio Waltz Binaire

Building Spirit

The technical challenge of the exhibit was to have the system running for five weeks, seven days a week, eight hours per day. There were a lot of pieces talking to each other, and we needed to be able to track the feedback from thousands of visitors.

Spirit used a bespoke script to follow the conversations, and when the answers veered too far from what it had anticipated, it would send the answer to a chatbot API to find an appropriate answer. Unfortunately, the voice to text turned out to be not very reliable in the museum environment, so we focused on the scripted questions.

The technical setup consisted of two components: the audio booth and the large display facing it. To let Spirit know when somebody was present in the booth, we installed an Arduino with an ultrasonic sensor that communicated with an iPhone 6 via Bluetooth. The iPhone was connected to a directional microphone and a speaker.

Here is where the magic happened. On the phone, we ran a custom app. The app turned the voice into text using the Apple Speech Framework, and then analyzed the emotions in the answer using IBM Watson, an iconic AI developed by IBM, while also checking if the answer is in the pre-written script. If it wasn’t, it used another API to get an answer from the chatbot. The information about the answer and emotions was stored and sent to a custom program written in vvvv that communicated with the iPhone app via OSC.

Ambient noise was our biggest worry. It could have prevented the system from understanding visitors’ answers. Also, the position of the microphone was fixed, so reaching different visitor heights and voice volumes was a challenge. This actually proved to be a problem, as there were several interactions in which the voice was unintelligible.

The Data

One good perk of the interactive system is that we had real-time access to the data, so we could follow how well the installation and exhibition were performing, and what the audience was saying. After the exhibition ended, we found a bit more time to use Python and Pandas in the analysis, and Excel to plot the results.

We had a total of 8996 individual sessions with Spirit during the exhibition, about 10 percent of the visitors to the Design Museum.

The emotion recognition system that we used, IBM Watson, is not yet totally reliable (as an example, “yes” was considered a 100% J=joyful answer). But with the amount of data we gathered, the system was still able to give some hints about visitor moods. And the variations in mood could be correlated to external events. For example, we saw a peak in feelings of joy on the 24th, when London hit its highest temperature after a cold January.

When we looked at the answers, we discovered that they seemed more spontaneous and playful than others given via written questionnaires. They were also more honest, suggesting that for some people, sharing intimately with an AI might be less intimidating than talking to a human interviewer. Others, though, were critical and disconcerted. It became clear that it is important to start a dialogue about how we want to interact with AI in our daily lives.

Though the experiment obviously didn’t culminate in a fully-formed product to help the elderly, the interaction model helped us create the kind of AI we would need to build community and increase social interaction, and allowed us to test people’s reactions to emotional and intimate questions from an AI. The experiment also directly related to the work we do with design research. We frequently send design researchers out into the field to talk to people to learn more about their needs and habits, and how we can design solutions to fit their lives. Our work with Spirit begs the question—could even a design researcher be replaced by an artificial researcher at some point? For now, we don’t have a lot of answers, but this experiment helped us push our understanding forward, and we’re excited about the AI-driven insights that will come in the future.

In the top floor of London’s Design Museum, as dozens of visitors walk by and the rain hits the windows, a woman speaks with an AI bot called Spirit. It asks her how many partners she would like to have if she can live until she is 150. She giggles and answers. “Just one—and that is because my husband is next to me.” According to Spirit’s analytics, her answer is 33% sad and 12% joyful.

Fast forward to fall of last year. Adobe announces an update to its Lightroom iOS app that allows users to capture RAW photos using their smartphone camera. Slowly, I began experimenting with on-the-go editing techniques similar to those I’ve developed over time using Lightroom on desktop. Could the iPhone, with its tiny image sensor, actually be the magic gadget I craved?

I’ve long wanted to do a project that celebrates the diverse architecture of my adoptive city, and my newly augmented smartphone camera provided just the opportunity. So, I set out to answer my own question with a specific aesthetic in mind and a simple design constraint in place: I would use my iPhone, alone, for both photos and edits.

I have now captured and shared more than 40 photos—one each day since April 1st—and will continue to do so until the series tops out at 100 images. The constraints I held myself to and the consistency of daily publishing have allowed me to quickly refine and iterate the technique—an accidental outcome as happy as it was unforeseen.

As designers, we often yearn for carte blanche freedom to explore and create as we see fit. What we forget is that our best solutions often come from imposing limits on that freedom, and seeing what comes of it.

How I did it: all photos in the series are captured using an iPhone 6S, and all edits were performed in roughly 60 seconds using some black and white alchemy in the Color tab of Adobe’s Lightroom Mobile app for iOS.

Want to see more of Burton’s work? Check out this, a NATO & G8 protest he attended in Chicago in May of 2012. And this, the stations of the Moscow Metro he captured during a visit in the fall of 2015.

‍

When I first moved to San Francisco, I spent every free moment exploring my new locale, camera in hand, with a backpack full of lenses and a tripod. With time, however, the weight of my DSLR and pack felt more like an albatross than an accessory, and I adopted the usual photographer’s lament, yearning for a magical gadget that could output images of a quality inversely proportional to its bulk.

These days, I frame my life less as a sensible narrative with a rise and fall, and more as a series of small, densely packed moments that leave sweet and sour aftertastes. These moments are the ones I choose to draw in my sketchbooks, usually several months after they’ve actually occurred. The unimportant things, I forget. What’s left for me to draw is what matters: moments of wisdom, aged by feelings that have grown more complex and multi-dimensional over time.

Here are a few moments that have stuck with me:

Blame it on the Boba

When I first moved to San Francisco, I started dating someone—less because it made sense to date him in particular, and more because I was enamored with the idea of christening my new city with a new relationship: new city, new boy, new me! Predictably, things didn’t work out, because that’s what happens when you rush into things for the wrong reasons.

Over a year after dumping me, however, he asked me out to boba. Somehow, we ended up seeing each other again. And again, predictably, things didn’t work out. Apparently, I saw things differently the second time around. I rarely drink alcohol, but that doesn’t stop me from attributing my poor life decisions to boys touting sweet beverages.

Most People are Terrible

I met one of my best friends, Cory, over two years ago. Since meeting him, I’ve probably drawn him about ten times. A savvy reporter with a sharp tongue but a heart of gold, Cory has provided me with many invaluable nuggets of wisdom. One of the most memorable nuggets was a sobering reminder that I tend to assume the best in people too quickly.

In some cases, this just means that someone who I thought had excellent taste in clothes, music, books, or food actually doesn’t. In more serious cases, this means that I have a difficult time distinguishing charm from crazy. In any case, and particularly the latter, I keep this axiom close to my heart.

Not Assholes, Just Shibas

In 8th grade, I met a girl named Mira who is now one of my oldest and closest friends. Mira is much more charismatic and social than I am. During our younger years, I always thought were two sides of one coin: she was the outgoing and social one; I was the quiet and taciturn one.

However, a few years ago, she told me that she’s actually a total introvert. I realized two things: First, that our introversion was probably what brought us together in the first place. Second, that I had completely misunderstood one of my best friends. But that’s water under the bridge at this point. Lately, we’ve started characterizing ourselves as shiba inus, who aren’t exactly the cuddliest of dogs. But they’re not jerks, they’re just independent. Just like me and Mira.

At the end of the day, I use these moments to remind myself that I can always adapt when life doesn’t work out exactly as I expect. And if all else fails, finding humor in turbulent moments is the quickest solution for a bad day.

I’m a huge nerd. I grew up watching a lot of fantastical and post-apocalyptic anime, and I’m a former literary history student with a fondness for medieval poetry. Having spent enough time with Chaucer, Boccaccio, Satoshi Kon, and Hideaki Anno—most of whom tend to leave their audiences hanging or uncomfortable—I learned to appreciate stories with ambiguous endings. I’ve carried this same sentiment into my sketchbooks.

Imagine, for example, using parts from an eel to shock the human heart with current when it’s having a heart attack? In an exhibit called Domestic Futures at Nationalmuseum of design, Stockholm Haines showed exactly such a “product”. Goodbye defibrillating paddles, hello electric eel!

More recently, IDEO’s London studio collaborated with Haines for New Old, an exhibit at the Design Museum London. The result was “Spirit,” an AI assistant for the elderly. After working alongside Haines, we found ourselves intrigued, so we caught up with her to ask a few questions about what it means to be a budding biodesigner.

When did you first think about getting into design, and why?

When I was younger, I had many misconceptions about design that I think are still problematic today. You rarely get to see the messy, exhausting, and all-consuming guts of design work, but I think it is an incredibly engaging discipline. I got my masters in the Design Interactions department at the Royal College of Art, and am now undertaking PhD research at Transtechnology Research at Plymouth University.

Who are the designers, artists, writers, and thinkers that have influenced your work?

Noam Toran, my tutor on my MA course, offered many fascinating and unnerving threads of research, along with Tony Dunne and Fiona Raby, who promoted alternative ways of thinking. I also like Floris Kaayk (a bit of enjoyable grossness there!), who always seems to have something fascinating in progress; my close friend designer Soomi Park, who is highlighting sensitivity to emotion in artificially intelligent objects; and recently, I saw a great talk by Hyphen-labs, which probes some really important questions about design.

Tell us what you produced for the “New Old” Design Museum exhibit

For “Spirit,” I made some sculptures of potential body modifications—visualizing how a fictional company might improve sociability in the elderly. The IDEO team, including Ed White, Daniel Tauber, and Javier Soto Morras, had researched alterations that could be made to the body to send biological notifications. The work made me aware of the pressures and expectations on the elderly.

Tell us about three of your favorite projects

In 2013, I produced “Transfigurations”, which depicted babies with structural modifications. The work encouraged people to consider whether surgical procedures might offer solutions to future social and environmental problems. I think the cuteness of these sculptures made the work both disturbing and delightful. Another project, involved dissecting sculptures of anatomical parts, suggesting potential future procedures such as the removal of a cyst from a bionic eye implant. The tactile element helped this work to become a lightning rod for discussion regarding scientific research. Currently, I am developing “if you prick us do we not bleed?” about how we interact with humanoid robots by including bodily fluids. I was, of course, inspired by the famous Shylock monologue in the Merchant of Venice. “If you prick us, do we not bleed? If you tickle us, do we not laugh? If you poison us, do we not die? And if you wrong us, shall we not revenge?” .It's still a very powerful message about the mistreatment of those perceived as different.

What does it mean to use the body as a design medium?

All of my work is, of course, speculative. I don’t spend much time actually moving human material around, although I did once spend a very interesting day at a cadaver research laboratory! Instead I research the tools and materials that may have an impact on the body, or how we perceive the body. There are already disciplines that have to view the body as editable, and moving this way of thinking from a surgical or dental domain to a design or engineering one is where there is space for interesting interventions. There seems to be lots of interest in nanotechnology, and like many biotechnologies, this means there will be interactions with designs we can not see, but can perhaps feel, and maybe also artificial intelligence that may make design decisions for us.

Want to see more of Haines’ work? Find her current exhibits and talks here.

Agi Haines’ artwork isn’t easy on the eyes. But to her, it looks just like home. As the daughter of two South East London artists who met while working at Madame Tussauds wax museum, her childhood home was populated with wax heads, antique surgical tools, and sculpture scaffolds. Viewing the human body as raw material for design interventions wasn’t the stuff of some sci-fi future—it started as a family affair (her sister, Beatrice Haines caught the bug, too) and Haines has been working and speaking about it ever since.

I help organizations cut through complexity by shaping how they show up, through brand strategy, identity, and storytelling.

Working at the intersection of brand and business, I bring an editorial eye and a bias toward making—turning ideas into tangible experiences that people can understand, trust, and believe in.

My work spans government, healthcare, financial services, media, and consumer goods, from launching Gen Z-focused ventures to building innovation labs and reimagining legacy brands. I relish moments of ambiguity and enjoy translating across teams, perspectives, and priorities to move ideas forward.

I started my career in editorial and digital design, shaping cross-platform experiences and identity systems in publishing and agency environments. That foundation still shapes how I work today: I’m detail-oriented, collaborative, and overreliant on the Oxford comma. I hold a BFA in Visual Communication from the School of the Art Institute of Chicago.

For 25 years, I've asked the same question: Who does this design exclude—and what are we going to do about it?

My work spans human-centered strategy, inclusive design, and qualitative research, with clients ranging from Microsoft, Google, and Verizon to the National Science Foundation, and San Francisco Unified School District.

Before IDEO, I taught elementary school in East Palo Alto and spent a decade doing design work with social service organizations—where I learned firsthand what it costs people when systems are built without them in mind.

I am currently writing User Error, a nonfiction book about digital access and the design decisions behind it. I live in Oakland, California.

‍

My expertise spans brand, communication, and product design across tech, education, the arts, and social impact.

I believe great work demands both high-level vision and obsessive attention to detail, and only happens through collaboration.

I bring an inclusive, hands-on approach and a deep understanding of business, which enables me to consistently deliver excellence while always asking why.

Before joining IDEO, I worked at the brand firms Pentagram and VSA Partners. I began my career as a designer, leading teams at the School of the Art Institute of Chicago and the Milwaukee Art Museum. I hold an MFA in graphic design from Maryland Institute College of Art and a BFA in communication design from the Milwaukee Institute of Art & Design, and have taught at some of the best design schools in the US.

I am responsible for IDEO’s long-term success in China and working with clients to use design as a tool to enable growth. Specifically, I have helped Chinese companies design holistic brand solutions through the development of their products, communication, services, and innovation teams, and I have helped multinationals expand their presence and influence in China.

I advise global leaders on developing China-led innovation and capabilities.

In over 15 years in IDEO Shanghai, I have worked on projects that use design to elevate the quality of the experience of healthcare products and services, streamline processes that increase productivity, create spaces and programs that promote and enable inclusive communities, and build next generation mobility solutions that are planet-positive.

Before joining IDEO, I worked at Philips Electronics and the Electrolux Group in Italy, the Netherlands, and Singapore on a number of breakthrough commercial products. I am a member of the Young President Organization in Shanghai.