Nauto, a startup in the automotive industry that’s building a system to help make driving safer and smarter, approached IDEO to collaborate on the design of their latest device. It includes a proprietary dual-camera system that can be directly installed in just about any vehicle to enable safety features. Through real-time data analysis, high-definition recording, and LTE connectivity, Nauto’s device records and analyzes activity inside and outside the car, and automatically uploads information to a smart cloud.

The device can detect if drivers are distracted based on their eye and head movements, risky maneuvers such as tailgating or swerving, and dangerous environmental conditions such as unexpected obstacles. In these scenarios, the product alerts the driver through audio feedback inside the vehicle.

Over time, the data collected by Nauto reveals bigger insights and trends in driving behavior, ranging from causes of collisions to patterns in driver distraction. These insights are stored in a secure cloud platform and made accessible to both drivers and fleet managers. Drivers can benefit from Nauto’s VERA score—personalized feedback based on their driving performance—and fleet managers can gain access to a complete picture of how each of their drivers are performing across locations. Through these data-driven insights, Nauto gives drivers and fleet managers the tools to stay safe on the road.

To help launch Nauto’s device, IDEO prototyped several iterations of the product’s housing, cabling, and ergonomics, resulting in a clean aesthetic and an easy installation process for users. The engineering team also prioritized materials that would protect against extreme temperatures and sunlight exposure. Most importantly, IDEO helped design a camera device that can be seamlessly integrated into almost any model of any vehicle, greatly expanding its potential in the market.

Nauto’s latest system began rolling out to commercial fleets and strategic OEM and Insurance partners in late 2016.

Photos by Nauto.

Most people are used to watching their favorite shows whenever and wherever they want these days. But 10 years ago, that wasn’t the case. Far ahead of the curve, HBO realized the potential for carving out its own audience, and created one of the first original on-demand offerings that allowed viewers to cut the cord from cable and satellite providers. HBO came to IDEO for help in navigating the future of its audience experience that would be distinguished from cable, and would put full control in the hands of the viewer.

With special emphasis on HBO’s Video On Demand offering, IDEO began early-phase research to explore people’s experience with the media brand and found that it centered largely on the viewing of HBO shows, the most critical part of the media experience. But other important media-related activities—learning about new shows, planning to watch new shows, creating the right viewing environment, saving and sharing viewing experiences—were either underserved or controlled by HBO’s cable and satellite partners. IDEO concluded that HBO’s challenge would be to develop a media service that holistically addressed the media consumer’s entire journey and allowed subscribers to experience HBO wherever and whenever they wanted.

To demonstrate the value of the entire media consumption journey, IDEO created a comprehensive product development and user experience vision. This vision was delivered in the form of an immersive environment, built on-site at HBO, which conveyed key customer values and behaviors and presented a roadmap for building the appropriate products and services. Included in this roadmap were future scenarios and tools that invited prototyping and exploration.

"The collaboration was foundational for us, serving as our guidepost for creating more personalized on-demand and online viewer experiences. This early work influenced what would become our streaming presence—from categorization to how the products rolled out—and ultimately led us to design the next generation of user-inspired products for a more highly engaged audience," said Bernadette Aulestia, Executive Vice President of Global Distribution at HBO.

In the 10 years since the original collaboration with IDEO, HBO has pioneered the path forward for media brands by setting the standard for a world-class array of content and accompanying viewer experience model.

While the designs of most cutting tools have evolved significantly over the years, multi-tools have remained largely the same. Recognizing this gap, SOG, an established leader in the specialty knife industry, collaborated with IDEO to identify new opportunities for innovation in the multi-tool space. The teams specifically aimed to expand SOG’s offerings into a more general lifestyle category and position them as adaptable tools for people’s everyday needs.

IDEO's research and industrial design work resulted in a family of four new multi-tools known as Baton. A sleek, black, minimal design ties together the complete set of tools, whose features vary to include bottle-openers, flashlights, scissors, pens, and pliers.

Each multi-tool’s range of capabilities, combined with its slim, compact structure that looks like a pen, makes it a travel-friendly companion for the office or the great outdoors. And its intuitive design makes it easy to use for anyone, regardless of their experience with multi-tools.

SOG’s new family of multi-tools launched in January 2017.

Every year, millions of students attend career colleges with hopes of landing jobs after graduation, but many end up unemployed and in debt, evidence of a significant disconnect between the goals of the students, educators, and institutions. Administrators are tasked with getting students in the door, but not getting them to graduation and students are focused on getting a degree to secure their future employment, while employers are looking for graduates who have professional skills beyond their new degrees.

In an effort to change this failing model, the ECMC Foundation engaged IDEO to help design a radical new vision for the future of career colleges. IDEO and the ECMC Foundation sought to develop a vision that could be used as a benchmark for the sector, showcasing a student-centered educational experience with a business model that aligns students, employers, and institutions as partners in advancement.

At the heart of the student experience is extended support along the learning journey, from path-finding and job placement to ongoing career support for alumni, helping students mindfully navigate their education from matriculation through employment.

A key insight on the employer side was the need to prioritize the parallel development of students’ soft skills—like collaboration and communication styles—and hard skills, ensuring graduates are not only properly trained in the unique skills of their chosen career path, but also prepared to adapt to professional environments.

Institutional accountability became a core factor in the vision, directly linking the college system’s success to the student experience: as job placement improves, so do the school’s earnings and future enrollment rates. The final result is a student-centered educational experience and business model that aligns students and schools as true partners in a better life.

Key elements of IDEO’s recommendations are being implemented as pilot projects at Zenith Education Group—a nonprofit provider of career school training, funded by the ECMC Foundation.

Many students have the motivation to pursue higher education, but are dealing with external pressures and realities that make completion challenging.

Spirit is a simulated AI, a provocation created by IDEO’s London Studio in response to a commission from the Design Museum. It asked designers and their teams—including Yves Behar of fuseproject and furniture designer Konstantin Grcic—to contribute to a project on the future of aging as a sequel to an exhibit of the same topic that they hosted 30 years earlier. The museum asked IDEO to explore what community might look like in the year 2047.

For our project, we aimed to start a dialogue about the role emerging technologies might play in the way people connect as a community. In the future, we may no longer need to drive our children to school, speak with anybody to go grocery shopping, or visit a human doctor. Technology often makes us more independent, and less reliant on human contact and support. To counter the social isolation that may arise, we developed the concept of a free and open-source social AI, a system built to foster strong and healthy communities by strengthening social bonds and keeping people active and mentally stimulated.

Creating the Exhibit

We designed the interactive part of the exhibition for three reasons: We wanted to give visitors a glimpse of what it would be like to interact with an artificial entity; we wanted to see how people would feel about the interaction; and, obviously, we like playful experimentation and prototyping.

Current AI technology is in its infancy when it comes to having a real dialogue with a human being. But just as autonomous cars learn with every mile they drive, these technologies will learn the more they interact with people. Current popular AI products (Siri, Alexa, etc.) listen to user commands and respond. We found it interesting to reverse that by having our Spirit actively ask visitors questions, and rather intimate ones, including: What makes you happiest? What would you be scared of forgetting? Would you trust an artificial intelligence to choose your friends? If you lived to 120, how many partners would you want to have?

The exhibit had two states: An idle state where visitors were encouraged to talk to Spirit and it displayed selected quotes from previous visitors and visualized the data it gathered through a generative visual design, and an interactive state.

The interactive dialogue state took place inside an audio booth. The system greeted visitors with an audiovisual message and a stylized speech-bubble that mediated the conversation. The system then asked different questions, engaging in deeper conversation over time. For example, Spirit might ask, "What makes you happiest," and the answers could vary from "rich relationships" to "when it stops raining," "playing football," or "creating new things and solving problems." Each answer created a new pebble in the visualization, the color, size, and shape of which were determined by an analysis of the length and the emotion of the response. When the visitor finished answering, the pebble merged into a sea of pebbles representing all of the interactions collected so far.

Visual interface design and data visualization by Studio Waltz Binaire

Building Spirit

The technical challenge of the exhibit was to have the system running for five weeks, seven days a week, eight hours per day. There were a lot of pieces talking to each other, and we needed to be able to track the feedback from thousands of visitors.

Spirit used a bespoke script to follow the conversations, and when the answers veered too far from what it had anticipated, it would send the answer to a chatbot API to find an appropriate answer. Unfortunately, the voice to text turned out to be not very reliable in the museum environment, so we focused on the scripted questions.

The technical setup consisted of two components: the audio booth and the large display facing it. To let Spirit know when somebody was present in the booth, we installed an Arduino with an ultrasonic sensor that communicated with an iPhone 6 via Bluetooth. The iPhone was connected to a directional microphone and a speaker.

Here is where the magic happened. On the phone, we ran a custom app. The app turned the voice into text using the Apple Speech Framework, and then analyzed the emotions in the answer using IBM Watson, an iconic AI developed by IBM, while also checking if the answer is in the pre-written script. If it wasn’t, it used another API to get an answer from the chatbot. The information about the answer and emotions was stored and sent to a custom program written in vvvv that communicated with the iPhone app via OSC.

Ambient noise was our biggest worry. It could have prevented the system from understanding visitors’ answers. Also, the position of the microphone was fixed, so reaching different visitor heights and voice volumes was a challenge. This actually proved to be a problem, as there were several interactions in which the voice was unintelligible.

The Data

One good perk of the interactive system is that we had real-time access to the data, so we could follow how well the installation and exhibition were performing, and what the audience was saying. After the exhibition ended, we found a bit more time to use Python and Pandas in the analysis, and Excel to plot the results.

We had a total of 8996 individual sessions with Spirit during the exhibition, about 10 percent of the visitors to the Design Museum.

The emotion recognition system that we used, IBM Watson, is not yet totally reliable (as an example, “yes” was considered a 100% J=joyful answer). But with the amount of data we gathered, the system was still able to give some hints about visitor moods. And the variations in mood could be correlated to external events. For example, we saw a peak in feelings of joy on the 24th, when London hit its highest temperature after a cold January.

When we looked at the answers, we discovered that they seemed more spontaneous and playful than others given via written questionnaires. They were also more honest, suggesting that for some people, sharing intimately with an AI might be less intimidating than talking to a human interviewer. Others, though, were critical and disconcerted. It became clear that it is important to start a dialogue about how we want to interact with AI in our daily lives.

Though the experiment obviously didn’t culminate in a fully-formed product to help the elderly, the interaction model helped us create the kind of AI we would need to build community and increase social interaction, and allowed us to test people’s reactions to emotional and intimate questions from an AI. The experiment also directly related to the work we do with design research. We frequently send design researchers out into the field to talk to people to learn more about their needs and habits, and how we can design solutions to fit their lives. Our work with Spirit begs the question—could even a design researcher be replaced by an artificial researcher at some point? For now, we don’t have a lot of answers, but this experiment helped us push our understanding forward, and we’re excited about the AI-driven insights that will come in the future.

In the top floor of London’s Design Museum, as dozens of visitors walk by and the rain hits the windows, a woman speaks with an AI bot called Spirit. It asks her how many partners she would like to have if she can live until she is 150. She giggles and answers. “Just one—and that is because my husband is next to me.” According to Spirit’s analytics, her answer is 33% sad and 12% joyful.

Fast forward to fall of last year. Adobe announces an update to its Lightroom iOS app that allows users to capture RAW photos using their smartphone camera. Slowly, I began experimenting with on-the-go editing techniques similar to those I’ve developed over time using Lightroom on desktop. Could the iPhone, with its tiny image sensor, actually be the magic gadget I craved?

I’ve long wanted to do a project that celebrates the diverse architecture of my adoptive city, and my newly augmented smartphone camera provided just the opportunity. So, I set out to answer my own question with a specific aesthetic in mind and a simple design constraint in place: I would use my iPhone, alone, for both photos and edits.

I have now captured and shared more than 40 photos—one each day since April 1st—and will continue to do so until the series tops out at 100 images. The constraints I held myself to and the consistency of daily publishing have allowed me to quickly refine and iterate the technique—an accidental outcome as happy as it was unforeseen.

As designers, we often yearn for carte blanche freedom to explore and create as we see fit. What we forget is that our best solutions often come from imposing limits on that freedom, and seeing what comes of it.

How I did it: all photos in the series are captured using an iPhone 6S, and all edits were performed in roughly 60 seconds using some black and white alchemy in the Color tab of Adobe’s Lightroom Mobile app for iOS.

Want to see more of Burton’s work? Check out this, a NATO & G8 protest he attended in Chicago in May of 2012. And this, the stations of the Moscow Metro he captured during a visit in the fall of 2015.

‍

When I first moved to San Francisco, I spent every free moment exploring my new locale, camera in hand, with a backpack full of lenses and a tripod. With time, however, the weight of my DSLR and pack felt more like an albatross than an accessory, and I adopted the usual photographer’s lament, yearning for a magical gadget that could output images of a quality inversely proportional to its bulk.

These days, I frame my life less as a sensible narrative with a rise and fall, and more as a series of small, densely packed moments that leave sweet and sour aftertastes. These moments are the ones I choose to draw in my sketchbooks, usually several months after they’ve actually occurred. The unimportant things, I forget. What’s left for me to draw is what matters: moments of wisdom, aged by feelings that have grown more complex and multi-dimensional over time.

Here are a few moments that have stuck with me:

Blame it on the Boba

When I first moved to San Francisco, I started dating someone—less because it made sense to date him in particular, and more because I was enamored with the idea of christening my new city with a new relationship: new city, new boy, new me! Predictably, things didn’t work out, because that’s what happens when you rush into things for the wrong reasons.

Over a year after dumping me, however, he asked me out to boba. Somehow, we ended up seeing each other again. And again, predictably, things didn’t work out. Apparently, I saw things differently the second time around. I rarely drink alcohol, but that doesn’t stop me from attributing my poor life decisions to boys touting sweet beverages.

Most People are Terrible

I met one of my best friends, Cory, over two years ago. Since meeting him, I’ve probably drawn him about ten times. A savvy reporter with a sharp tongue but a heart of gold, Cory has provided me with many invaluable nuggets of wisdom. One of the most memorable nuggets was a sobering reminder that I tend to assume the best in people too quickly.

In some cases, this just means that someone who I thought had excellent taste in clothes, music, books, or food actually doesn’t. In more serious cases, this means that I have a difficult time distinguishing charm from crazy. In any case, and particularly the latter, I keep this axiom close to my heart.

Not Assholes, Just Shibas

In 8th grade, I met a girl named Mira who is now one of my oldest and closest friends. Mira is much more charismatic and social than I am. During our younger years, I always thought were two sides of one coin: she was the outgoing and social one; I was the quiet and taciturn one.

However, a few years ago, she told me that she’s actually a total introvert. I realized two things: First, that our introversion was probably what brought us together in the first place. Second, that I had completely misunderstood one of my best friends. But that’s water under the bridge at this point. Lately, we’ve started characterizing ourselves as shiba inus, who aren’t exactly the cuddliest of dogs. But they’re not jerks, they’re just independent. Just like me and Mira.

At the end of the day, I use these moments to remind myself that I can always adapt when life doesn’t work out exactly as I expect. And if all else fails, finding humor in turbulent moments is the quickest solution for a bad day.

I’m a huge nerd. I grew up watching a lot of fantastical and post-apocalyptic anime, and I’m a former literary history student with a fondness for medieval poetry. Having spent enough time with Chaucer, Boccaccio, Satoshi Kon, and Hideaki Anno—most of whom tend to leave their audiences hanging or uncomfortable—I learned to appreciate stories with ambiguous endings. I’ve carried this same sentiment into my sketchbooks.

Imagine, for example, using parts from an eel to shock the human heart with current when it’s having a heart attack? In an exhibit called Domestic Futures at Nationalmuseum of design, Stockholm Haines showed exactly such a “product”. Goodbye defibrillating paddles, hello electric eel!

More recently, IDEO’s London studio collaborated with Haines for New Old, an exhibit at the Design Museum London. The result was “Spirit,” an AI assistant for the elderly. After working alongside Haines, we found ourselves intrigued, so we caught up with her to ask a few questions about what it means to be a budding biodesigner.

When did you first think about getting into design, and why?

When I was younger, I had many misconceptions about design that I think are still problematic today. You rarely get to see the messy, exhausting, and all-consuming guts of design work, but I think it is an incredibly engaging discipline. I got my masters in the Design Interactions department at the Royal College of Art, and am now undertaking PhD research at Transtechnology Research at Plymouth University.

Who are the designers, artists, writers, and thinkers that have influenced your work?

Noam Toran, my tutor on my MA course, offered many fascinating and unnerving threads of research, along with Tony Dunne and Fiona Raby, who promoted alternative ways of thinking. I also like Floris Kaayk (a bit of enjoyable grossness there!), who always seems to have something fascinating in progress; my close friend designer Soomi Park, who is highlighting sensitivity to emotion in artificially intelligent objects; and recently, I saw a great talk by Hyphen-labs, which probes some really important questions about design.

Tell us what you produced for the “New Old” Design Museum exhibit

For “Spirit,” I made some sculptures of potential body modifications—visualizing how a fictional company might improve sociability in the elderly. The IDEO team, including Ed White, Daniel Tauber, and Javier Soto Morras, had researched alterations that could be made to the body to send biological notifications. The work made me aware of the pressures and expectations on the elderly.

Tell us about three of your favorite projects

In 2013, I produced “Transfigurations”, which depicted babies with structural modifications. The work encouraged people to consider whether surgical procedures might offer solutions to future social and environmental problems. I think the cuteness of these sculptures made the work both disturbing and delightful. Another project, involved dissecting sculptures of anatomical parts, suggesting potential future procedures such as the removal of a cyst from a bionic eye implant. The tactile element helped this work to become a lightning rod for discussion regarding scientific research. Currently, I am developing “if you prick us do we not bleed?” about how we interact with humanoid robots by including bodily fluids. I was, of course, inspired by the famous Shylock monologue in the Merchant of Venice. “If you prick us, do we not bleed? If you tickle us, do we not laugh? If you poison us, do we not die? And if you wrong us, shall we not revenge?” .It's still a very powerful message about the mistreatment of those perceived as different.

What does it mean to use the body as a design medium?

All of my work is, of course, speculative. I don’t spend much time actually moving human material around, although I did once spend a very interesting day at a cadaver research laboratory! Instead I research the tools and materials that may have an impact on the body, or how we perceive the body. There are already disciplines that have to view the body as editable, and moving this way of thinking from a surgical or dental domain to a design or engineering one is where there is space for interesting interventions. There seems to be lots of interest in nanotechnology, and like many biotechnologies, this means there will be interactions with designs we can not see, but can perhaps feel, and maybe also artificial intelligence that may make design decisions for us.

Want to see more of Haines’ work? Find her current exhibits and talks here.

Agi Haines’ artwork isn’t easy on the eyes. But to her, it looks just like home. As the daughter of two South East London artists who met while working at Madame Tussauds wax museum, her childhood home was populated with wax heads, antique surgical tools, and sculpture scaffolds. Viewing the human body as raw material for design interventions wasn’t the stuff of some sci-fi future—it started as a family affair (her sister, Beatrice Haines caught the bug, too) and Haines has been working and speaking about it ever since.

I help organizations cut through complexity by shaping how they show up, through brand strategy, identity, and storytelling.

Working at the intersection of brand and business, I bring an editorial eye and a bias toward making—turning ideas into tangible experiences that people can understand, trust, and believe in.

My work spans government, healthcare, financial services, media, and consumer goods, from launching Gen Z-focused ventures to building innovation labs and reimagining legacy brands. I relish moments of ambiguity and enjoy translating across teams, perspectives, and priorities to move ideas forward.

I started my career in editorial and digital design, shaping cross-platform experiences and identity systems in publishing and agency environments. That foundation still shapes how I work today: I’m detail-oriented, collaborative, and overreliant on the Oxford comma. I hold a BFA in Visual Communication from the School of the Art Institute of Chicago.

For 25 years, I've asked the same question: Who does this design exclude—and what are we going to do about it?

My work spans human-centered strategy, inclusive design, and qualitative research, with clients ranging from Microsoft, Google, and Verizon to the National Science Foundation, and San Francisco Unified School District.

Before IDEO, I taught elementary school in East Palo Alto and spent a decade doing design work with social service organizations—where I learned firsthand what it costs people when systems are built without them in mind.

I am currently writing User Error, a nonfiction book about digital access and the design decisions behind it. I live in Oakland, California.

‍

My expertise spans brand, communication, and product design across tech, education, the arts, and social impact.

I believe great work demands both high-level vision and obsessive attention to detail, and only happens through collaboration.

I bring an inclusive, hands-on approach and a deep understanding of business, which enables me to consistently deliver excellence while always asking why.

Before joining IDEO, I worked at the brand firms Pentagram and VSA Partners. I began my career as a designer, leading teams at the School of the Art Institute of Chicago and the Milwaukee Art Museum. I hold an MFA in graphic design from Maryland Institute College of Art and a BFA in communication design from the Milwaukee Institute of Art & Design, and have taught at some of the best design schools in the US.

I am responsible for IDEO’s long-term success in China and working with clients to use design as a tool to enable growth. Specifically, I have helped Chinese companies design holistic brand solutions through the development of their products, communication, services, and innovation teams, and I have helped multinationals expand their presence and influence in China.

I advise global leaders on developing China-led innovation and capabilities.

In over 15 years in IDEO Shanghai, I have worked on projects that use design to elevate the quality of the experience of healthcare products and services, streamline processes that increase productivity, create spaces and programs that promote and enable inclusive communities, and build next generation mobility solutions that are planet-positive.

Before joining IDEO, I worked at Philips Electronics and the Electrolux Group in Italy, the Netherlands, and Singapore on a number of breakthrough commercial products. I am a member of the Young President Organization in Shanghai.