ORION

Objective

To explore how artificial intelligence can augment education and learning through interactions designed to improve the user’s relationship with the environment and create sustainable behavioral changes.

Solution

Our team has created ORION, an IoT assistant that is designed to help users reduce their resource consumption in the home.

Read our team’s process blog »

Duration
Five month long class project

Team
Adrian Galvin, Laura Rodriguez-Eng, Mary Tsai

Tools
Adobe Photoshop, Illustrator, XD, Keynote

What’s this all about?

Human impact on the environment increases climate change and leads to the depletion of natural resources.

Part of this problem is the lack of concrete understanding of how our personal consumption contributes to this impact.

While developing and maintaining sustainable practices is challenging, it is imperative that changes are made in our daily lifestyles.

To help achieve this, we created ORION, a home-based IoT device that is designed to facilitate positive interaction with utility data and the local environment in order to foster lasting behavioral changes.

ORION’s mission is to analyze a home’s energy and utility usage and then provide assistance to the user to not only lower their monthly bills but to reduce their utility consumption overall.

Where do we start?

To understand how to teach people, we needed to better understand how people learn. What would learning that takes place over weeks, months, or even years, look like?

Our team wanted to explore how people can participate in self-directed learning over longer periods of time. To this end, we explored principals of informal learning. We specifically focused on areas of community and social-based self-directed learning.

We determined that to be successful, it is important users have continuous interaction with a device or system in order to foster behavioral changes.

But first, we needed to better understand how people perceive the environment and their connections to it.

Our Research

Exploratory Research helped us to identify and outline the direction for this project.

We interviewed:

We also conducted an extensive literature review to broaden our understanding of relevant topics, such as:

Generative Research allowed us to gain a better understanding of how people perceive the environment and environmentally sustainable behaviors.

We held a participatory workshop for 12 users and asked them to:

We also held a diary study where participants were asked to take two daily photos of what the environment meant to them.

Read more about our workshop and diary study »

User Testing & Feedback enabled our team to evaluate which of our ideas worked and made sense to potential users.

Read more about our our evaluative research and concept development »

What did we learn?

Based on the results of our research, we deviced four design principals for ORION.

Who are we designing for?

We chose to feature a persona of a new homeowner who wants to help the environment but doesn’t know what he or she can do. This is where ORION can make a difference.

We found it unlikely that a person who doesn’t care about their environmental footprint would purchase a system such as ORION.

With ORION, we hope to leverage a user’s desire to save money on their utility bills or to help the environment in a general sense with tangible changes they can make within their home.

What does ORION do?

It Monitors Utilities

ORION will analyze user behavior through home utility readings. Air quality, while not being a traditional utility, is important to many people we spoke with and can easily be included via an air sensor.

Once ORION builds a profile for the household, it will begin to look for ways in which the homeowner can reduce his or her consumption. It will then communicate these solutions as suggestions to the user(s).

It Relates Utilities to their Sources

In order to build a connection between the user and the local environment, ORION will gradually inform the user where their electricity, natural gas, and drinking water comes from, and what affects the air quality that they breathe.

It Connects Users to Local Organizations

This final step may not occur at the same time for every user, if it happens at all. If a user is engaged with ORION and is actively seeking to reduce consumption and to learn more about the sources of natural resources,  ORION will conclude that they may be receptive to doing more, specifically participating in events of local advocacy organizations working to make a difference.

So how does ORION measure user engagement?

ORION is programmed to build a user profile by conducting a series of checks on user behavior.

If the user interacts with ORION on a frequent basis, responds to notifications, actively aims to lower their consumption, and learns about their local utility sources, then ORION will prompt the user to join a local advocacy organization. But which one?

Based on which utility the user interacts with most often, ORION will choose the relevant organization and provide the time and place for one of their events.

Long-term interaction

People are busy and have a lot demands on their time. As ORION seeks to alter behavior over longer periods of time, it became necessary to examine ways in which it might initiate interactions with the user, long after the honeymoon period has ended.

The device has multiple ways of alerting the user. These include vibration, light patterns, and sounds. The diagram above displays motivational tactics, which is the algorithm to be used to help determine what is the most effective way to request the attention of the user.

Does the he or she respond to sound but not light? ORION can learn this and use light patterns as the primary means to attract the user’s attention. If the success rate decreases over time, ORION will again test other motivational tactics on the user, such as sound or vibration.

This brings up an interesting question, how do we keep ORION from being annoying, or might the annoyance ultimately be helpful in changing the user’s behavior?

Engagement Levels

ORION does a lot. But it’s important to keep in mind that it doesn’t do everything mentioned all the time. Like a television or appliance, it has multiple modes and settings.

O1 Idle

Otherwise referred to as standby mode. The light band is can pulsate to indicate the device’s state.

02 Ambient

This mode activates when a human is detected entering the room with ORION. At this time, poetic utility visualizations begin. What they do is allow the user to glance at the device and come away with a basic sense of how each utility is performing in a matter of seconds. (More on the visualizations below)

03 Daily

When the user asks to see more detailed information, ORION projects an infographic of the day’s utility consumption onto a wall or nearby surface. The user can adjust settings, set goals to reduce their consumption, and check the progress of set goals.

04 Monthly

Also at the request of the user, the projected infographic can display monthly (or yearly, if applicable) data.

05 Volunteer

As mentioned above, when ORION considers a user to be interested in volunteering for an advocacy organization, more detailed information about that organization and its events will be displayed.

Hardware

Now that we know more about what ORION does, let’s take a look at what it is.

ORION is a small IoT device that includes technologies such as a micro projector, holographic display, proximity sensors, and an air quality sensor.

More on the Visualizations

Poetic Visualizations

Four visualizations were designed for this project. One for each of the utilities (and air quality) that ORION monitors.

Natural gas is represented by a blue flame. The flame appears larger and brighter as more gas is used.

Water is represented by a full container. As water is consumed during the course of a day, the container is depleted.

Air quality is represented by smoke. The smoke grows darker as the air quality worsens.

Electricity is represented by bolts of energy. These bolts become faster and shift in color to red as energy demands increase.

These visualizations are designed to display while a user is within visual range of the device. The goal of these visualizations is to quickly convey current consumption levels to the user with minimal interaction on their part.

Detailed Visualizations

Once the user initiates an interaction with ORION, more detailed visualizations are projected onto a nearby wall or surface.

Daily

The daily visualizations contain all of the information necessary to assist the user in understanding their daily utility usage.

A detailed list shows which appliances used a particular utility and how much of it. (2)

A map shows where the utility is sourced. (3)

The prominent feature of this screen is the visual indicator of overall daily consumption. (5)

A small bubble displays the current month’s savings. (6)

A progress bar indicates monthly progress toward a utility reduction goal. (7)

Monthly

The monthly visualizations focus on showing the user usage patterns over the month and how daily consumption fits into the larger picture.

Sources

A notification icon brings up information on utility sources. In the example above, a pop up window shows an energy plant in the Pittsburgh area, where it is, and some information on its output.

Volunteer Opportunities

Here we see information about a suggested advocacy group for the user to engage with. Information is provided relating to the group’s mission and upcoming events. (3-4)

To better help ORION suggest an organization to the user, engagement data is provided from each utility. The user can then view the percentage breakdown of their engagement with each utility. (2)

Mobile Application

The goal of the mobile app is simple, to provide the user with the same functionality and data while on the go, as ORION provides them with in their homes.

User Flow Diagram

Take a look at the user flow. It documents all the steps from opening the ORION box, on boarding, and working through all the features and steps. Below are some specific scenarios of experiences that users may encounter.

What happens when the user speaks to ORION? How does it’s artificial intelligence process their request? As shown in the diagram above, the AI will attempt to process the user query into one of several categories.

Are they asking to adjust their personal information, create or edit goals for themselves, ask about the current utility consumption of their home, find out more about volunteering, or adjust settings and preferences? If so, ORION will respond with vocal and visual indicators. If the user’s query does not fit into one of those categories, ORION may ask for more clarification.

This next diagram shows several possible user queries and  specific responses that ORION can provide. We seek to strengthen ORION’s message to users by looking back what we have learned about education:

Focus on daily activities and make the impact visible

Every response will include a vocal and visual component if possible.

Conclusion

This has been a great project to be a part of and we each learned a tremendous amount about what is involved in creating a product such as ORION.

Just as a reminder, additional information can be found on our project blog on Medium.

April 3, 2018