Building ORION

An IoT home assistant that leverages AI to facilitate sustainable behavioral change and environmental awareness.


Overview
To explore how artificial intelligence can augment education and learning through interactions designed to improve the user’s relationship with the environment and create sustainable behavioral changes.

Our team has created ORION, an IoT assistant that is designed to help users reduce their resource consumption in the home.

Role
Contributed to the project concept, running research workshops, and generating design documents. My individual efforts were focused on building the mobile concepts.

Read our process blog on Medium

Team
Adrian Galvin, Laura Rodriguez-Eng, Mary Tsai

Duration
5 months (semester-long project)


What’s this all about?

Human impact on the environment increases climate change and leads to the depletion of natural resources.

Part of this problem is the lack of concrete understanding of how our personal consumption contributes to this impact.

While developing and maintaining sustainable practices is challenging, it is imperative that changes are made in our daily lifestyles.

To help achieve this, we created ORION, a home-based IoT device that is designed to facilitate positive interaction with utility data and the local environment in order to foster lasting behavioral changes.

ORION’s mission is to analyze a home’s energy and utility usage and then provide assistance to the user to not only lower their monthly bills but to reduce their utility consumption overall.

Key Takeaways

The ORION concept is not just a device. It’s an ecosystem that’s designed to encourage users to:

  • become aware of and reduce their utility consumption
  • learn about where their energy comes from and what the environmental ramifications of their actions are
  • create positive environmental impact by changing their daily routines and behaviors
  • foster helpful community connections through activism and volunteering with local organizations

Our Process

How do People Learn?

To understand how to teach people, we needed to better understand how people learn. What would learning look like that takes place over weeks, months, or even years?

Our team wanted to explore principals of informal learning. How does participation in self-directed learning over longer periods of time affect us?

We found that for learning to be successful, continual interaction with a device or system is crucial.

But what would that learning look like in our context? We needed to better understand how people perceive the environment and their connections to it.

Our Research

Exploratory Research helped us to identify and outline the direction for this project.

We interviewed:

  • 9 experts, including university faculty members, local community activists, and administrators of environmental organizations in the Pittsburgh area.

We also conducted an extensive literature review to broaden our understanding of relevant topics, such as:

  • education and how people learn and comprehend new ideas in a social environment
  • artificial intelligence and how it is currently being used to assist students and teachers
  • local and national environmental issues and what activism groups are doing

Generative Research allowed us to gain a better understanding of how people perceive the environment and environmentally sustainable behaviors.

We held a participatory workshop for 12 users and asked them to:

  • create multiple personas, with one that helps the environment and one that doesn’t care
  • explore how the actions of their personas may help or hurt the environment
  • create a ‘magic device’ that the personas could use to improve the environment around them

We also held a diary study where participants were asked to take two daily photos of what the environment meant to them.

Read more about our workshop and diary study »

User Testing & Feedback enabled our team to evaluate which of our ideas worked and made sense to potential users.

Read more about our our evaluative research and concept development »

What did we learn?

Based on the results of our research, we deviced four design principals for ORION.

  • Focus on small scale, daily life activities. Tackling climate change or water pollution is an impossible task. But picking up trash, volunteering, or using less electricity are achievable measures for most people.
  • Make the impact visible. It’s difficult for people to correlate their behavior with an increase (or decrease) in environmental pollution. But what happens if the effects of their environmental behavior can be seen through a smaller scale, such as in their home?
  • Awareness is an empowering catalyst for behavior change. Is someone unaware that their everyday behavior harms the environment? How might their behavior change if they become conscious how their actions impact the environment?
  • Connect people’s personal values to a larger environmental context. Not everyone is concerned about the environment. But when environmental issues become connected to personal matters, such as the health and well-being of a loved one, realizations of the environment’s impact can occur.

Who are we designing for?

We chose to feature a persona of a new homeowner who wants to help the environment but doesn’t know what he or she can do. This is where ORION can make a difference.

We found it unlikely that a person who doesn’t care about their environmental footprint would purchase a system such as ORION.

With ORION, we hope to leverage a user’s desire to save money on their utility bills or to help the environment in a general sense with tangible changes they can make within their home.

What does ORION do?

It Monitors Utilities

ORION will analyze user behavior through home utility readings. Air quality, while not being a traditional utility, is important to many people we spoke with and can easily be included via an air sensor.

Once ORION builds a profile for the household, it will begin to look for ways in which the homeowner can reduce his or her consumption. It will then communicate these solutions as suggestions to the user(s).

It Relates Utilities to their Sources

In order to build a connection between the user and the local environment, ORION will gradually inform the user where their electricity, natural gas, and drinking water comes from, and what affects the air quality that they breathe.

It Connects Users to Local Organizations

This final step may not occur at the same time for every user, if it happens at all. If a user is engaged with ORION and is actively seeking to reduce consumption and to learn more about the sources of natural resources,  ORION will conclude that they may be receptive to doing more, specifically participating in events of local advocacy organizations working to make a difference.

So how does ORION measure user engagement?

ORION is programmed to build a user profile by conducting a series of checks on user behavior.

If the user interacts with ORION on a frequent basis, responds to notifications, actively aims to lower their consumption, and learns about their local utility sources, then ORION will prompt the user to join a local advocacy organization. But which one?

Based on which utility the user interacts with most often, ORION will choose the relevant organization and provide the time and place for one of their events.

Long-term interaction

People are busy and have a lot demands on their time. As ORION seeks to alter behavior over longer periods of time, it became necessary to examine ways in which it might initiate interactions with the user, long after the honeymoon period has ended.

The device has multiple ways of alerting the user. These include vibration, light patterns, and sounds. The diagram above displays motivational tactics, which is the algorithm to be used to help determine what is the most effective way to request the attention of the user.

Does the he or she respond to sound but not light? ORION can learn this and use light patterns as the primary means to attract the user’s attention. If the success rate decreases over time, ORION will again test other motivational tactics on the user, such as sound or vibration.

This brings up an interesting question, how do we keep ORION from being annoying, or might the annoyance ultimately be helpful in changing the user’s behavior?

Engagement Levels

ORION does a lot. But it’s important to keep in mind that it doesn’t do everything mentioned all the time. Like a television or appliance, it has multiple modes and settings.

O1 Idle

Otherwise referred to as standby mode. The light band is can pulsate to indicate the device’s state.

02 Ambient

This mode activates when a human is detected entering the room with ORION. At this time, poetic utility visualizations begin. What they do is allow the user to glance at the device and come away with a basic sense of how each utility is performing in a matter of seconds. (More on the visualizations below)

03 Daily

When the user asks to see more detailed information, ORION projects an infographic of the day’s utility consumption onto a wall or nearby surface. The user can adjust settings, set goals to reduce their consumption, and check the progress of set goals.

04 Monthly

Also at the request of the user, the projected infographic can display monthly (or yearly, if applicable) data.

05 Volunteer

As mentioned above, when ORION considers a user to be interested in volunteering for an advocacy organization, more detailed information about that organization and its events will be displayed.

Hardware

Now that we know more about what ORION does, let’s take a look at what it is.

ORION is a small IoT device that includes technologies such as a micro projector, holographic display, proximity sensors, and an air quality sensor.

More on the Visualizations

Poetic Visualizations

Four visualizations were designed for this project. One for each of the utilities (and air quality) that ORION monitors.

Natural gas is represented by a blue flame. The flame appears larger and brighter as more gas is used.

Water is represented by a full container. As water is consumed during the course of a day, the container is depleted.

Air quality is represented by smoke. The smoke grows darker as the air quality worsens.

Electricity is represented by bolts of energy. These bolts become faster and shift in color to red as energy demands increase.

These visualizations are designed to display while a user is within visual range of the device. The goal of these visualizations is to quickly convey current consumption levels to the user with minimal interaction on their part.

Detailed Visualizations

Once the user initiates an interaction with ORION, more detailed visualizations are projected onto a nearby wall or surface.

Daily

The daily visualizations contain all of the information necessary to assist the user in understanding their daily utility usage.

A detailed list shows which appliances used a particular utility and how much of it. (2)

A map shows where the utility is sourced. (3)

The prominent feature of this screen is the visual indicator of overall daily consumption. (5)

A small bubble displays the current month’s savings. (6)

A progress bar indicates monthly progress toward a utility reduction goal. (7)

Monthly

The monthly visualizations focus on showing the user usage patterns over the month and how daily consumption fits into the larger picture.

Sources

A notification icon brings up information on utility sources. In the example above, a pop up window shows an energy plant in the Pittsburgh area, where it is, and some information on its output.

Volunteer Opportunities

Here we see information about a suggested advocacy group for the user to engage with. Information is provided relating to the group’s mission and upcoming events. (3-4)

To better help ORION suggest an organization to the user, engagement data is provided from each utility. The user can then view the percentage breakdown of their engagement with each utility. (2)

Mobile Application

The goal of the mobile app is simple, to provide the user with the same functionality and data while on the go, as ORION provides them with in their homes.

Understanding Our Concept

User Flow Diagram

Our user flow provides an overview of the ORION concept. It’s not just a device. It’s an ecosystem that’s designed to encourage users to:

  • become aware of and reduce their utility consumption
  • learn about where their energy comes from and what the environmental ramifications of their actions are
  • create positive environmental impact by volunteering with local organizations who support the environment
  • become better connected to others in their communities

Interaction Patterns

When the user speaks to ORION, their query is categorized into one of several response types. The question, “ORION, how is my energy today?” is identified as a “Display Command” and ORION will project the appropriate visual indicators as well as provide an auditory response. If ORION does not understand the query, it may ask for additional clarification.

Sample User Conversations

Every response will include a vocal and visual component if possible.

Final Thoughts

“Focus on daily activities and make the impact visible”

This was our mantra of this project going in, and our team is proud of how we saw this through from initial concept to final proposal.

There’s a lot of information contained within ORION. Finding ways to gently nudge the user can lead us to better adoption of environmentally friendly sustainable behaviors.

And as a reminder, additional information on our process can be found on our project blog on Medium.