Scope: 6-week long design sprint focused on designing
the new proposed features for the new MVP Launch
My Role: UX Researcher & UX Designer
Client: HVAC Company
A previous design team had already designed initial MVP core features. My role was to design and validate the additional prioritized features needed for the MVP release.
+ Design identified features for homeowners managing their thermostat to best support their home comfort
+ Validate hypothesized features and values being added to the new homeowner app experience
+ Gather feedback and insights into current processes for how homeowners manage their system for future feature planning
Usability Testing, Prototyping, UX/UI Design
To make it even easier for Homeowners to connect their thermostat for remote management, we streamlines the registration process in the app onboarding.
Homeowners receive alerts when there's an issue with their thermostat. The alerts make it easy to take action if desired.
The ability to schedule an appointment or directly contact a dealer within the app in order to get help with an alert.
Homeowners can now learn new detail about their thermostat's energy consumption and operating status. This helps them make decisions about their thermostat's usage and maintenance.
Where I joined the project
Development team takes over
Market Research &
Product Definition
Discover
Design Phase 1
Prototype
Test
Deliver
Development Handoff and Implementation
Market Research, Requirement Gathering and Feature Prioritization
The team took an agile approach to designing the app functionality using design sprints
Designing remaining features needed for MVP release
1:1 Semi-structured user-testing sessions to validate features
Refined prototyped features based on findings from test sessions
Initial MVP
Feature Sprints
Final MVP
Feature Sprint
Qualitative
User-Testing
Previous Product + Design Team
Refine Final
MVP Designs
I focused on designing and testing 4 main feature areas based on previous feature prioritization work completed before I joined.
1. Seamless Configuration
2. Service Scheduling with Alerts
3. Energy Usage + Spending
4. Monitoring Air Health
+ Better understanding of homeowners’ experience managing their thermostat remotely
+ Understand whether the newly designed features are clear and easy to understand for homeowners
+ Validate whether hypothesized features are useful and bring value to homeowners
1. Background & Current Experience of the App
2. Provide open-ended tasks related to each of the 4 main feature areas
+ Prototype review before testing
+ Interview protocol review: Testing goals and focus areas
+ Pre-determined list of users created by the client
+ 9 Homeowners who currently use the legacy app
Participants were hesitant about entering personal information because it felt unneeded for the purposes of managing their thermostat.
Most participants mentioned they would rather self-troubleshoot first, and were nervous the scheduling may not be accurate.
Some participants felt this information wasn’t useful for the app because it didn’t provide any actionable items or information to help manage their thermostat if air quality was poor.
The data visualization and design of this feature wasn’t clear to many participants. Some participants stated comfort outweighs cost and therefore wouldn’t find value in this feature to prompt them to change their thermostat settings.
App connection issues with the participants’ thermostat system are frequent, and cause the app to stop functioning. Some participants have sought other thermostat solutions as a result.
Participants have experienced receiving an overwhelming number thermostat alerts and notifications that aren’t accurate or provide them any value. This deters them from using the application.
After doing a read out of findings, I worked with the product team to prioritize changes.
Changes to the 4 features were made based on the findings, and 6 new features were designed and added to the app, based on business decisions.
+ Our Statement of Work (SOW)
+ Project & Contract Timeline
+ Quick Wins (High-impact, low-effort)
Changes to the 4 features were made made based on the findings, and 6 new features were designed to the app based on business decisions. Over 100 new screens were designed and handed over to the new development team.
Before
After
Simplified seamless integration flow in onboarding. Updated language of notifications that new users can opt-in to sharing their systems data if they want.
Before
After
Simplified seamless integration flow in onboarding. Updated language of notifications that new users can opt-in to sharing their systems data if they want.
Before
After
Simplified seamless integration flow in onboarding. Updated language of notifications that new users can opt-in to sharing their systems data if they want.
Before
After
Simplified seamless integration flow in onboarding. Updated language of notifications that new users can opt-in to sharing their systems data if they want.
Lack of Requirements: The client had a list of high-level features, but there was little information about the details.
I leveraged best practices found in other apps to help information key interactions and feature design. I planned to evaluate overall effectiveness, clarity and ease of use in the usability study.
Previous MVP features had not been tested. After investigating the file, I noticed many UX gaps in the design.
Unfortunately, changing the original features was out of scope for my work. I made sure to raise concerns to the Product Owner. This emphasized the importance of thoroughly designing original features before piling on new ones.
User testing and my analysis of the design revealed many feature gaps that the Product Owner wanted added to the design, but that we didn’t have time or budget to design.
I created a backlog list of all the design changes potentially needed and used this to communicate with the Product Owner and team about what changes we were prioritizing. This allowed us to clearly communicate and prioritize the most critical changes given the constraints we had.
Quick Iterative designs were completed for this phase of work that give homeowners value
+ Gathered feedback on whether the new features were meeting homeowners’ needs
+ Provided recommendations, and completed iterative design changes to improve the overall value provided to homeowners in the short timeframe
Insights to help drive next phases of work to improve overall customer satisfaction & retention
+ Identified pain points in the current experience to ensure the business can mitigate this in the new app
+ Provided insights about what current homeowners find valuable, which the product team can use to drive decisions for future state priorities and feature roadmaps
Next steps recommendations to help guide the team in the next design sprint & future work
+ Conduct a usability study on the previous design work that wasn’t studied in this sprint
+ Investigate which critical and routine alerts homeowners receive and how we can make sure they only see understandable, actionable alerts
+ Conduct a usability study on additional updated and newly added features
+ Usability study on initial MVP features already designed before adding additional features. Some of the initial features, including Homeowners setting temperature schedules for their homes, were not tested by the previous teams. Usability issues with these features are critical to catch before implementing the second found features.
+ Follow-up co-design workshop with Homeowners. and allow for more time to make design changes. There was limited time to ideate and iterated on potential solutions.
+ Stakeholder priority workshop before starting this phase of work. During the project the stakeholders had a laundry list of features they wanted to add, but didn't have a clear priority. The workshop could have level-set on the what and why is most important for this next phase.
+ Qualitative user testing can provide valuable feedback to the business to help shape next steps of a product's roadmap. However, it's still important the organization takes this into consideration and has a broader strategy for prioritizing features.
+ The importance of level-setting on scope before, during and after testing session with stakeholders. Especially with stakeholders who are new to UX, it can be overwhelming if the design team is given full responsibility to make scoping decisions.
+ Users’ previous experience with a product can greatly impact future perceptions and attitudes towards the business.