SocialSense AI

EVENT: Protothon Design Hackathon 2023

TIMELINE & TEAM: 36 hours, 5 UX Designers

PLACING: 3rd in AI Track

ROLES: UX/UI Design, UX Research

INTRODUCTION

Problem

Individuals who struggle with interpersonal communication, particularly those on the autism spectrum, face challenges in forming relationships in social situations.

Traditional methods of support, such as therapy, may be difficult to access due to a shortage of mental health workers. However, AI technology can serve as a useful tool for these individuals to practice these skills in a safe space

Project Overview

This tool was created as a project for the 2023 Protothon, a 36 hour long hackathon hosted  by Dubstech and Design Buddies. We designed SocialSense, an experience that would pair a personalized AI buddy with our users and help our them practice their social skills in a friendly and motivating space.

The Solution

Personalized experience

A digital AI buddy that users can access at home and customize their social skills needs and goals.

Social skills simulator

A platform that features social scenarios users can practice with their AI buddy in a safe environment.

Feedback that inspires growth

The digital AI buddy celebrates our user’s wins and offers encouraging feedback on ways to improve for next time.

RESEARCH

In 2023, the CDC reported that approximately 1 in 36 children in the U.S. is diagnosed with an autism spectrum disorder according to 2020 data.

Those with autism often struggle with social interactions and experience anxiety when faced with changes in their routine.

Autism-associated health problems extend across the lifespan. However, young people are less likely to receive transition support.

Research demonstrates that job and training activities that encourage independence reduce autism symptoms and increase daily living skills.

Key Findings

Research shows that social skills training can help enhance participation in the community and support outcomes like happiness and friendships.

Social stories are a beneficial method for reducing a targeted problem behavior, but existing applications fail to use AI

1:1 Social skills training has a direct correlation in build confidence for real world situations

Previous studies have emphasized the effectiveness of video-modeling classes in fostering social skills

Challenges and Assumptions

Due to the time constraint of 36 hours, our team needed to make certain assumptions and prioritize challenges

  • Product Value: People with ASD will benefit from opportunities for social connections.

  • AI Capabilities: We assume AI correctly processes audio input.

  • Target Audience: Teenagers tend to struggle with self-identity and social interactions.

ASSUMPTIONS:

  • Privacy and Security: Build a platform that is safe and trustworthy.

  • Inclusivity: accessible for people with different disabilities.

  • Friendly Interface: Create a balance between simplicity and meaningful learning experiences

CHALLENGES:

DEFINE

Meet Kristen

Kristin is a 16 year old in high school on the autism spectrum who struggles to connect with peers. They lack social skills but want to improve at their own pace without having to express their insecurities to another person.

Kristen’s Pain Points

Kristen’s Needs

How might we use technology to simulate social situations and help people build confidence with their communication skills?

DESIGN

Action Priority Matrix

We created an action priority matrix to focus in on our ideas collected at the end of our brainstorming session and determine which solutions would be most impactful and feasible

Our Solutions

  • AI coach that trains individuals for various social situations and provides feedback on their performance.

  • An onboarding feature that collects data on users social skill needs and goals.

  • A platform that generates various social scenarios for a user to practice communication skills.

Brand Style Guide

We wanted our brand to be feel approachable, friendly, and inclusive of all users as we created a simulated safe space for those that need it. We chose green to promote and calm and happy mood for our users, and a modern and widely accessible font, Poppins. Our customized logo was designed to represent a friendly conversation between our AI buddy and the user

REFLECTIONS

Conclusion

This was the 1st time I participated in a design-based hackathon...and our team, The Banh Mi & Baguette Brigade 🥖 placed 3rd out of over a dozen teams in the Artificial Intelligence track! 🏆

Thank you to my Designlab buddies Dominika, Andrew, Nami, and Rochelle for being wonderful teammates. It was a challenge to design within 36 hours but it was an enlightening and productive experience in learning to apply my design skills into an impactful product and design team. Everyone brought their A-game and I'm proud of what we produced together 🙌  And shoutout to DubsTech and Design Buddies for hosting an awesome event!

Opportunites for Growth

  • If we had the time, I would be interested in conducting user interviews and usability tests with our target audience to have been able to make more data driven decisions and then iterate based on feedback

  • This was a great exercise in working with other designers and learning how to utilize each of our unique strengths to optimize our group efficiency. I felt like I was able to use my project management skills to keep the group on track while contributing as a designer as well. I’m looking forward to hopping onto projects with teammates from diverse backgrounds to create even more exciting experiences