Project Summary
Role: Lead UX Researcher
Methodologies: Survey and User Interviews
The Story:
- The Challenge: Obtaining speech therapy services from the department of education should be pretty straightforward, but in reality it’s a convoluted nightmare. We needed to connect with parents who’ve lived through this process to better understand the problem and design a solution. But parents of children with disabilities are overwhelmed, tired, and weary of people trying to do research on them and sell them solutions, so they weren’t eager to chat with us.
- The Solution: Through secondary research, we realized that many of these parents were part of communities with trusted leaders, so I had the idea of reaching out to the leaders to share our mission and purpose, to build trust and open the door to community partnerships.
- The Impact: With these partnerships in place, we were able to connect with a diverse set of caregivers and parent advocates who provided rich insights that we were able to share with our team in order to build two new products for Inclusive, and ultimately, for the parents themselves.
Case Study
‣
📓 Context + Leadership Priorities
Context
- Inclusive is an organization that provides resources for caregivers of children with intellectual and developmental disabilities (I/DD).
- Target user: Caregiver of a child with I/DD who has sought speech therapy through the DOE (Department of Education) in New York City.
- Timeline: 4 weeks to complete comparative analysis, survey, and user interviews
Leadership Priorities
- Fill the need-gap: Caregivers need an efficient way to obtain services such as speech therapy for their children with disabilities.
- Build trust: We want caregivers to trust Inclusive as a reliable source for disability resources.
‣
❓ Research Goals, Assumptions + Research Questions
Research Goal
- Objective: to obtain the information needed to begin the development of two new products for Inclusive:
- Guide to Services: A tool to help caregivers navigate the process of obtaining disability services for their child
- Resource Directory: A search tool for resources such as therapeutic providers and classes
Assumptions
- Caregivers have difficulty selecting a speech therapist for their child because accurate information about speech therapists is difficult to locate.
- Caregivers do not have adequate support in navigating the complex process of securing services such as speech therapy for their child.
Research Questions
- What are the criteria used by caregivers when choosing a speech therapist for their child?
- What search terms/filters would be relevant in their search?
- What qualities are important in a speech therapist?
- What is the current process by which caregivers obtain speech therapy services for their child?
- What obstacles did they have to overcome?
- What needs were not met adequately?
- What were their greatest supports or resources in their journey?
‣
🛠 Teams, Tools + Ownership
Team Structure:
- My role: Team lead for the research team, leading four researchers
- Inclusive is comprised of a number of pods. The pod I was working with included a project lead, project strategy team, content team, and design team, all of whom worked directly with the research team.
Research tools:
- Notion for documentation and collaboration
- FigJam for comparative analysis
- Google Forms + Sheets for survey
- Vowel for user interviews
- Figma for collaboration with the design and content teams
Research owned:
- Kickoff documents and research plan document - to document the research and refer to it as a guide for our team and as a northern light for our overall goals.
- Competitive audit and analysis - to understand the current landscape of disability resources for caregivers and identify best practices for searchable databases as a baseline for our new designs.
- Survey creation, distribution, synthesis and analysis - to answer research questions best suited to quantitative research. The survey also doubled as a screener for user interviews.
- User interviews - discussion guide, thematic analysis, synthesis - to gain insights in regards to the present user experience and needs so that they can be translated into product designs.
‣
🪜 Methods and Process
User recruitment:
- Our target user was highly specific, and as it turned out, very challenging to reach.
- The research team initially reached out through social media, targeting regional parent groups. Our initial survey response was very weak.
- Our CEO had warned us that these caregivers are very busy, skeptical of studies, and difficult to get a response from. Determined to reach our target user, I decided that we needed to be more strategic and find a way to build trust and connect.
- I gathered my team to identify leaders of support groups, care coordinators, and parent advocates within the NYC disability community. We reached out to these folks to share our mission and ask for their help in gathering participants.
- This new outreach strategy resulted in important community partnerships which will impact future Inclusive projects and led to success in user recruitment.
Survey:
- Planning - First, we aligned with the content and design teams on questions-to-be-answered in this phase of research. Then, I led the research team in co-creating the survey.
- Distribution - The research team split up the work of distributing the survey and keeping track of responses to ensure that there weren’t any issues with the survey and that we were meeting our targets.
- Analysis - The research team closed the survey and met to analyze the results collaboratively.
- Synthesis and sharing insights - Results were synthesized and reported in two ways: Presentation during company-wide sprint demo and written report for content and design team use.
Planning User Interviews:
- Before conducting the survey, the research team had outlined questions-to-be-answered based on input from the content and design teams
- After the survey we examined the remaining questions, and considered their potential impact in product development. We then began drafting our research plan for user interviews, in which defined the questions that we would attempt to answer in interviews.
- After confirming these questions with the design and content team leads, I led a meeting with the research team in which we drafted our discussion guide.
- We decided to keep the interviews semi-structured, because we still needed to ask open ended questions about the journey towards obtaining speech therapy services to better understand pain points our product might solve and supports our product might emulate or improve upon. We also included a few optional closed questions get details on the search process for a speech therapist in case it didn’t come up naturally in the conversation.
Conducting User Interviews:
- The research team reached out to a socioeconomically diverse set of survey respondents to schedule interviews.
- We aimed to complete 5 caregiver interviews because we only had one highly specific user segment. We also interviewed two disability care coordinators on recommendation of our CEO.
- Interviews were conducted remotely via video chat, with rotating teams of two researchers- one interviewer and one note taker. Bite-sized team debriefings after each session.
- Video recordings, transcripts, and initial notes were examined and synthesized into detailed session notes.
- The research team met to conduct a collaborative thematic analysis of the interviews. We then synthesized these themes into key insights.
- Themes and key insights were presented at company sprint demo. Reports were created for the content and design teams.
‣
🗒 Research Artifacts + Learnings
‣
Learnings:
High-level overview of some of our most important learnings from the survey and interviews
From Surveys:
- Most important criteria in choosing a speech therapist:
- Insurance accepted
- Years in practice
- Ages services
- Areas of specialization
- Top resources in obtaining disability services:
- 72% Other caregivers (in person or online support groups)
- 29% Service coordinators
- 23% Teachers and other school staff
- 19% Care providers such as neurologists, neuropsychologists, social workers
- Greatest unmet need in journey:
- Most respondents described the need for some type of assistance navigating the complex system of obtaining services, such as a guide, or care coordination system.
“If it was a one-stop-shop, it would have to include, you know, that amount of ease. We have money to pay for all of [these services], but by the time we find the service, get it into the budget, and then pay for it, we might as well have done it all ourselves.” (from user interviews)
From Interviews:
- Our users are very busy managing their child's care:
- Researching and locating providers
- Scheduling and communicating with providers
- Dealing with bureaucratic processes
- Going to classes and appointments
- Advocating for their child in a variety of settings
- About the process of obtaining speech therapy:
- Obtaining a diagnosis and a referral for speech assessment are pre-requisites and significant obstacles to obtaining speech therapy
- Families often need to switch schools or get a DOE voucher for providers outside of school if their school can't provide speech therapy
- The list of SLP providers provided by the DOE is an outdated PDF, which does not provide needed details. Caregivers often get no response when reaching out via the contact info on the list.
- Even if the school does provide speech therapy, it may not be frequent enough to meet the child's needs. Or the therapist may cover certain areas of speech therapy and not others.
- Most families with disabled children obtain speech therapy services before elementary school through Early Intervention (age 0-3) or CPSE (age 3-5)
‣
Journey Map:
Based on both primary and secondary research we created this journey map, to aid in the design of the “Guide to Services” product:
‣
🎯 Final Results + Impact
Impact
Based on survey results...
- The product strategy team was able to confirm the need-gap for both of our products
- The design and content teams were able to:
- choose filter categories for the therapist search function
- confirm the assumption that reviews were desired
- better understand user pain points and needs
- better understand the current user journey
- The research team gained a better understanding of what questions to ask in user interviews
Ongoing impact…
- Many of the insights we uncovered about our users and their journeys will be useful not just for these two new products, but also for the development of previous and future Inclusive projects
- Interviewees offered feedback about features they would find useful, based on their past experience, such as:
- Access to important forms
- A place to connect with other parents of children with I/DD to share resources and stories
- Information on non-provider resources such as classes and social skills groups
Influencing Content and Design
Our findings from both the survey and interviews allowed the content and design teams to create prototypes for both the Guide to Services and Resource Directory, based on an in depth understanding of the user journey.
Resource Directory
Guide to Services
‣
🪞 Reflection
- Learning to Lead: Though this was neither my first lead role nor my first research role, it was my first time leading a research team. My team was talented, hardworking, focused, and easy to manage. Although I wanted to be as collaborative as possible, I also had to recognize when it was time for me to make a decision or take action without soliciting feedback from my team. This project helped me to develop discernment.
Cross-functional teamwork:
- Leading means advocating
- As the research lead, I was often in the position of needing to advocate for research. My team was often under pressure to cut corners to save time, energy, and cost. I had to demonstrate to stakeholders that investing in quality research would, in fact, save resources and positively impact the business.
- Shared goals create alignment
- The content and design teams at times had requests of the research team that did not align with best practices for UX research. In addition to educating about best practices, I sought to understand the underlying purpose and goals of these requests, so that the research team could create and execute a research plan that would meet the needs of the other teams.
User recruitment challenges:
- Because previous research teams had been unable to successfully recruit our target users, there were low expectations from leadership before we began recruitment.
- However, it was clear that the needs of our users were not yet clearly understood, and that not understanding these needs would negatively impact the product and brand. I expressed my determination to reach our users, and negotiated a set amount of time we would dedicate to the effort, while emphasizing the importance of doing so.
- When our initial outreach did not yield a response, I knew we needed to quickly change course. I identified a novel strategy for successfully reaching our users, who provided rich and meaningful insights with major impact on product direction.
- Since completing these studies, I have given presentations on user recruitment to other Inclusive research teams. The work we put into building community connections will be useful for all future Inclusive projects.