Create with AI
About this case study
This case study goes over how user activation could increase if I leverage AI to generate or import a user’s first quiz.
About Socrative
Socrative has a long history of being one of the most simplest, but powerful freemium quizzing apps that teachers trust. Socrative was founded in 2010 and acquired by Showbie in 2018. I joined the team in 2020 and have been gradually replacing legacy UI with modernized design.
Responsibilities
Leading a workshop
Defining poblem
Competitive research
Define product requirements
User flows
Wireframing
Prototyping
Define success metrics
Problems to solve
Creating your first quiz takes significant commitment, because it requires you to fill in numerous fields that make up all your quiz questions. A significant portion of new users abandon our app before completing a quiz and never experience the full core flow that would capture their attention.
Creating your first quiz requires you to enter a handful of inputs to create a question.
Initial research
Quantitative data shows conversions happen at a higher rate when users find quiz content from our free quiz library or import content from an another user.
Solution
New users could make it further into Socrative’s core flow if creating their first quiz was easier. We can use AI to generate content and assist in import their existing content.
Leading a workshop
I conducted a two day workshop that lead our product management and development through these activities:
Fear and Hope
Empathy mapping
Value assessment
Defining problem statements
Sketch and present solutions
Defining product requirements
By the end of the workshop we had a strong understanding of the user, a handful of initial solutions, and defined the problem to solve. This gave me enough to create product requirements that paint a clear vision, and facilitate discussion on what to include in scope. The product requirements are:
A consistent UI for every way we allow them to generate.
Relevant content should be found in as few steps as possible.
Guide users with detailed instructions on how to use AI.
Be transparent about how we use their information.
Inform users of their responsibility to validate the accuracy of generated content.
Competitor Research
I knew going into this project that AI would be involved in our solution, so, I explored and documented several apps on a whiteboard (Miro) to understand how AI is used to create content in quiz apps. This served as inspiration we could reference if the need required and gave clues of what to expect as we explored a solution to our specific problem.
Wireframing and user flow
Simple wireframes were drawn to explore the functionality and user flow. The wireframes were presented and discussed with designers, developers, and product managers to solidify a direction before going into higher fidelity work.
Design Discovery
Multiple drafts of high-fidelity designs were explored with the product team and the wider company before packaged and captioned with hand off instructions for development.
The above is a screenshot of one of many figma pages
Prototyping
LLM (Large Language Model) experiment
AI is a new technology and users may not be confident prompt writers, so I experimented to see if a Custom GPT can guide users to create relevant content. I created a customGPT quiz builder that would ask users a few short questions and output the questions into our app.
The experiment found that LLM’s are great at guiding users or great at generating questions, but was inconsistent when doing both.
Drawer prototype
I created a figma prototype to demonstrate the main flow for generating questions so that our team could get more hands on with a working idea of the solution.
Video walkthrough
This recording goes through the complete build
Results
I’ll add results once it’s been collected. For now, I’ve defined the metrics to determine the success of the project.
Primary
How often are users returning to use the new feature.
Number of quizzes created by new users to see if it’s going up.
See if more new users are activating.
Secondary
User Retention
Core flow completion (create, launch, and finish quiz with students)
Contact me to see more of the process and progress of Socrative.