The usability test focused in the Summary & Chapters feature, designed to automatically generate video summaries and chapters markers using AI.
Role: Product Designer
Usability Test
Kaltura
Overview
To understand how intuitive the feature is to use
Whether user can complete key tasks smoothly
If the output meets expectations for quality
What pain or usability issues arise during the flow
The Goal
Before the test, we created the test scenario, review sheet, and tagging framework.
Preparation
Task Completion Rate
Most users were able to complete the majority of tasks without issues, demonstrating strong overall performance and system usability.
Only a few tasks (such as deleting a draft or changing writing style) showed minor drop-offs in completion, highlighting areas for refinement.
User Ratings of Outcome Quality
Most testers were positively impressed by the generated summaries.
While a few noted critiques about the tone or length of the content,
the overall sentiment was one of satisfaction, and in some cases, pleasant surprise.
8
4
0
Present yourself
Select Summary & chapters
Change the writing style
Adjust the level of detail
Edit the content
Publish
Unpublished
Delete draft
Task success
N/A
4
2
0
1
2
3
4
5
Research Finding
Users wanted more intuitive and flexible editing, including control over chapter count, the ability to adjust basic draft settings, and refine content using AI.
Adjust and refine content using AI
“If I wanted to go more granular by dividing out seven sins into each each of their own chapters, I’d like to do that.”
Editing & Customization
Testers noted missing capabilities in the current version, including multi-language support, AI assistance, and sharing options.
“If I have to edit something I would have expected to come and see an AI thing coming in for each section where I’ll be able to change the text.”
Feature Gaps
7 out of 8 testers had difficulty navigating or locating elements due to unclear layout or unexpected behaviors. One tester was distracted by auto-play audio.
7/8
users
“Let me see if I can edit it. I don’t see an option.”
UI Navigation & Visibility
Pain Points
Solution
The full user flow will be available soon on Figma
You Can Contact Me Via