top of page
UX platforms evaluation
the challenge
The goal of this study was to compare the user experience of two different question-answering platforms — Dylan-Q and Sparklis — during information retrieval tasks. While both tools allow users to form queries and retrieve answers, they differ in interface design and interaction flow. The challenge was to assess which platform offered a more user-friendly and satisfying experience, especially for users unfamiliar with semantic query systems.
the
IDEA
As part of my master's internship, this project aimed to go beyond traditional usability testing and explore the overall user experience. We focused on six key UX dimensions — attractiveness, perspicuity, efficiency, dependability, stimulation, and novelty — using the standardized User Experience Questionnaire (UEQ). By combining UX metrics with task performance data, the goal was to identify both functional and emotional strengths of each interface.
the
Process
Fourteen participants were asked to complete six identical information retrieval tasks using both platforms. Before starting, participants completed orientation steps to become familiar with each tool. During the tests, time was measured, and users completed the UEQ after each platform experience. The study design allowed us to compare the platforms on individual UX dimensions while observing behavioral differences in interaction, speed, and accuracy.
Design phase
Before launching the evaluation, we carefully designed the experimental setup to ensure valid comparisons. We created identical task scenarios for both platforms and developed clear instruction and interaction flows. Participants were asked to complete three warm-up examples followed by six structured tasks per platform. Visual tracking and timing tools were prepared to record user behavior, and the UEQ was adapted into a digital format for easy data collection.
Testing
To transparently present the experiment structure, a short video was created documenting the full testing procedure. This included how participants were introduced to the platforms, performed warm-up tasks, completed the information retrieval scenarios, and filled out the UEQ after each session. The video served as a clear visual walkthrough of the study environment, tools used, and participant flow — helping to convey the methodology and rigor of the evaluation during my master's internship.
Findings
Dylan-Q received higher ratings in efficiency, attractiveness, and perspicuity, suggesting that users found it easier to learn, quicker to use, and more enjoyable overall. Participants completed tasks almost two minutes faster with Dylan-Q compared to Sparklis. However, dependability, stimulation, and novelty received lower or similar scores across both tools, likely influenced by participants’ unfamiliarity with such platforms.
bottom of page