Abstract—Subjectify.us is a web platform that provides a complete solution for conducting subjective comparisons. The service is designed specifically for the comparison of images, video, and sound processing algorithms. Apply your algorithm, its modifications, and competitive approaches to your test dataset—and upload the output to our server. We display results computed by different methods to paid participants pairwise. These participants are asked to choose the best method in each pair. We then convert pairwise comparison data to final scores and provide you with a detailed report complete with plots ready for inclusion in your paper.
You apply your algorithm and its competitors to your test dataset.
We recruit study participants and present your data pairwise to them.
We process a myriad of collected responses and generate plots for your paper.
With pairwise comparison, there’s no need to invent score scale and explain it to respondents. Study participants simply choose the best of two.
Receive a detailed report including plots ready for inclusion in your paper.
Receive all of the raw data you need to conduct your own in-depth analysis.
Save time, letting us find study participants and filter out answers from cheating respondents.
Our team is developing methods for generation of new views of given video. It is important for us to know how the end viewer feels about the synthesized videos or images from a perceptual perspective, so the subjective evaluation is crucial for us. We wanted each study participant to singly evaluate videos produced by various view generation methods. Subjectify.us platform is effective tool that satisfied our needs.
PhD student, Peking University
Subjectify.us is currently conducting its private beta testing stage. Be one of the first to hear about our public release. Simply complete the form, below, and you’ll receive notification about this and further updates. We'll never share your e-mail with outside parties.