Cost-Effective HITs for Relative Similarity Comparisons

Understand

Similarity comparisons of the form "Is object a more similar to b than to c?" are useful for computer vision and machine learning applications.

• Unfortunately, an embedding of $n$ points is specified by $n^3$ triplets, making collecting every triplet an expensive task.
• In noticing this difficulty, other researchers have investigated more intelligent triplet sampling techniques, but they do not study their effectiveness or their potential drawbacks.
• Although it is important to reduce the number of collected triplets, it is also important to understand how best to display a triplet collection task to a user.