A progressive visual analytics tool for incremental experimental evaluation

This paper presents a visual tool – AVIATOR – that integrates the progressive visual analytics paradigm in the IR evaluation process. This tool serves to speed-up and facilitate the performance assessment of retrieval models enabling a result analysis through visual facilities. AVIATOR goes one step beyond the common “compute–wait–visualize” analytics paradigm, introducing a continuous evaluation mechanism that minimizes human and computational resource consumption.