Expired
Milestone Jul 2, 2018–Sep 6, 2018

Evaluation & Report

Am Ende soll unsere Suchmaschine hinsichtlich der folgenden Gesichtspunkte analysiert werden (Auszug Foliensatz unit-en-ir-architecture.pdf):

  • Ranking Analysis (#49 (closed))

    • Definition of goals (#48 (closed))
    • Acquisition of relevance judgments for query-document pairs
    • Measurement theory (e.g., strong emphasis on top results common in web search)
    • Log analysis of recorded search behavior

  • User Experience Analysis 1

    • Definition of goals (e.g., usability, user satisfaction, etc.)
    • Log analysis of recorded user behavior
    • User studies and A/B testing

  • Performance Analysis 1

    • Definition of goals (e.g., throughput, response time, etc.)
    • Log analysis of recorded system behavior
    • Lab experiments and simulation

[1] Eher trivial, Fokus auf Ranking-Analysis