[Xapian-devel] Dynamic Snippets - small scale result testing

[Mihai Bivol]

2013/2/3 Peter Karman <peter at peknet.com>:
> Mihai Bivol wrote on 7/17/12 8:28 PM:
>> Hello,
>>
>> I've made a public small scale test[1] with different parameters for
>> generating snippets.
>>
>> There is a set of queries that return different documents from
>> Wikipedia. For each document there are 6 snippets that I would like to
>> be ranked from 1 to 5.
>>
>> 1 - Worst snippet from the set, totally irrelevant to the _query_.
>> 2 - Worse than the majority of the snippets from the set.
>> 3 - Quite relevant snippet to the _query_. Not different than the
>> other ones from the set.
>> 4 - Better than other relevant snippets from the set.
>> 5 - Snippet that is totally relevant to the _query_ and document
>> content, best from the set.
>>
>> If anyone has suggestions or any kind of feedback, please reply to this thread.
>> If you complete the assessment, please fill in the name field with
>> your IRC nickname. In case of unwanted submit (or an already existing
>> submit with your name), please notify me with the name of the submit
>> so I won't take it into account.
>
>
> was there ever any final assessment of this project?

The final results, though with a small number of assessments was a bit
over 3. So the snippets were quite relevant, but not the best that
could be selected. The constants that yielded the best results are
present in the repository in which I worked.

I currently want to integrate Omega with the snippet feature in a tech
blog[1] and work out other ways to extract the snippets, using the
same metric for ranking terms.

[1] http://techblog.rosedu.org

Mihai