[Xapian-discuss] TermGenerator question for the single quote character

tata 668 tata668 at gmail.com
Mon Apr 6 17:52:56 BST 2009


I found it: 
http://xapian.org/docs/apidoc/html/classXapian_1_1TermGenerator.html#f7d43aef10aa6b26ef853a0ae2695f83

I'll try to set it to the french stremmer..

Thanks

Julien



Olly Betts wrote:
> On Sun, Apr 05, 2009 at 07:18:08PM -0400, tata 668 wrote:
>   
>> I use the TermGenerator to index the french text "Cela m'excite" 
>> (without the quotes). When I do a search for "excite" after this 
>> indexation, I need it to be found. "excite" is a word on is own.
>>
>> Currently "excite" is not found but "m'excite" is...
>>     
>
> In 1.0.0, we changed to treating apostrophes as part of a word, and
> updated to a newer version of Snowball where the English stemmer
> deals with them.
>
> I think the correct way for this to work is for the other stemmers
> to also handle apostrophes (at least if their languages use them)
> as otherwise the word tokenisation required depends on the stemmer.
>
>   
>> Is there a setting I'm missing so that the single quote character act as 
>> a word delimiter?
>>     
>
> No, there's no such setting currently.
>
> Cheers,
>     Olly
>
>   


More information about the Xapian-discuss mailing list