[Xapian-tickets] [Xapian] #376: omindex: use config file for multi-start directories

[Xapian]

#376: omindex: use config file for multi-start directories
-------------------------+--------------------------------------------------
 Reporter:  olly         |       Owner:  olly     
     Type:  enhancement  |      Status:  assigned 
 Priority:  low          |   Milestone:  1.2.x    
Component:  Omega        |     Version:  SVN trunk
 Severity:  normal       |    Keywords:           
Blockedby:               |    Platform:  All      
 Blocking:               |  
-------------------------+--------------------------------------------------

Comment(by olly):

 I've been looking at the current "sites" support in omindex, which is
 closely related to the issue in this ticket.

 It adds a "P" term with the path part of the start URL, and if there's a
 host part it also adds an "H" term.

 I think it would make more sense to add a single term for each "site" with
 the full start URL - say XSITE<url>.  Benefits:

  * Updating a site can delete from the database any documents from that
 site which are no longer present on disk, without affecting documents from
 other sites (currently you have to use -p to prevent any deletion,
 otherwise indexing a site deletes all the documents from other sites).

  * Deleting all documents from a site is easy (a single API call!)

  * We can use "P" terms in a more natural way - either one term per path
 level of each document (so a filter restricting to all documents under a
 directory is easy), or one for the directory a document is actually in (so
 restricting to an exact directory is easy).

-- 
Ticket URL: <http://trac.xapian.org/ticket/376#comment:3>
Xapian <http://xapian.org/>
Xapian