[Xapian-discuss] Omega : Indexing disallowed by Meta tag

Olly Betts olly at survex.com
Sun May 26 23:55:20 BST 2013


On Sun, May 26, 2013 at 04:00:10PM +0200, Lucas Van Overberghe wrote:
> I am trying to index a big collection of webpages (~15GB) with Omega but
> cannot index them due the meta tag. Is there some way I can still index
> them?

$ omindex --help|grep meta
  -i, --ignore-exclusions   ignore meta robots tags and similar exclusions

Cheers,
    Olly



More information about the Xapian-discuss mailing list