[Xapian-tickets] [Xapian] #283: Automated coverage testing

[Xapian]

#283: Automated coverage testing
------------------------+---------------------------------------------------
 Reporter:  olly        |       Owner:  richard
     Type:  task        |      Status:  new    
 Priority:  normal      |   Milestone:         
Component:  Test Suite  |     Version:         
 Severity:  normal      |    Keywords:         
Blockedby:              |    Platform:  other  
 Blocking:              |  
------------------------+---------------------------------------------------
 We should have automated coverage testing, to help use improve the
 coverage of our testsuite.

 Suggested approach:

  * Use buildbot to automatically generate a suitably instrumented build
 from SVN with the right options: {{{-fprofile-arcs -ftest-coverage}}} and
 probably {{{-O0}}}

  * Use [http://ltp.sourceforge.net/coverage/lcov.php lcov] or something
  similar to run the testsuite under gcov and generate HTML of the
  results.  Probably running this as part of the buildbot job is
  easiest.

  * We ideally want to keep a record of some appropriate "summary
 statistics" so we can graph how we're doing over time.  Hopefully
  there is a suitable utility which will produce suitable stats and
  we just need to note these for each run along with the SVN rev
  and branch URL.  Failing that, perhaps we can parse them from the HTML
 output or something.

 Assigning to Richard for now, as he's best able to do the buildbot
 part at least.

-- 
Ticket URL: <http://trac.xapian.org/ticket/283>
Xapian <http://xapian.org/>
Xapian