[Releng] Evaluate tools for test coverage

[Guite]

• CodeClimate
• Scrutinizer (not sure yet whether coverage support is contained in the free plan)
• https://coveralls.io/
  • https://coveralls.io/github/zikula/core
  • https://coveralls.io/features
  • https://coveralls.zendesk.com/hc/en-us
• https://codecov.io/
• https://www.codacy.com/

[craigh]

dup #2927

[Guite]

not a dup; I splitted them and assigned them to different milestones.

[Guite]

It seems that most tools can be combined with Travis for processing the coverage information:

• https://scrutinizer-ci.com/docs/tools/external-code-coverage/
• https://docs.codeclimate.com/docs/travis-ci-test-coverage
• https://coveralls.zendesk.com/hc/en-us/articles/201769735-PHP
• https://docs.codecov.io/discuss/5911b210b818560f00f1038c
• https://github.com/codacy/php-codacy-coverage#installation

@javiereguiluz said:

calculating the coverage is incredibly slow, so given that it’s not important for us to know the coverage for each pull request, we use Travis cron jobs for that (https://docs.travis-ci.com/user/cron-jobs/)