How to make PHPunit return nonzero exit status on warnings

Question

When invoking PHPunit on some tests which fail with warnings, I get:

$ phpunit -c phpunit.xml --group app
Warning - MongoCollection::insert(): expects parameter 1 to be an array or object, null given in ...
    <more output>

OK, but incomplete or skipped tests!
Tests: 17, Assertions: 81, Incomplete: 1.

One of the tests should fail, but it doesn't; PHPunit marks it as "incomplete".

Let's check last exit status:

$ echo $?
0

The config I am using is:

<phpunit
    convertErrorsToExceptions="true"
    convertNoticesToExceptions="true"
    convertWarningsToExceptions="true"
    strict="true"
    stopOnError="true"
    stopOnFailure="true"
    stopOnIncomplete="true"
    stopOnSkipped="true"

    colors="true"
    bootstrap="bootstrap_phpunit.php"
    >

Any idea how to force PHPunit to emit nonzero exit status in case of "incomplete" tests?

Did you double-check that the config file is effectively being loaded? you should get a message like this: Configuration read from /your/path/phpunit.xml — gontrollez
– gontrollez, Commented Jun 19, 2014 at 11:59
I did - disabling it has changed error output, but didn't change exit status. — johndodo
– johndodo, Commented Jun 20, 2014 at 6:00
@gontrollez: thanks! I solved it: disabling error handler didn't help, but replacing it with the one that raises an exception worked wonderfully. — johndodo
– johndodo, Commented Jun 20, 2014 at 8:12

johndodo · Accepted Answer · 2014-06-20 08:09:15Z

1

Thanks to gontrollez, I started looking into error handlers and finally found a solution:

set_error_handler(function ($severity, $message, $filepath, $line)
{
    throw new Exception($severity." - ".$message." - ".$filepath." - ".$line);
});

This code throws an exception which causes PHPunit to properly detect test as failed instead of incomplete. It should be put somewhere in bootstrap_phpunit.php (that is, in file, specified as bootstrap file).

answered Jun 20, 2014 at 8:09

johndodo

18.5k17 gold badges103 silver badges120 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

mickadoo Over a year ago

will this work correctly though, what about tests with expected excepttions - i'm wondering if this will be called before the phpunit handling of it

Collectives™ on Stack Overflow

How to make PHPunit return nonzero exit status on warnings

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related