matplotlib/pytest-mpl

pytest-mpl

pytest-mpl is a pytest <https://docs.pytest.org>__ plugin to facilitate image comparison for Matplotlib <http://www.matplotlib.org>__ figures.

For each figure to test, an image is generated and then subtracted from an existing reference image. If the RMS of the residual is larger than a user-specified tolerance, the test will fail. Alternatively, the generated image can be hashed and compared to an expected value.

For more information, see the pytest-mpl documentation <https://pytest-mpl.readthedocs.io>__.

Installation

.. code-block:: bash

pip install pytest-mpl

For detailed instructions, see the installation guide <https://pytest-mpl.readthedocs.io/en/latest/installing.html>__ in the pytest-mpl docs.

Usage

First, write test functions that create a figure. These image comparison tests are decorated with @pytest.mark.mpl_image_compare and return the figure for testing:

.. code-block:: python

import matplotlib.pyplot as plt import pytest

@pytest.mark.mpl_image_compare def test_plot(): fig, ax = plt.subplots() ax.plot([1, 2]) return fig

Then, generate reference images by running the test suite with the --mpl-generate-path option:

.. code-block:: bash

pytest --mpl-generate-path=baseline

Then, run the test suite as usual, but pass --mpl to compare the returned figures to the reference images:

.. code-block:: bash

pytest --mpl

By also passing --mpl-generate-summary=html, a summary of the image comparison results will be generated in HTML format:

+---------------+---------------+---------------+ | |html all| | |html filter| | |html result| | +---------------+---------------+---------------+

For more information on how to configure and use pytest-mpl, see the pytest-mpl documentation <https://pytest-mpl.readthedocs.io>__.

Contributing

pytest-mpl is a community project maintained for and by its users. There are many ways you can help!

• Report a bug or request a feature on GitHub <https://github.com/matplotlib/pytest-mpl/issues>__
• Improve the documentation or code

.. |html all| image:: docs/images/html_all.png .. |html filter| image:: docs/images/html_filter.png .. |html result| image:: docs/images/html_result.png