scikit-learn-contrib/MAPIE is a Jupyter Notebook project with 1.7k stars in the Data space. A scikit-learn-compatible library for estimating prediction intervals and controlling risks, based on conformal predictions.
Snapshot summary built from the project's own GitHub metadata — there's no written TopGit review yet. The page will update automatically when a full review is published.
WHY NO REVIEW YET
TopGit writes full reviews for the most-starred, most-requested repositories. This page is a snapshot until then — see the READ ME tab for the original README in full.
MAPIE - Model Agnostic Prediction Interval Estimator
An open-source Python library for quantifying uncertainties and controlling the risks of machine learning models.
Image credits: Cemrecan Yurtman (portrait) and hogrmahmood (zebra-horse hybrid).
MAPIE allows you to:
Compute prediction intervals or prediction sets for regression,
classification, and time series by estimating your model uncertainty on a
conformalization dataset. Note that prediction intervals are not credibility intervals, nor confidence intervals.
Control risks of more complex tasks such as multi-label classification
and semantic segmentation in computer vision, providing probabilistic
guarantees on metrics like recall and precision.
Easily use any model (scikit-learn, TensorFlow, PyTorch) (thus being model agnostic) thanks to scikit-learn-compatible wrapper if needed. MAPIE is part of the scikit-learn-contrib ecosystem.
MAPIE relies notably on the fields of Conformal Prediction and Distribution-Free Inference. It implements peer-reviewed algorithms that are model and use case agnostic (but still needs appropriate datasets for conformalization) and possesses theoretical guarantees under minimal assumptions on the data and the model.
🚀 MAPIE in 2026 🚀 New features have been implemented, starting with the application of risk control to emerging use cases such as LLM-as-Judge and image segmentation. In addition, exchangeability tests have been introduced to help users verify when MAPIE can be legitimately applied. Also, new adaptive conformal prediction methods have been added. Finally, the documentation has been updated with a new design!
🎉 MAPIE in 2025 🎉 MAPIE v1 is live! This new version introduces major changes to the API. Check out the release notes.
See GitHub Releases and HISTORY.md for up-to-date details on the new features. If you have question about how Mapie works under the hood, please refer to our full documentation
🛠 Requirements & installation
MAPIE runs on:
Python >=3.10
NumPy >=1.23
scikit-learn >=1.4
MAPIE can be installed in different ways:
$ pip install mapie # installation via `pip`
$ conda install -c conda-forge mapie # or via `conda`
$ pip install git+https://github.com/scikit-learn-contrib/MAPIE # or directly from the github repository
⚡ Quickstart and documentation
Below are two simple examples from our documentation that show how MAPIE is used in a regression setting and a classification setting:
Uncertainty quantification for a regression task
Uncertainty quantification for a classification task
📝 Contributing
You are welcome to propose and contribute new ideas.
We encourage you to open an issue so that we can align on the work to be done.
It is generally a good idea to have a quick discussion before opening a pull request that is potentially out-of-scope.
For more information on the contribution process, read our contribution guidelines.
🔍 References
Vovk, Vladimir, Alexander Gammerman, and Glenn Shafer. Algorithmic Learning in a Random World. Springer Nature, 2022.
Angelopoulos, Anastasios N., and Stephen Bates. "Conformal prediction: A gentle introduction." Foundations and Trends® in Machine Learning 16.4 (2023): 494–591.
Barber, Rina Foygel, Emmanuel J. Candès, Aaditya Ramdas, and Ryan J. Tibshirani. "Predictive inference with the jackknife+." Annals of Statistics 49.1 (2021): 486–507.
Kim, Byol, Chen Xu, and Rina Barber. "Predictive inference is free with the jackknife+-after-bootstrap." Advances in Neural Information Processing Systems 33 (2020): 4138–4149.
Sadinle, Mauricio, Jing Lei, and Larry Wasserman. "Least ambiguous set-valued classifiers with bounded error levels." Journal of the American Statistical Association 114.525 (2019): 223–234.
Romano, Yaniv, Matteo Sesia, and Emmanuel Candès. "Classification with valid and adaptive coverage." Advances in Neural Information Processing Systems 33 (2020): 3581–3591.
Angelopoulos, Anastasios N., et al. "Uncertainty sets for image classifiers using conformal prediction." International Conference on Learning Representations (2021).
Romano, Yaniv, Evan Patterson, and Emmanuel Candès. "Conformalized quantile regression." Advances in Neural Information Processing Systems 32 (2019).
Xu, Chen, and Yao Xie. "Conformal prediction interval for dynamic time-series." International Conference on Machine Learning. PMLR, 2021.
Bates, Stephen, et al. "Distribution-free, risk-controlling prediction sets." Journal of the ACM 68.6 (2021): 1–34.
Angelopoulos, Anastasios N., Stephen Bates, Adam Fisch, Lihua Lei, and Tal Schuster. "Conformal Risk Control." (2022).
Angelopoulos, Anastasios N., Stephen Bates, Emmanuel J. Candès, et al. "Learn Then Test: Calibrating Predictive Algorithms to Achieve Risk Control." (2022).
📚 License & citation
MAPIE is free and open-source software licensed under the BSD-3-Clause license.
If you use MAPIE in your research, please cite the main paper:
Cordier, Thibault, et al. "Flexible and systematic uncertainty estimation with conformal prediction via the MAPIE library." Conformal and Probabilistic Prediction with Applications. PMLR, 2023.
@inproceedings{Cordier_Flexible_and_Systematic_2023,
author = {Cordier, Thibault and Blot, Vincent and Lacombe, Louis and Morzadec, Thomas and Capitaine, Arnaud and Brunel, Nicolas},
booktitle = {Conformal and Probabilistic Prediction with Applications},
title = {{Flexible and Systematic Uncertainty Estimation with Conformal Prediction via the MAPIE library}},
year = {2023}
}
You can also cite the ICML workshop manuscript:
Taquet, Vianney, et al. "MAPIE: an open-source library for distribution-free uncertainty quantification." arXiv preprint arXiv:2207.12274 (2022).
@article{taquet2022mapie,
title = {MAPIE: an open-source library for distribution-free uncertainty quantification},
author = {Taquet, Vianney and Blot, Vincent and Morzadec, Thomas and Lacombe, Louis and Brunel, Nicolas},
journal = {arXiv preprint arXiv:2207.12274},
year = {2022}
}
🤝 Affiliations
MAPIE has been developed through a collaboration between Capgemini Invent,
Quantmetry, Michelin, ENS Paris-Saclay, and with the financial support from
Région Île-de-France and Confiance.ai.
How active is development on scikit-learn-contrib/MAPIE?
The most recent commit recorded on scikit-learn-contrib/MAPIE was 3 months ago, based on the GitHub push timestamp. The repository has 184 forks — one of the better signals of community interest.
How many stars does scikit-learn-contrib/MAPIE have?
scikit-learn-contrib/MAPIE has 1.7k GitHub stars — refresh the page for the live number, or check github.com/scikit-learn-contrib/MAPIE. TopGit mirrors GitHub's count but does not claim minute-by-minute accuracy.
What language is scikit-learn-contrib/MAPIE written in?
scikit-learn-contrib/MAPIE is written primarily in Jupyter Notebook. GitHub's language field is based on the largest share of bytes in the default branch.
What license does scikit-learn-contrib/MAPIE use?
scikit-learn-contrib/MAPIE is released under the BSD-3-Clause license. Always verify the LICENSE file directly on GitHub for the authoritative terms — license strings can be edited out of sync with a project's actual stance.
What topics is scikit-learn-contrib/MAPIE associated with?
GitHub's repository topics for scikit-learn-contrib/MAPIE: "classification", "confidence-intervals", "conformal-prediction", "data-science", "python", "regression", "risk-control", "sklearn". TopGit's editorial category is Data.
Where can I see scikit-learn-contrib/MAPIE in action?
The project maintains a homepage at https://mapie.readthedocs.io/en/stable/. The README tab on this page also usually contains screenshots and a quickstart.
Where do I read more about scikit-learn-contrib/MAPIE?
This TopGit page is a snapshot — the READ ME tab shows the project's own README content (links stripped, images preserved). The GitHub repository at github.com/scikit-learn-contrib/MAPIE is the definitive source.
Read full README in the tab above.
Curious whether MAPIE is right for you?
Let ChatGPT, Claude, or Perplexity look into it — click below and see what AI actually says about MAPIE.