An open-source entry in TopGit's GitHub warehouse: isl-org/lang-seg, 834 stars, Jupyter Notebook. Language-Driven Semantic Segmentation
Snapshot summary built from the project's own GitHub metadata — there's no written TopGit review yet. The page will update automatically when a full review is published.
WHY NO REVIEW YET
TopGit writes full reviews for the most-starred, most-requested repositories. This page is a snapshot until then — see the READ ME tab for the original README in full.
This project will no longer be maintained by Intel.
Intel has ceased development and contributions including, but not limited to, maintenance, bug fixes, new releases, or updates, to this project.
Intel no longer accepts patches to this project.
If you have an ongoing need to use this project, are interested in independently developing it, or would like to maintain patches for the open source software community, please create your own fork of this project.
Language-driven Semantic Segmentation (LSeg)
The repo contains official PyTorch Implementation of paper Language-driven Semantic Segmentation.
ICLR 2022
Authors:
Boyi Li
Kilian Q. Weinberger
Serge Belongie
Vladlen Koltun
Rene Ranftl
Overview
We present LSeg, a novel model for language-driven semantic image segmentation. LSeg uses a text encoder to compute embeddings of descriptive input labels (e.g., ''grass'' or 'building'') together with a transformer-based image encoder that computes dense per-pixel embeddings of the input image. The image encoder is trained with a contrastive objective to align pixel embeddings to the text embedding of the corresponding semantic class. The text embeddings provide a flexible label representation in which semantically similar labels map to similar regions in the embedding space (e.g., ''cat'' and ''furry''). This allows LSeg to generalize to previously unseen categories at test time, without retraining or even requiring a single additional training sample. We demonstrate that our approach achieves highly competitive zero-shot performance compared to existing zero- and few-shot semantic segmentation methods, and even matches the accuracy of traditional segmentation algorithms when a fixed label set is provided.
Please check our Video Demo (4k) to further showcase the capabilities of LSeg.
@inproceedings{
li2022languagedriven,
title={Language-driven Semantic Segmentation},
author={Boyi Li and Kilian Q Weinberger and Serge Belongie and Vladlen Koltun and Rene Ranftl},
booktitle={International Conference on Learning Representations},
year={2022},
url={https://openreview.net/forum?id=RriDjddCLN}
}
Acknowledgement
Thanks to the code base from DPT, Pytorch_lightning, CLIP, Pytorch Encoding, Streamlit, Wandb
The most recent commit recorded on isl-org/lang-seg was 1.9 years ago, based on the GitHub push timestamp. The repository has 101 forks — one of the better signals of community interest.
How many stars does isl-org/lang-seg have?
isl-org/lang-seg has 834 GitHub stars — refresh the page for the live number, or check github.com/isl-org/lang-seg. TopGit mirrors GitHub's count but does not claim minute-by-minute accuracy.
Is isl-org/lang-seg open source?
Yes — isl-org/lang-seg ships under the MIT license, which makes its source code freely readable (and, depending on license terms, forkable and reusable). Source: github.com/isl-org/lang-seg.
What is isl-org/lang-seg?
isl-org/lang-seg (isl-org/lang-seg) is a Jupyter Notebook project on GitHub. From the project's own README: Language-Driven Semantic Segmentation
Where do I read more about isl-org/lang-seg?
This TopGit page is a snapshot — the READ ME tab shows the project's own README content (links stripped, images preserved). The GitHub repository at github.com/isl-org/lang-seg is the definitive source.
Read full README in the tab above.
Want a second opinion on lang-seg?
Ask an AI that can read this page — one click and you get its take on lang-seg.