apple/corenet được TopGit xếp vào nhóm dự án mã nguồn mở, với 7.0k sao trên GitHub, viết chủ yếu bằng Jupyter Notebook. CoreNet: A library for training deep neural networks
Tóm tắt dựng từ metadata GitHub của chính dự án — chưa có bài review TopGit. Trang sẽ tự động cập nhật khi bài review đầy đủ được xuất bản.
VÌ SAO CHƯA CÓ REVIEW
TopGit viết bài đầy đủ cho repo có nhiều sao nhất và được yêu cầu nhiều nhất. Trang này là snapshot trong thời gian chờ — xem README gốc ở tab READ ME.
CoreNet: A library for training deep neural networks
CoreNet is a deep neural network toolkit that allows researchers and engineers to train standard and novel small and large-scale models for variety of tasks, including foundation models (e.g., CLIP and LLM), object classification, object detection, and semantic segmentation.
Table of contents
What's new?
Research efforts at Apple using CoreNet
Installation
Directory Structure
Maintainers
Contributing to CoreNet
License
Relationship with CVNets
Citation
What's new?
October 2024: Version 0.1.1 of the CoreNet library includes
KV Prediction
Research efforts at Apple using CoreNet
Below is the list of publications from Apple that uses CoreNet. Also, training and evaluation recipes, as well as links to pre-trained models, can be found inside the projects folder. Please refer to it for further details.
KV Prediction for Improved Time to First Token
OpenELM: An Efficient Language Model Family with Open Training and Inference Framework
CatLIP: CLIP-level Visual Recognition Accuracy with 2.7x Faster Pre-training on Web-scale Image-Text Data
Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement
CLIP meets Model Zoo Experts: Pseudo-Supervision for Visual Enhancement
FastVit: A Fast Hybrid Vision Transformer using Structural Reparameterization
Bytes Are All You Need: Transformers Operating Directly on File Bytes
MobileOne: An Improved One millisecond Mobile Backbone
RangeAugment: Efficient Online Augmentation with Range Learning
Separable Self-attention for Mobile Vision Transformers (MobileViTv2)
CVNets: High performance library for Computer Vision, ACM MM'22
MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer, ICLR'22
Installation
You will need Git LFS (instructions below) to run tests and Jupyter notebooks
(instructions) in this repository,
and to contribute to it so we recommend that you install and activate it first.
On Linux we recommend to use Python 3.10+ and PyTorch (version >= v2.1.0), on
macOS system Python 3.9+ should be sufficient.
Note that the optional dependencies listed below are required if you'd like to
make contributions and/or run tests.
For Linux (substitute apt for your package manager):
sudo apt install git-lfs
git clone [email protected]:apple/corenet.git
cd corenet
git lfs install
git lfs pull
# The following venv command is optional, but recommended. Alternatively, you can create and activate a conda environment.
python3 -m venv venv && source venv/bin/activate
python3 -m pip install --editable .
To install optional dependencies for audio and video processing:
sudo apt install libsox-dev ffmpeg
For macOS, assuming you use Homebrew:
brew install git-lfs
git clone [email protected]:apple/corenet.git
cd corenet
cd \$(pwd -P) # See the note below.
git lfs install
git lfs pull
# The following venv command is optional, but recommended. Alternatively, you can create and activate a conda environment.
python3 -m venv venv && source venv/bin/activate
python3 -m pip install --editable .
To install optional dependencies for audio and video processing:
brew install sox ffmpeg
Note that on macOS the file system is case insensitive, and case sensitivity
can cause issues with Git. You should access the repository on disk as if the
path were case sensitive, i.e. with the same capitalization as you see when you
list the directories ls. You can switch to such a path with the cd $(pwd -P)
command.
Directory Structure
This section provides quick access and a brief description for important CoreNet directories.
Description
Quick Access
Getting Started
Working with the examples is an easy way to get started with CoreNet.
CoreNet provides reproducible training recipes, in addition to the pretrained model
weights and checkpoints for the publications that are listed in projects/ directory.
Publication project directories generally contain the following contents:
README.md provides documentation, links to the pretrained weights, and citations.
<task_name>/<model_name>.yaml provides configuration for reproducing the trainings and evaluations.
MLX examples demonstrate how to run CoreNet models efficiently on Apple Silicon.
Please find further information in the README.md file within the corresponding example directory.
└──mlx_example
├── clip
└── open_elm
Model Implementations
Models are organized by tasks (e.g. "classification"). You can find all model implementations for each
task in the corresponding task folder.
Each model class is decorated by a
@MODEL_REGISTRY.register(name="<model_name>", type="<task_name>") decorator.
To use a model class in CoreNet training or evaluation,
assign models.<task_name>.name = <model_name> in the YAML configuration.
In this section, we have highlighted the rest of the key directories that implement
classes corresponding to the names that are referenced in the YAML configurations.
This code is developed and maintained by Maxwell Horton, Mohammad Sekhavat Yanzi Jin, and Dmitry Belenko.
Previous Maintainers
Sachin Mehta
Farzad Abdolhosseini
Contributing to CoreNet
We welcome PRs from the community! You can find information about contributing to CoreNet in our contributing document.
Please remember to follow our Code of Conduct.
License
For license details, see LICENSE.
Relationship with CVNets
CoreNet evolved from CVNets, to encompass a broader range of applications beyond computer vision. Its expansion facilitated the training of foundational models, including LLMs.
Citation
If you find our work useful, please cite the following paper:
@inproceedings{mehta2022cvnets,
author = {Mehta, Sachin and Abdolhosseini, Farzad and Rastegari, Mohammad},
title = {CVNets: High Performance Library for Computer Vision},
year = {2022},
booktitle = {Proceedings of the 30th ACM International Conference on Multimedia},
series = {MM '22}
}
apple/corenet có 7.0k sao GitHub — tải lại trang để xem số mới nhất, hoặc xem trực tiếp github.com/apple/corenet. TopGit phản chiếu số sao của GitHub nhưng không cam kết đến từng phút.
apple/corenet có tag gì không?
Bản đồng bộ chưa ghi nhận topic GitHub nào cho apple/corenet. GitHub topics hiển thị ở thanh bên phải trang repo — đó là nơi đáng kiểm tra nhất.
apple/corenet có website riêng không?
TopGit chưa ghi nhận URL trang chủ cho apple/corenet. Phần README ở tab phía trên thường có link demo, hoặc xem mô tả GitHub của repo.
apple/corenet còn đang phát triển không?
Commit gần nhất trên apple/corenet là 1 tháng trước (theo timestamp GitHub). Repo có 543 fork — một chỉ báo về mức độ quan tâm của cộng đồng.
apple/corenet viết bằng ngôn ngữ gì?
apple/corenet chủ yếu viết bằng Jupyter Notebook. Trường "language" của GitHub dựa trên phần lớn byte ở nhánh mặc định.
Đọc thêm về apple/corenet ở đâu?
Trang TopGit này là một snapshot — tab "Readme" hiển thị nguyên văn README của repo (đã bỏ link, giữ ảnh). Repo GitHub ở github.com/apple/corenet là nguồn chính thức.
Đọc đầy đủ README ở tab phía trên.
corenet có đáng để bạn bỏ thời gian?
ChatGPT, Claude và Perplexity đều đọc được trang này. Hỏi thử xem họ nghĩ gì về corenet.