deepspeed
Here are 58 public repositories matching this topic...
Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3
-
Updated
May 20, 2021 - Python
🥈50th place in Bristol-Myers Squibb – Molecular Translation competition🥈
-
Updated
Jun 4, 2021 - Python
Samples for fine-tuning HuggingFace models with AzureML
-
Updated
Oct 14, 2021
A framework for benchmarking various DNN inference engine.
-
Updated
Nov 8, 2021 - Python
Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.
-
Updated
Jan 2, 2022 - Python
Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
-
Updated
Aug 6, 2022 - Python
Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.
-
Updated
Sep 6, 2022 - Jupyter Notebook
[T] ~ Nova Wallet ~ GUI wallet for windows on the bittensor network polkadot you can use this to store your TAO under a polkadot address [T]
-
Updated
Jan 13, 2023
Transformer OCR by Torch Lightning
-
Updated
Feb 17, 2023 - Python
Sample codes and guidelines on how to finetune any opensource GPT models using #deepspeed and #huggingface
-
Updated
Mar 31, 2023
A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM
-
Updated
Apr 28, 2023 - Python
A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca
-
Updated
Apr 28, 2023 - Python
Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed
-
Updated
Jun 14, 2023 - Python
使用自己的tokenizer继续预训练大语言模型。
-
Updated
Jun 25, 2023 - Python
Improve this page
Add a description, image, and links to the deepspeed topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the deepspeed topic, visit your repo's landing page and select "manage topics."