Commits

Commits on Dec 1, 2023

added bf16 support (#7888 )
yidong72
committedDec 1, 2023

Commits on Oct 16, 2023

distributed checkpoint average script (#7721 )
yidong72
committedOct 16, 2023

Commits on Oct 10, 2023

generalized chat sft prompt (#7655 )
yidong72
committedOct 10, 2023

Commits on Aug 7, 2023

Include the scripts for preprocessing OAST and unit tests for chat sft datasets (#7112 )

yidong72
and
pre-commit-ci[bot]
committedAug 7, 2023

Commits on Jul 18, 2023

added back the retro documents (#7033 )
yidong72
committedJul 18, 2023

Commits on Jun 29, 2023

support value attribution condition (#6934 )

yidong72
and
pre-commit-ci[bot]
committedJun 29, 2023

Commits on Jun 22, 2023

Make Gradio library optional (#6904 )
yidong72
committedJun 22, 2023

Commits on May 24, 2023

not pinning version (#6680 )
yidong72
committedMay 24, 2023

Commits on May 16, 2023

Dialogue dataset (#6654 )

committedMay 16, 2023

Commits on Apr 11, 2023

fix bug (#6409 )
yidong72
committedApr 11, 2023

Commits on Mar 22, 2023

Add the capability to stop generation based on customized end strings (#6239 )
yidong72
committedMar 22, 2023

Commits on Mar 16, 2023

Text generation logics calculation fix. (#6225 )
yidong72
committedMar 16, 2023

Commits on Mar 14, 2023

Add sequence parallel support to Rope positional embedding (#6178 )
yidong72
committedMar 14, 2023

Commits on Mar 9, 2023

convert Megatron LM ckpt to NeMo PP support. (#6159 )

yidong72
and
pre-commit-ci[bot]
committedMar 9, 2023

Commits on Feb 13, 2023

Refactor the retrieval services for microservice architecture (#5910 )
yidong72
committedFeb 13, 2023

Commits on Jan 28, 2023

RETRO model finetuning (#5800 )

yidong72
and
pre-commit-ci[bot]
committedJan 28, 2023

Commits on Jan 4, 2023

added tab former doc to the index page (#5733 )
yidong72
committedJan 4, 2023

Commits on Dec 12, 2022

Add RETRO model documentation (#5578 )

yidong72
and
ericharper
committedDec 12, 2022

Commits on Dec 9, 2022

Text generation improvement (UI client, data parallel support) (#5437 )

committedDec 9, 2022

Commits on Oct 12, 2022

Fix Global init steps (#5143 )

committedOct 12, 2022

Commits on Oct 2, 2022

Text generation refactor and RETRO text generation implementation (#4985 )

committedOct 2, 2022

Commits on Sep 13, 2022

Update the prompt learning to handle large lanague model (#4906 )

yidong72
and
doyend
committedSep 13, 2022

Commits on Sep 7, 2022

Adding RETRO model Faiss sharding index and KNN sharding index (#4713 )

committedSep 7, 2022

Commits on Aug 3, 2022

Add MuTransfer Capablity to RETRO model pretraining (#4643 )
yidong72
committedAug 3, 2022

Commits on Jun 28, 2022

Add O2 support for RETRO model (#4411 )

yidong72
and
ericharper
committedJun 28, 2022

Commits on Jun 8, 2022

fix the post ln (#4350 )

yidong72
and
ericharper
committedJun 8, 2022

Commits on Jun 5, 2022

Fix bugs in indexed dataset exam script (#4325 )

yidong72
and
michalivne
committedJun 5, 2022

Commits on Jun 2, 2022

Add RETRO indexed dataset and set_inference_key_value_memory inference (#4220 )

yidong72
and
ericharper
committedJun 2, 2022

Commits on May 14, 2022

added pp2 ci test (#4168 )
yidong72
committedMay 14, 2022
Add RETRO model for pretraining (#4121 )

yidong72
and
okuchaiev
committedMay 14, 2022

Commits on Apr 30, 2022

Added encoder and decoder modules for RETRO model (#4038 )

committedApr 30, 2022

Commits on Apr 26, 2022

fix eval (#4054 )
yidong72
committedApr 26, 2022

Commits on Mar 30, 2022

Populate the GPT/BERT list_available_models with uploaded models (#3885 )
yidong72
committedMar 30, 2022

Commits on Mar 29, 2022

Make test_gpt_eval unit test less strict (#3898 )

yidong72
and
ericharper
committedMar 29, 2022

Commits on Mar 28, 2022

Add text_generation_util to support TopK, TopP sampling + Tabular Data Generation. (#3834 )

committedMar 28, 2022