-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Include the scripts for preprocessing OAST and unit tests for chat sft datasets #7112
Commits on Jul 14, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 06c9490 - Browse repository at this point
Copy the full SHA 06c9490View commit details -
Configuration menu - View commit details
-
Copy full SHA for 825a9de - Browse repository at this point
Copy the full SHA 825a9deView commit details -
adde special token only for huggingface model
Signed-off-by: Yi Dong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 8d1bc6a - Browse repository at this point
Copy the full SHA 8d1bc6aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 871f068 - Browse repository at this point
Copy the full SHA 871f068View commit details
Commits on Jul 16, 2023
-
print out error datapoint content
Signed-off-by: Yi Dong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for b49e619 - Browse repository at this point
Copy the full SHA b49e619View commit details -
Configuration menu - View commit details
-
Copy full SHA for f3374f7 - Browse repository at this point
Copy the full SHA f3374f7View commit details
Commits on Jul 17, 2023
-
Signed-off-by: Yi Dong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 199d575 - Browse repository at this point
Copy the full SHA 199d575View commit details -
try to be compatible with huggingface tokenizer
Signed-off-by: Yi Dong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 01d49d5 - Browse repository at this point
Copy the full SHA 01d49d5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 726effd - Browse repository at this point
Copy the full SHA 726effdView commit details
Commits on Jul 20, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 39192be - Browse repository at this point
Copy the full SHA 39192beView commit details
Commits on Jul 21, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 1912e97 - Browse repository at this point
Copy the full SHA 1912e97View commit details
Commits on Jul 23, 2023
-
Signed-off-by: Yi Dong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for d0c18f0 - Browse repository at this point
Copy the full SHA d0c18f0View commit details -
Configuration menu - View commit details
-
Copy full SHA for ca1526b - Browse repository at this point
Copy the full SHA ca1526bView commit details
Commits on Jul 25, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 5059a9e - Browse repository at this point
Copy the full SHA 5059a9eView commit details -
Configuration menu - View commit details
-
Copy full SHA for cb67e93 - Browse repository at this point
Copy the full SHA cb67e93View commit details -
added the unit test for chat sft dataset
Signed-off-by: Yi Dong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 8972863 - Browse repository at this point
Copy the full SHA 8972863View commit details
Commits on Jul 26, 2023
-
Signed-off-by: Yi Dong <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 5e9fbc8 - Browse repository at this point
Copy the full SHA 5e9fbc8View commit details
Commits on Jul 27, 2023
-
Configuration menu - View commit details
-
Copy full SHA for f737755 - Browse repository at this point
Copy the full SHA f737755View commit details -
Configuration menu - View commit details
-
Copy full SHA for d56302d - Browse repository at this point
Copy the full SHA d56302dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 199f900 - Browse repository at this point
Copy the full SHA 199f900View commit details -
Configuration menu - View commit details
-
Copy full SHA for cd9331b - Browse repository at this point
Copy the full SHA cd9331bView commit details
Commits on Jul 29, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 5016e69 - Browse repository at this point
Copy the full SHA 5016e69View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for c53662f - Browse repository at this point
Copy the full SHA c53662fView commit details