Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

First merge to main #1

Merged
merged 25 commits into from
Apr 8, 2024
Merged

First merge to main #1

Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
33dee16
add inference script
kimmypracha Jan 26, 2024
e0f6b4b
add evaluation script
kimmypracha Jan 26, 2024
331f68c
initial fine-tune folder.
kimmypracha Apr 3, 2024
852d7f4
update inference folder.
kimmypracha Apr 3, 2024
46a181b
add oasst processing script
kimmypracha Apr 4, 2024
b829420
initiate the folder format
kimmypracha Apr 4, 2024
fee52da
initiate the README.md file
kimmypracha Apr 4, 2024
eea2672
initial draft for README file
kimmypracha Apr 5, 2024
9e11046
clean preprocessing code
kimmypracha Apr 5, 2024
9098a43
change evaluation and validation path in the script
kimmypracha Apr 5, 2024
e8a9f0d
change fine-tune path in the script
kimmypracha Apr 5, 2024
8b3f7fa
change path in the inference script
kimmypracha Apr 5, 2024
0eb9355
add README for preprocessing
kimmypracha Apr 5, 2024
d1925f2
Adding essential data-generation files
AtharvaNijasure Apr 6, 2024
7bb300a
Few more changes
AtharvaNijasure Apr 6, 2024
00a97a0
cleaned the evaluation script
kimmypracha Apr 7, 2024
023d246
write a document for evaluation
kimmypracha Apr 7, 2024
f2fe28a
Write a document for fine-tuning
kimmypracha Apr 7, 2024
1c536db
write a document for inference.
kimmypracha Apr 7, 2024
f55999b
write a document for preprocessing
kimmypracha Apr 7, 2024
289d02f
clean the code and add more data in the folder
kimmypracha Apr 7, 2024
d47d9c0
add relevant data
kimmypracha Apr 8, 2024
1536f6c
add anonimity
kimmypracha Apr 8, 2024
451b00b
remove the description for now
kimmypracha Apr 8, 2024
2be8d08
add the data-generation section
kimmypracha Apr 8, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
change fine-tune path in the script
  • Loading branch information
@kimmypracha
kimmypracha committed Apr 5, 2024
commit e8a9f0d4d6587b64ab6f2661e63c2e8ee163978b
2 changes: 1 addition & 1 deletion src/fine-tuning/fine-tune.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ python3.9 qlora.py \
--warmup_ratio 0.03 \
--lr_scheduler_type constant \
--gradient_checkpointing \
--dataset ./data/marunachef/train_v6.jsonl \
--dataset ../../data/recipe/02_oasst/train_v6.jsonl \
--dataset_format oasst1 \
--run_name phi-1_5-marunachef-v1 \
--source_max_len 0 \
Expand Down