You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+7-13Lines changed: 7 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,29 +1,23 @@
1
-
# Tinker Cookbook
2
-
1
+
<h1align="center">Tinker Cookbook</h1>
3
2
<divalign="center">
4
3
<imgsrc="assets/tinker-cover.png"width="60%" />
5
-
<br/>
6
-
<em>Tinker: a training API for researchers and developers</em>
7
-
<br/>
8
-
<div></div>
9
-
<div></div>
10
4
</div>
11
5
6
+
We present two libraries to help the broader community customize their language models: `tinker` and `tinker-cookbook`.
12
7
13
-
To help the broader community customize their language models, we release two libraries: Tinker and Tinker Cookbook.
14
-
- Tinker includes primitives to fine-tune language models. It sends API requests to us, while we handle the complexity of distributed training.
15
-
- Tinker Cookbook includes realistic examples to fine-tune language models. It builds on the Tinker API and provides commonly used abstractions to fine-tune language models.
8
+
-`tinker` is a training SDK for researchers and developers to fine-tune language models. You send API requests to us and we handle the complexities of distributed training.
9
+
-`tinker-cookbook` includes realistic examples of fine-tuning language models. It builds on the Tinker API and provides common abstractions to fine-tune language models.
16
10
17
11
## Installation
18
12
19
-
1. Obtain a Tinker API token and export it as `TINKER_API_KEY`. // TODO(tianyi): add onboarding flow link
13
+
1. Obtain a Tinker API token and export it as environment variable `TINKER_API_KEY`. You will only be able to do this after you have access to Tinker. Sign up for waitlist at [thinkingmachines.ai/tinker](https://thinkingmachines.ai/tinker). After you have access, you can create an API key from your console: [tinker-console.thinkingmachines.ai](https://tinker-console.thinkingmachines.ai).
20
14
2. Install tinker python client via `pip install tinker`
21
15
3. We recommend installing `tinker-cookbook` in a virtual env either with `conda` or `uv`. For running most examples, you can install via `pip install -e .`.
22
16
23
17
## Tinker
24
18
25
19
Refer to the [docs](https://tinker-docs.thinkingmachines.ai/training-sampling) to start from basics.
26
-
We introduce a few Tinker primitives, the basic components to fine-tune LLMs.
20
+
Here we introduce a few Tinker primitives - the basic components to fine-tune LLMs:
`tinker_cookbook/recipes/sl_loop.py` and `tinker_cookbook/recipes/rl_loop.py` include minimal examples of using these primitives to fine-tune LLMs.
36
+
See [tinker_cookbook/recipes/sl_loop.py](tinker_cookbook/recipes/sl_loop.py) and [tinker_cookbook/recipes/rl_loop.py](tinker_cookbook/recipes/rl_loop.py) for minimal examples of using these primitives to fine-tune LLMs.
0 commit comments