Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 14, 2024

• Add a deprecation notice + short explanation of "composite embeddings"

  apehex

  committed
  addce7e

Commits on Sep 20, 2024

• Take a smaller gif capture

  apehex

  committed
  1b19116

Commits on Sep 19, 2024

• Tidy + fix typos

  apehex

  committed
  c24bd25

• Reorder the comparison subsections + update TOC

  apehex

  committed
  4841d11

• Illustrate the whole process of binary predictions

  apehex

  committed
  d005cc4

• Remove the borders

  apehex

  committed
  4fe8da2

• Change the header image

  apehex

  committed
  ec5a95d

Commits on Sep 18, 2024

• Edit the remaining sections

  apehex

  committed
  e36276f

Commits on Sep 17, 2024

• Merge the sections "language basis" and "tokenization" + move the "binary predictions" after the sections on embeddings + tidy

  apehex

  committed
  6223cf3

• Rewrite the TLDR + tidy

  apehex

  committed
  c429409

• Rewrite the introduction

  apehex

  committed
  5a09350

Commits on Sep 14, 2024

• Add pytorch implementations + tidy

  apehex

  committed
  5d31b6f

• Improve the tldr + tidy

  apehex

  committed
  13cd6d7

Commits on Sep 13, 2024

• Match colors between inputs and embeddings

  apehex

  committed
  d7fb5dc

Commits on Sep 12, 2024

• Write the tldr + tidy

  apehex

  committed
  b7a732c

Commits on Sep 11, 2024

• Write the comparison section + tidy

  apehex

  committed
  5e2b0c9

Commits on Sep 10, 2024

• Illustrate the process from inputs to composite embeddings

  apehex

  committed
  a92b686

Commits on Sep 8, 2024

• Add a diagram describing binary predictions + add random thoughts

  apehex

  committed
  b3b8194

Commits on Sep 7, 2024

• Tidy + add TOC

  apehex

  committed
  e964740

Commits on Sep 6, 2024

• Write the introduction and input embedding sections

  apehex

  committed
  18e0c0f

• Shorten the tables

  apehex

  committed
  3feaa33

Commits on Sep 5, 2024

• Add examples and tables of embedding vectors + start writing

  apehex

  committed
  17c22b6

• Tidy + fix typos

  apehex

  committed
  1790ab9

Commits on Sep 4, 2024

• Add PCA / UMAP plots of tokun embeddings

  apehex

  committed
  8cdce25

Commits on Sep 3, 2024

• Add random points

  apehex

  committed
  7c0089c

Commits on Sep 2, 2024

• Crop the tiktokenizer screens + add composite embeddings

  apehex

  committed
  205b3e1

• Draft the last article of the serie, on composite embeddings

  apehex

  committed
  5e1276d

• Rename the screenshots to differentiate from future images

  apehex

  committed
  40d8695

Commits on Sep 1, 2024

• Match the latest mlable API

  apehex

  committed
  e6400a7

Commits on Aug 29, 2024

• Fix typo

  apehex

  committed
  c830822

Commits on Aug 27, 2024

• Squeeze the feature axis during detokenization

  apehex

  committed
  560c4b8

• Flatten the raw predictions + fix typo + use reshaping ops

  apehex

  committed
  d45a169

Commits on Aug 22, 2024

• Adapt the pipeline to the latest model (0.13.1)

  apehex

  committed
  a90daa3

• Turn the byte values straight into embeddings

  apehex

  committed
  3332be3

Commits on Aug 20, 2024

• Control the dtype of the unicode dataset

  apehex

  committed
  cd2acd8

Pagination

PreviousNext