Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 1, 2025

• remote the causal option for simplicity

  sjjeong94

  committed
  d068688

  Copy full SHA for d068688

Commits on Nov 9, 2024

• add the gelu activation to the linear kernel

  sjjeong94

  committed
  2308e5e

  Copy full SHA for 2308e5e

Commits on Nov 2, 2024

• focus on the forward pass

  sjjeong94

  committed
  abfe565

  Copy full SHA for abfe565

• add a linear kernel

  sjjeong94

  committed
  e2a904e

  Copy full SHA for e2a904e

Commits on Oct 31, 2024

• add an attention kernel from the triton tutorials

  sjjeong94

  committed
  828163a

  Copy full SHA for 828163a

Commits on Oct 30, 2024

• fix the non-contiguous tensor case in layernorm

  sjjeong94

  committed
  a51d061

  Copy full SHA for a51d061

Commits on Oct 24, 2024

• modify rmsnorm - calculate multiple rows

  sjjeong94

  committed
  90f83b0

  Copy full SHA for 90f83b0

Commits on Oct 16, 2024

• add qkv_concat

  188zzoon

  committed
  c78f28b

  Copy full SHA for c78f28b

• add modulation_scale_shift, modulation_gate_proj

  188zzoon

  committed
  b8ad847

  Copy full SHA for b8ad847

• add linear, silu

  188zzoon

  committed
  d16b4c8

  Copy full SHA for d16b4c8

Commits on Oct 5, 2024

• add the double stream block to modules

  sjjeong94

  committed
  eac395b

  Copy full SHA for eac395b

Commits on Oct 3, 2024

• add the single stream block to modules

  sjjeong94

  committed
  617cb41

  Copy full SHA for 617cb41

• add benchmarks for the rms norm backward kernel

  sjjeong94

  committed
  6bcc77c

  Copy full SHA for 6bcc77c

Commits on Oct 1, 2024

• replace flux normalization with triton kernels

  sjjeong94

  committed
  44c23d8

  Copy full SHA for 44c23d8

• replace flux rope with a triton kernel

  sjjeong94

  committed
  07a8a8e

  Copy full SHA for 07a8a8e

Commits on Sep 24, 2024

• add rms norm backward kernel

  sjjeong94

  committed
  e27cf1b

  Copy full SHA for e27cf1b

Commits on Sep 22, 2024

• update test parameters

  sjjeong94

  committed
  8c4a9f2

  Copy full SHA for 8c4a9f2

Commits on Sep 18, 2024

• compare baseline single block with compiled one

  sjjeong94

  committed
  af4941d

  Copy full SHA for af4941d

Commits on Sep 17, 2024

• tests

  sjjeong94

  committed
  3baa0d6

  Copy full SHA for 3baa0d6

• make a module

  sjjeong94

  committed
  ae6fb66

  Copy full SHA for ae6fb66

• simplify rope

  sjjeong94

  committed
  5707da8

  Copy full SHA for 5707da8

• simplify normalizations

  sjjeong94

  committed
  0ab082b

  Copy full SHA for 0ab082b

• update result figures

  sjjeong94

  committed
  9713977

  Copy full SHA for 9713977

Commits on Sep 16, 2024

• add rope kernel

  sjjeong94

  committed
  ee0f7fc

  Copy full SHA for ee0f7fc

Commits on Sep 15, 2024

• add rms norm kernel

  sjjeong94

  committed
  ec10009

  Copy full SHA for ec10009

• layer norm modulation fwd result on h100

  sjjeong94

  committed
  613d40b

  Copy full SHA for 613d40b

Commits on Sep 10, 2024

• add flux block modules

  sjjeong94

  committed
  d7b64b2

  Copy full SHA for d7b64b2

Commits on Aug 5, 2024

• layer norm modulation fwd result on a100

  sjjeong94

  committed
  670c659

  Copy full SHA for 670c659

Commits on Jul 31, 2024

• layer norm modulation fwd figure

  sjjeong94

  committed
  9e731e8

  Copy full SHA for 9e731e8

• layer_norm_modulation torch.compile result

  sjjeong94

  committed
  d49df1c

  Copy full SHA for d49df1c

• first commit

  sjjeong94

  committed
  74d1311

  Copy full SHA for 74d1311