Code

Sync torch titan#7

Code

Draft

philippguevorguian wants to merge 12 commits intomainYerevaNN/YNNtitan:mainfrom sync_torch_titanYerevaNN/YNNtitan:sync_torch_titanCopy head branch name to clipboard

+239-252

Commits

Commits on Aug 20, 2024

• Updated FSDP -> FSDPModule in doc

  Show description for b76d755
  awgu

  committed
  b76d755

  Copy full SHA for b76d755

• remove compiled_rmsnorm

  Show description for 40210ea
  tianyu-l

  committed
  40210ea

  Copy full SHA for 40210ea

Commits on Aug 21, 2024

• [MRG] relax the FP8 CUDA arch limitation to SM89 (pytorch#549)

  Show description for 90c889e
  

  leeeizhang

  and

  awgu

  authored
  90c889e

  Copy full SHA for 90c889e

Commits on Aug 22, 2024

• remove PP tracer

  Show description for b029b73
  tianyu-l

  committed
  b029b73

  Copy full SHA for b029b73

Commits on Aug 23, 2024

• [405B] Add performance data for 405B model (pytorch#554)

  Show description for 9515a14
  fduwjj

  authored
  9515a14

  Copy full SHA for 9515a14

• Fix the performance number for 405B (pytorch#556)

  Show description for 3faaa1a
  fduwjj

  authored
  3faaa1a

  Copy full SHA for 3faaa1a

• Fix the performance number for 405B (pytorch#557)

  Show description for c8d868b
  fduwjj

  authored
  c8d868b

  Copy full SHA for c8d868b

• Address comment from PR(pytorch#557) (pytorch#558)

  fduwjj

  authored
  21e8b55

  Copy full SHA for 21e8b55

• [ez] Remove legacy float8 enabling flag in 405B toml (pytorch#559)

  Show description for 3bdccb9
  fduwjj

  authored
  3bdccb9

  Copy full SHA for 3bdccb9

• add contributing guidelines

  Show description for 8c497b7
  tianyu-l

  committed
  8c497b7

  Copy full SHA for 8c497b7

Commits on Aug 24, 2024

• Merge pull request #6 from pytorch/main

  Show description for 2e55278
  philippguevorguian

  authored
  2e55278

  Copy full SHA for 2e55278

• Merge branch 'main' into sync_torch_titan

  philippguevorguian

  authored
  527229d

  Copy full SHA for 527229d