Code

Self tuning v1#4

Code

Open

priyakasimbeg wants to merge 63 commits intomainpriyakasimbeg/algorithmic-efficiency:mainfrom self_tuning_v1priyakasimbeg/algorithmic-efficiency:self_tuning_v1Copy head branch name to clipboard

+476-1

Commits

Commits on Apr 2, 2024

• firs stab at self-tuning submission

  priyakasimbeg

  committed
  878966c

  Copy full SHA for 878966c

• checkpoint initial params

  priyakasimbeg

  committed
  ad941a9

  Copy full SHA for ad941a9

• fix typo

  priyakasimbeg

  committed
  e6fccf4

  Copy full SHA for e6fccf4

• fix typo

  priyakasimbeg

  committed
  218dcdb

  Copy full SHA for 218dcdb

• fix

  priyakasimbeg

  committed
  25a4999

  Copy full SHA for 25a4999

• fixes

  priyakasimbeg

  committed
  5e9afe5

  Copy full SHA for 5e9afe5

• fixes

  priyakasimbeg

  committed
  c17753d

  Copy full SHA for c17753d

• fix

  priyakasimbeg

  committed
  dd8c31c

  Copy full SHA for dd8c31c

• fix

  priyakasimbeg

  committed
  304eccd

  Copy full SHA for 304eccd

• fix

  priyakasimbeg

  committed
  e05d6ac

  Copy full SHA for e05d6ac

• fix

  priyakasimbeg

  committed
  36cef79

  Copy full SHA for 36cef79

• add extra points

  priyakasimbeg

  committed
  ba4ed6d

  Copy full SHA for ba4ed6d

• don't unreplicate model params in checkpoint of initial weights

  priyakasimbeg

  committed
  82a8587

  Copy full SHA for 82a8587

• fix replication issue for loading checkpoint

  priyakasimbeg

  committed
  44438d8

  Copy full SHA for 44438d8

Commits on Apr 3, 2024

• replicate params

  priyakasimbeg

  committed
  b1529a0

  Copy full SHA for b1529a0

• attempt to fix checkpointing

  priyakasimbeg

  committed
  62db565

  Copy full SHA for 62db565

• wandb logging fix for self tuning ruleset

  priyakasimbeg

  committed
  976823e

  Copy full SHA for 976823e

• allow variable training horizons

  priyakasimbeg

  committed
  5f607c7

  Copy full SHA for 5f607c7

• fix dict

  priyakasimbeg

  committed
  d25ad20

  Copy full SHA for d25ad20

• fix appending for optimizer states

  priyakasimbeg

  committed
  17d1560

  Copy full SHA for 17d1560

• fix appending for optimizer states

  priyakasimbeg

  committed
  08a12cc

  Copy full SHA for 08a12cc

• fix return of initializer fn

  priyakasimbeg

  committed
  d0a00f6

  Copy full SHA for d0a00f6

• fix

  priyakasimbeg

  committed
  8ec7261

  Copy full SHA for 8ec7261

• fix

  priyakasimbeg

  committed
  3fd010d

  Copy full SHA for 3fd010d

• debugging

  priyakasimbeg

  committed
  e6d2bd9

  Copy full SHA for e6d2bd9

• fix

  priyakasimbeg

  committed
  6166c96

  Copy full SHA for 6166c96

• log lr

  priyakasimbeg

  committed
  e11040d

  Copy full SHA for e11040d

• remove optimizer state donation

  priyakasimbeg

  committed
  40d5b13

  Copy full SHA for 40d5b13

• check in nadamw points

  priyakasimbeg

  committed
  4a00c27

  Copy full SHA for 4a00c27

• modify

  priyakasimbeg

  committed
  269f5b5

  Copy full SHA for 269f5b5

• modify

  priyakasimbeg

  committed
  645c66b

  Copy full SHA for 645c66b

• update points

  priyakasimbeg

  committed
  b7dda6f

  Copy full SHA for b7dda6f

• donate optmizer state buffer

  priyakasimbeg

  committed
  7b09e03

  Copy full SHA for 7b09e03

• move params zeros like out of loop

  priyakasimbeg

  committed
  efc0b32

  Copy full SHA for efc0b32

• move replicate out of init fn

  priyakasimbeg

  committed
  7708283

  Copy full SHA for 7708283

• debugging

  priyakasimbeg

  committed
  fe34043

  Copy full SHA for fe34043

• clear caches in opt initializer

  priyakasimbeg

  committed
  8b1e8e4

  Copy full SHA for 8b1e8e4

• undo replicating stuff

  priyakasimbeg

  committed
  1b9e6ee

  Copy full SHA for 1b9e6ee

• debugging criteo

  priyakasimbeg

  committed
  bdcaef3

  Copy full SHA for bdcaef3

• debugging criteo

  priyakasimbeg

  committed
  874df2d

  Copy full SHA for 874df2d

• move opt init to update

  priyakasimbeg

  committed
  b67aa72

  Copy full SHA for b67aa72

• fix

  priyakasimbeg

  committed
  f81f973

  Copy full SHA for f81f973

• fix

  priyakasimbeg

  committed
  154c191

  Copy full SHA for 154c191

• fix

  priyakasimbeg

  committed
  e67e5ae

  Copy full SHA for e67e5ae

• replicating opt state

  priyakasimbeg

  committed
  6c80565

  Copy full SHA for 6c80565

• default traing horizon

  priyakasimbeg

  committed
  4b30fab

  Copy full SHA for 4b30fab

• add back logging for lr rate

  priyakasimbeg

  committed
  9523129

  Copy full SHA for 9523129

• fix logging

  priyakasimbeg

  committed
  ab1ba5e

  Copy full SHA for ab1ba5e

• debug

  priyakasimbeg

  committed
  6dd597e

  Copy full SHA for 6dd597e

• add delete opt state

  priyakasimbeg

  committed
  bb078ad

  Copy full SHA for bb078ad

• add delete opt state

  priyakasimbeg

  committed
  d37131d

  Copy full SHA for d37131d

• remove eval for debugging

  priyakasimbeg

  committed
  1c2ef29

  Copy full SHA for 1c2ef29

• replicate current params

  priyakasimbeg

  committed
  07a24f9

  Copy full SHA for 07a24f9

• fix

  priyakasimbeg

  committed
  57da39b

  Copy full SHA for 57da39b

Commits on Apr 4, 2024

• clean up

  priyakasimbeg

  committed
  18a6a67

  Copy full SHA for 18a6a67

• fix

  priyakasimbeg

  committed
  342ef6b

  Copy full SHA for 342ef6b

• fix

  priyakasimbeg

  committed
  adfa75d

  Copy full SHA for adfa75d

• debugging

  priyakasimbeg

  committed
  cea23a5

  Copy full SHA for cea23a5

• debugging

  priyakasimbeg

  committed
  f331017

  Copy full SHA for f331017

• debugging

  priyakasimbeg

  committed
  c09a82e

  Copy full SHA for c09a82e

• debugging

  priyakasimbeg

  committed
  c556071

  Copy full SHA for c556071

• push

  priyakasimbeg

  committed
  05d26b7

  Copy full SHA for 05d26b7

Commits on Apr 5, 2024

• enable evals

  priyakasimbeg

  committed
  6bb65ee

  Copy full SHA for 6bb65ee