Code

DeepSeek_v3 support#1735

Code

Open

srajabos wants to merge 18 commits intohuggingface:mainhuggingface/optimum-habana:mainfrom srajabos:DeepSeek_v3srajabos/optimum-habana:DeepSeek_v3Copy head branch name to clipboard

+2,253

Commits

Commits on Feb 18, 2025

• Resolve rebase conflicts on DeepSeek_v3

  

  srajabos

  authored and

  skavulya

  committed
  aca9778

  Copy full SHA for aca9778

• Update __init__.py

  

  srajabos

  authored and

  skavulya

  committed
  a8fdecd

  Copy full SHA for a8fdecd

• Update __init__.py

  

  srajabos

  authored and

  skavulya

  committed
  3e7a00e

  Copy full SHA for 3e7a00e

• Update modeling_deepseek_v3.py

  

  srajabos

  authored and

  skavulya

  committed
  8629818

  Copy full SHA for 8629818

• Support optimized KV cache, static MOE and expert parallelism

  skavulya

  committed
  a161a36

  Copy full SHA for a161a36

• Commented out attention_mask assertion for the mmlu tests

  

  pallavijaini0525

  authored and

  skavulya

  committed
  da80fba

  Copy full SHA for da80fba

• Support optimized fusedDSPA, RoPE and RMS

  

  srajabos

  authored and

  skavulya

  committed
  34f8ff7

  Copy full SHA for 34f8ff7

• Commented out attention_mask assertionn

  

  pallavijaini0525

  authored and

  skavulya

  committed
  937deeb

  Copy full SHA for 937deeb

• Change references to deepseekv2 to deepseekv3

  skavulya

  committed
  e32aadd

  Copy full SHA for e32aadd

• Override load_state_dict to support deepseek-R1

  Show description for 37a0431
  skavulya

  committed
  37a0431

  Copy full SHA for 37a0431

• Added dynamic MoE changes

  

  srajabos

  authored and

  skavulya

  committed
  7b0b9cf

  Copy full SHA for 7b0b9cf

• Fix multicard expert parallelism for deepseekv3

  skavulya

  committed
  33e792c

  Copy full SHA for 33e792c

• Delete duplicate tests accidentally copied

  skavulya

  committed
  71de78c

  Copy full SHA for 71de78c

• Refactor deepseek_v3 and add clarifying comments

  skavulya

  committed
  1336c14

  Copy full SHA for 1336c14

• Fix edge case in expert slices in DeepSeek-V3

  skavulya

  committed
  e02c6de

  Copy full SHA for e02c6de

• Add deepseekv3 to list of models supporting reuse_cache

  skavulya

  committed
  96a3473

  Copy full SHA for 96a3473

• Style fix in modeling_utils

  skavulya

  committed
  5e95f58

  Copy full SHA for 5e95f58

Commits on Feb 19, 2025

• Updated the README.md for the deepseek-r1-bf16

  pallavijaini0525

  committed
  9bb5601

  Copy full SHA for 9bb5601