Code

[feat] grpo latest support npu#6242

Code

Open

duanjunwen wants to merge 18 commits intohpcaitech:grpo-latest-npuhpcaitech/ColossalAI:grpo-latest-npufrom duanjunwen:grpo-latest-npuduanjunwen/ColossalAI:grpo-latest-npuCopy head branch name to clipboard

Commits

Commits on Mar 7, 2025

• fix inference rebatching bug

  

  YeAnbang

  authored and

  duanjunwen

  committed
  ef1c1cb

  Copy full SHA for ef1c1cb

• fix num_train_step update

  

  YeAnbang

  authored and

  duanjunwen

  committed
  01f84de

  Copy full SHA for 01f84de

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for bc66524
  

  pre-commit-ci[bot]

  authored and

  duanjunwen

  committed
  bc66524

  Copy full SHA for bc66524

• [misc] update torch version (hpcaitech#6206)

  Show description for ccc512a
  

  ver217

  authored and

  duanjunwen

  committed
  ccc512a

  Copy full SHA for ccc512a

• [hotfix] fix lora load (hpcaitech#6231)

  Show description for bcb5b60
  

  ver217

  authored and

  duanjunwen

  committed
  bcb5b60

  Copy full SHA for bcb5b60

• [release] update version (hpcaitech#6236)

  

  ver217

  authored and

  duanjunwen

  committed
  a7e3bec

  Copy full SHA for a7e3bec

Commits on Mar 11, 2025

• [feat] add ops test to adapt npu

  duanjunwen

  committed
  265d430

  Copy full SHA for 265d430

• [feat] test loss func & assert close

  duanjunwen

  committed
  e61bb0a

  Copy full SHA for e61bb0a

• detach

  

  Tong Li

  committed
  704866a

  Copy full SHA for 704866a

• [feat] support compare tools on npu

  duanjunwen

  committed
  bc6e14a

  Copy full SHA for bc6e14a

Commits on Mar 12, 2025

• [fix] fix qwen policy, now use gather output as logits

  duanjunwen

  committed
  6930c7c

  Copy full SHA for 6930c7c

• [fix] fix qwen lmhead, now gather output for logints

  duanjunwen

  committed
  4b24a03

  Copy full SHA for 4b24a03

Commits on Mar 13, 2025

• [feat] fix qwen Linear_Col --> VocalHead

  duanjunwen

  committed
  05ca507

  Copy full SHA for 05ca507

• [fix] fix

  duanjunwen

  committed
  2305f93

  Copy full SHA for 2305f93

• [fix] fix qwen VocabParallelLMHead1D and gather output

  duanjunwen

  committed
  03ce3c5

  Copy full SHA for 03ce3c5

• fix tp bug

  

  Tong Li

  authored and

  duanjunwen

  committed
  b835d1b

  Copy full SHA for b835d1b

• fix consumer

  

  Tong Li

  authored and

  duanjunwen

  committed
  137ec17

  Copy full SHA for 137ec17

• Merge branch 'grpo-latest' into grpo-latest-npu

  duanjunwen

  committed
  a9cf3aa

  Copy full SHA for a9cf3aa