Skip to content

[Kunlunxin] Fix duplicate generation - #332

Merged
cyber-pioneer merged 2 commits into
flagos-ai:v0.1.0from
0songHan:fix/kunlunxin-duplicate-generation
Aug 13, 2026
Merged

[Kunlunxin] Fix duplicate generation#332
cyber-pioneer merged 2 commits into
flagos-ai:v0.1.0from
0songHan:fix/kunlunxin-duplicate-generation

Conversation

@0songHan

Copy link
Copy Markdown

PR Category

Vendor

PR Type

Bug Fixes

Description

This PR fixes the duplicate generation issue on Kunlunxin by patching the sampler RNG implementation to ensure consistent sampling behavior during inference.

Related Issues

N/A

Changes

  • Patch the sampler RNG implementation for Kunlunxin.
  • Fix the duplicate generation issue during model inference.
  • Keep the implementation transparent to existing inference workflows.

Testing

Validated on Kunlunxin hardware with:

  • Qwen3.5-35B-A3B
  • Qwen3.6-27B

Verified that the duplicate generation issue is resolved on both models.

Checklist

  • I have run the existing tests and they pass
  • I have added tests for my changes (if applicable)
  • I have updated the documentation (if applicable)

@github-actions github-actions Bot added the core label Jul 31, 2026
@CLAassistant

CLAassistant commented Jul 31, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@0songHan

Copy link
Copy Markdown
Author

The Lint Check is failing due to an existing lint issue intests/e2e_tests/serving/test_bge_m3.py, which is not modified by this PR. Could you please confirm whether this PR can be merged despite the unrelated lint failure?

@cyber-pioneer
cyber-pioneer merged commit c802754 into flagos-ai:v0.1.0 Aug 13, 2026
28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants