Skip to content

[Bug]: Qwen3.5 series model fail infer for gguf format #1513

@n1ck-guo

Description

@n1ck-guo

Problem Description

The model inference process may result in continuous repetition.

Reproduction Steps

Qwen3.5-122B Qwen3.5-397b

Environment Information

No response

Error Logs

The user wants to identify the subject in the image. this is a Labrador dog. a woman in pl. this is a Labrador dog wearing a blue and floral harness, a woman in pl in a woman, a Labrador dog. a woman, a woman, a Labrador dog, a woman, a Labrador, a Labrador dog, a Labrador, a Labrador, and a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, and a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador. a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a Labrador, a

</think>

The image features a Labrador dog. the image. a Labrador, a

Additional Context

No response

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions