Skip to content

qwen2.5-vl的awq量化问题 #4762

@huhuhu777

Description

@huhuhu777

我在采用自定义数据集作校准集的时候会发生显存溢出,数据格式为下面这种jsonl文件:
{"messages": [{"role": "user", "content": "\n 请根据以下规则,对图片进行分类:\n\n 分类约束:……省略"}, {"role": "assistant", "content": "二维码"}], "images": ["二维码/a71505d8a820d7ed965c5fbc3a4d3d37.jpg"]}
……

但是用官方数据集则不会发生显存溢出的问题且显存充足,这是为什么?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions