8000 添加tokens生成速度 · Issue #73 · QwenLM/qwen.cpp · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
This repository was archived by the owner on Dec 6, 2024. It is now read-only.
This repository was archived by the owner on Dec 6, 2024. It is now read-only.
添加tokens生成速度 #73
Open
Open
添加tokens生成速度#73
@OliverQueen1466

Description

@OliverQueen1466
OliverQueen1466
opened on Jan 22, 2024

能否添加一个在推理结束之后，输出prefill和decode速度（token/s）的功能，谢谢

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions
      0