8000 GitHub - scjzhang/tools: Some useful tools
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

scjzhang/tools

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

38 Commits
 
 
 
 

Repository files navigation

Introduction

A inference benchmark tool, you can base on this tool to extend usage for different benchmark purpose. You can add a dataloader to provide your dataset for benchmarking, and also you can add your backend for benchmarking on different framework or models.

This tool provides several basic benchmarkers, like mlperf, direct, nlp_generative.

Usage

Install python packages

    pip install -r requirement.txt

Benchmark on single gpu

    python runner.py -m facebook/opt-1.3b -b 1 -s 16

Benchmark on multiple gpus

    deepspeed --num_gpus 2 runner.py -m facebook/opt-1.3b -b 1 -s 16

Builtin supported models

- facebook/opt-1.3b
- t5-3b
- EleutherAI/gpt-j-6B
- decapoda-research/llama-7b-hf
- decapoda-research/llama-13b-hf
- decapoda-research/llama-30b-hf
- decapoda-research/llama-65b-hf 
- bigscience/bloom-7b1
- bigscience/bloom
- microsoft/bloom-deepspeed-inference-fp16

For more details info

python runner.py -h

About

Some useful tools

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 95.9%
  • Shell 4.1%
0