OnnxSlim can help you slim your onnx model, with less operators, but same accuracy, better inference speed.
- 🚀 OnnxSlim is merged to mnn-llm, performance increased by 5%
- 🚀 Rank 1st in the AICAS 2024 LLM inference optimization challenge held by Arm and T-head
- 🚀 OnnxSlim is merged into ultralytics ❤️❤️❤️
- 🚀 OnnxSlim is merged into transformers.js 🤗🤗🤗
pip install onnxslimpip install git+https://github.com/inisis/OnnxSlim@maingit clone https://github.com/inisis/OnnxSlim && cd OnnxSlim/
pip install .onnxslim your_onnx_model slimmed_onnx_model
For more usage, see onnxslim -h or refer to our examples
Discord: https://discord.gg/nRw2Fd3VUS QQ Group: 873569894