v1.0.1
Release Highlights
🚀 Performance Measurement Improvements
This release addresses a critical challenge in API performance benchmarking by introducing dynamic prompt generation to mitigate potential caching effects.
Key Enhancements
- Randomized Prompt Generation
- Introduced a mechanism to generate input prompts of arbitrary lengths
- Prevents artificial inflation of prompt throughput metrics caused by caching
- Ensures more accurate and realistic performance measurements
- Binary Optimization
- Significantly reduced executable file size
- Maintains full functionality of the previous release
Changelog
- ✅ Added arbitrary length of dynamic prompt generation
- ✅ Reduced executable file size