Tags: AndrewShukhtin/warp
Tags
Use fully random input (minio#167) Instead of using a 10MiB circular buffer with random data, use an infinite stream that is encrypted continuously. We use a smaller circular buffer as input, but repeats should not be present. Provides good solid speed, per thread: ``` BenchmarkWithRandomData/64KB-32 83332 14328 ns/op 4573.91 MB/s 72 B/op 4 allocs/op BenchmarkWithRandomData/1MB-32 5216 222968 ns/op 4702.82 MB/s 72 B/op 4 allocs/op BenchmarkWithRandomData/10MB-32 542 2223248 ns/op 4716.42 MB/s 72 B/op 4 allocs/op BenchmarkWithRandomData/1GB-32 1 2272999700 ns/op 4723.90 MB/s 80 B/op 4 allocs/op ```
Fix crash when there isn't enough data (minio#158) When there isn't enough data for a full segment the segment duration will be 0 causing a crash. Before: ``` λ go build && warp analyze warp-mixed-2021-01-04[011541]-58G4.csv.zst 1481 operations loaded... Done! panic: internal error: so.PerSegDuration <= 0 goroutine 77 [running]: github.com/minio/warp/pkg/bench.Operations.Segment(0xc00038e000, 0x0, 0xe9, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) e:/gopath/src/github.com/minio/warp/pkg/bench/analyze.go:142 +0x935 github.com/minio/warp/pkg/aggregate.Aggregate.func2(0xc0001800a0, 0x4, 0x5, 0xc0002e2d80, 0x4, 0x4, 0xc001bba030, 0xc0004027a0, 0xc0004027c0, 0x2) e:/gopath/src/github.com/minio/warp/pkg/aggregate/aggregate.go:191 +0x546 created by github.com/minio/warp/pkg/aggregate.Aggregate e:/gopath/src/github.com/minio/warp/pkg/aggregate/aggregate.go:164 +0x790 ``` After: ``` λ go build && warp analyze warp-mixed-2021-01-04[011541]-58G4.csv.zst 1481 operations loaded... Done! Mixed operations. Operation: DELETE, 1%, Concurrency: 96, Duration: 53s. * Throughput: 0.58 obj/s Operation: GET, 52%, Concurrency: 100, Duration: 54s. * Throughput: 114.06 MiB/s, 2.28 obj/s Operation: PUT, 0%, Concurrency: 0, Duration: 0s. Skipping PUT too few samples. Operation: STAT, 40%, Concurrency: 99, Duration: 58s. * Throughput: 1.64 obj/s Cluster Total: 106.26 MiB/s, 3.99 obj/s over 58s. ``` Fixes minio#156