8000 GitHub - Crispy256/qtar: 机械磁盘复制百万小文件原理就是先给要 copy 的文件排序,让接下来 tar 读取文件时尽可能少地移动磁头
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
/ qtar Public
forked from heguangyu5/qtar

机械磁盘复制百万小文件原理就是先给要 copy 的文件排序,让接下来 tar 读取文件时尽可能少地移动磁头

Notifications You must be signed in to change notification settings

Crispy256/qtar

 
 

Repository files navigation

qtar

See https://www.simula.no/publications/improving-disk-io-performance-linux

This is a minimal test program writing to /tmp/z.tar without any compression.

Usage

sudo qtar /path/to/input-dir > /tmp/files.list
cd /path/to/input-dir
sudo tar zcf /tmp/a.tar.gz -T /tmp/files.list

OR

./qtar-tar-gz.sh /path/to/input-dir /path/to/output.tar.gz
注意路径要用绝对路径

问题

  1. archive_write_set_format_ustar 不能处理长文件名
  2. archive_write_set_format_pax Can't translate pathname 'XXX' to UTF-8

About

机械磁盘复制百万小文件原理就是先给要 copy 的文件排序,让接下来 tar 读取文件时尽可能少地移动磁头

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 90.6%
  • Shell 6.5%
  • Makefile 2.1%
  • C 0.8%
0