HWDFS is a distributed file system for high availability, high performance, and low cost. It is a linux-based file system that provides high reliability and concurrent access through backup and erasure coding technology. Developers can expand the update scheme with custom erasure codes by implementing the API interface provided by the system. At present, the system has implemented some of the most advanced update schemes. HWDFS is mainly designed for large files larger than 64MB.
The project is still in the development stage, many bugs have not been fixed, and it is still unable to meet all the scenarios that may appear in the real world. If you find them, please feel free to submit bugs. If you have any questions or feedback, please contact and join us, we appreciate your contribution.
- Erasure Code:
- TSCNS
- Apache Thrift
- TinyXML
- Robin-Map
- MSR Cambridge Traces
- Install Apache Thrift.
- Build Project.
mkdir build; cd build; cmake .. make
- Use
./client -h
to view all commands on the client. - Use
./data_server
to run data node, use./parity_server
to run parity node - you can change Update Scheme, IP Address and Port in
config.xml