Minimalist backend simulation for developing with Arweave-js
- In the root directory:
npm install - Install MongoDb
- Open a terminal and start the MongoDB daemon
For OSX M1 Install Rosetta
1. Open Finder and navigate to Applications/Utilities
2. Right click on Terminal
3. Check the box for "Open using Rosetta"
4. Install
Then install Mongo with brew:
brew tap mongodb/brew
brew update
brew install mongodb-community@5.0
brew services start mongodb-community@5.0
mongosh
- In a separate terminal run
npm run dev
Create .env in root with parameters
touch .env
Example parameters
PORT=1984
LIMIT=50mb
MODE=test
MODE=dev is for developing datweave
MODE=test is for testing datweave
npm run dev with MODE=dev will listen to port 1984 and with MODE=test will run via Jest.
npm run test
This will watch for changes and immediately run tests.
Do not need to open in a new terminal or have MongoDB or Node running. Jest and MongoMemoryServer will take care of this, but do need to set MODE=test.
- /dat contains endpoints specific to datweave. Needed to have a way to relate wallets to their transactions without relying on retrieving metadata from Solana so that datweave can be used independently offline.
Example of how to upload large files to Arweave from the Arweave-js README.md:
let data = fs.readFileSync('path/to/file.pdf'); // get the same data
let resumeObject = JSON.parse(savedUploader); // get uploader object from where you stored it.
let uploader = await arweave.transactions.getUploader(resumeObject, data);
while (!uploader.isComplete) {
await uploader.uploadChunk();
}
After uploading data to Arweave, datweave expects the following call to associate the transaction id with wallet address that it belongs to.
This is a simplication of what Arweave does in production.
arweave.api.post(`/wallet/dat?address=${arweaveAddress}&txnID=${txId}`)
async findDataByOwner(address) {
return (await arweave.api.get(`/tx/dat/${address}`)).data.transactions
}
Show databases
show dbs
Display all records from collection
show dbs
use <dbs name>
show collections
db.<collection name>.find({})
Find a record and ignore chunk property
db.transactions.find({id: "4Z7FstvUq4JExe-KpvEJbORt3VoVyr5cCTeTBbX0-Lk"}, {chunk:0}).pretty()
Examine a specific chunk
db.transactions.find({id: "4Z7FstvUq4JExe-KpvEJbORt3VoVyr5cCTeTBbX0-Lk"}, {chunk: "145978"}).pretty()
Count documents
db.transactions.countDocuments()
Delete one document e.g.
db.wallets.deleteOne({_id: ObjectId("623cc2c2c032fde16a31aeb5")})
Delete all documents
db.transactions.deleteMany({})
Export record to file
mongoexport --db datweave --collection wallets --out wallets.json