Privacy Policy

Web Crawler Extension

Mwmbl provides a web crawler browser extension that volunteers can use to help us crawl the web.

No personal information is collected from your browser
No search or browsing history is accessed
No IP address is recorded
The extension crawls the web starting with a set of seed domains that are highly ranked by Hacker News users
After retrieving the HTML files, content is extracted, batched, and sent to our central server
We store a random unique ID that is stored locally with the extension and sent with the browser. This is used to help detect spam from malicious users.