8000 Commits · simplecto/sitemap_grabber · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Oct 12, 2024

build(pyproject.toml): fix the version name scheme
Developer
committed
build(pyproject.toml): added commitizen config to pyproject.toml
Developer
committed
build(.gitignore): dont save vscode things
Developer
committed
docs(README.md): add docs for using flit in prep for release management
Developer
committed
build: added commitizen to pre-commit
Developer
committed
Adding mkdocs
Developer
committed

Commits on Oct 11, 2024

* Added a fetch_all() method to WellKnowns
Developer
committed

Commits on Oct 10, 2024

* pinned all version requirements
Developer
committed
* added dependabot config
Developer
committed
* added readme (finally)
Developer
committed
* use absolute imports
Developer
committed
* forgot to pip install requirements. oops
Developer
committed
* missed a file
Developer
committed
* added first run at CI/CD and github workflows
Developer
committed
removed responses mock testing library
Developer
committed
pycharm changes
Developer
committed
linting improvements
Developer
committed
converted test_well_known_files.py to use unittest.mock because responses does not support curl_cffi
Developer
committed
converted test_sitemap_grabber.py to use unittest.mock because responses does not support curl_cffi
Developer
committed
rewrite tests because responses cannot mock curl_cffi
Developer
committed
- bump all dev versions for linting
Developer
committed

Commits on Oct 9, 2024

- purge bandit (that is part of ruff)
Developer
committed

Commits on Aug 7, 2024

- IDE update
Developer
committed

Commits on Jul 27, 2024

- version pinning on requirements
Developer
committed
added some comments and docs
Developer
committed
update precommit to prevent rewriting of config files
Developer
committed

Commits on Jun 12, 2024

Commits on Jun 10, 2024

forgot to add requirement
Developer
committed
replace requests with cloudscraper to get around cloudflare
Developer
committed
version bump
Developer
committed
some refactoring as a result of more tests.
Developer
committed

Commits on Jun 7, 2024

grabber will now hunt for sitemaps in common places if not found in robots.txt
Developer
committed
handle sitemapindex roots
Developer
committed

0