GitHub · Where software is built

8000 GitHub · Where software is built

More Web Proxy on the site http://driver.im/

Labels Milestones New issue

WARCBolt support for HTTP/2

#66

· sebastian-nagel opened

on Oct 23, 2024

Port topology and resources to StormCrawler 3.1 or upwards

#60

· jnioche opened

on Nov 16, 2023

Avoid following advertisements in news feeds and sitemaps

#58

· sebastian-nagel opened

on Nov 14, 2023

produce WET files?

#55

· chris-ha458 opened

on Jul 19, 2023

Consider archiving of news feeds and sitemaps

#54

· sebastian-nagel opened

on Dec 4, 2022

Explore schema.org annotations for seed completions

#53

· sebastian-nagel opened

on Dec 4, 2022

Use wikidata to complete seeds

#50

· sebastian-nagel opened

on Oct 18, 2022

Do not use "http/2" protocol version in HTTP headers in WARC files

#42

· sebastian-nagel opened

on Oct 4, 2020

Allow to follow news sites not providing RSS/Atom feed or news sitemap

#41

· sebastian-nagel opened

on Jul 24, 2020

Automatic removal of ephemeral sitemaps

#40

· sebastian-nagel opened

on Jul 24, 2020

NewsSiteMapParserBolt: do not detect feeds as sitemaps

#35

· sebastian-nagel opened

on Jan 9, 2020

Add HTTP protocol version to HTTP request message

#34

· sebastian-nagel opened

on Dec 12, 2019

0