8000 [Sitemaps] Add cross-submit feature into our project · Issue #85 · crawler-commons/crawler-commons · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

[Sitemaps] Add cross-submit feature into our project #85

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
Chaiavi opened this issue Jun 18, 2015 · 2 comments
Open

[Sitemaps] Add cross-submit feature into our project #85

Chaiavi opened this issue Jun 18, 2015 · 2 comments
Labels
sitemaps

Comments

@Chaiavi
Copy link
Member
Chaiavi commented Jun 18, 2015

In the official sitemaps documentation there is a reference about Sitemaps & Cross Submits

In a nutshell, it means that there is a way for a sitemap to reference urls from an other domain (as long as it gets validated in the other domain, and as long as it contains urls from one domain only per sitemap)

We should implement this functionality.
@Chaiavi
Copy link
Member Author
Chaiavi commented Jun 21, 2015

Good scenario:

Snippet from nytimes.com robots.txt:

Sitemap: http://spiderbites.nytimes.com/sitemaps/www.nytimes.com/sitemap.xml.gz
Sitemap: http://www.nytimes.com/sitemaps/sitemap_news/sitemap.xml.gz
Sitemap: http://spiderbites.nytimes.com/sitemaps/sitemap_video/sitemap.xml.gz

@kkrugler
Copy link
Contributor
kkrugler commented Aug 21, 2015 AB0B

See issue #81 for a lengthy discussion of the above.

@kkrugler kkrugler mentioned this issue Aug 21, 2015
Closed
@sebastian-nagel sebastian-nagel mentioned this issue Mar 20, 2017
Closed
@sebastian-nagel sebastian-nagel mentioned this issue Oct 5, 2017
Closed
@sebastian-nagel sebastian-nagel mentioned this issue Oct 19, 2017
Closed
@kkrugler kkrugler mentioned this issue Mar 26, 2019
Merged
@sebastian-nagel sebastian-nagel mentioned this issue Feb 24, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
sitemaps
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@kkrugler @jnioche @Chaiavi
0