[robots.txt] Several user agent types on one line?
I find a robots.txt with:
User-agent: archiver,indexer,researcherIs it legal to have them all on one line? Currently, all is ignored.
This may be related to #19 (closed).
You don't pay for Framagit, because it is funded by donations to Framasoft. Our not-for-profit needs any support you can afford: support.framasoft.org.
Framagit est gratuit car il est financé par les dons à Framasoft. Notre association a besoin de votre soutien sur soutenir.framasoft.org.
I find a robots.txt with:
User-agent: archiver,indexer,researcherIs it legal to have them all on one line? Currently, all is ignored.
This may be related to #19 (closed).