[robots.txt] Several user agent types on one line?
I find a robots.txt
with:
User-agent: archiver,indexer,researcher
Is it legal to have them all on one line? Currently, all is ignored.
This may be related to #19 (closed).
I find a robots.txt
with:
User-agent: archiver,indexer,researcher
Is it legal to have them all on one line? Currently, all is ignored.
This may be related to #19 (closed).