WeChall_Prime Factory (Training, Math)Training: WWW-Robots (HTTP, Training)
Posted 冷暖知不知
tags:
篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了WeChall_Prime Factory (Training, Math)Training: WWW-Robots (HTTP, Training)相关的知识,希望对你有一定的参考价值。
In this little training challenge, you are going to learn about the Robots_exclusion_standard.
The robots.txt file is used by web crawlers to check if they are allowed to crawl and index your website or only parts of it.
Sometimes these files reveal the directory structure instead protecting the content from being crawled.
Enjoy!
解题:
robots协议。
http://www.wechall.net/robots.txt
以上是关于WeChall_Prime Factory (Training, Math)Training: WWW-Robots (HTTP, Training)的主要内容,如果未能解决你的问题,请参考以下文章
factory源码分析——uvm_default_factory
spring 之 factory-bean & factory-method
Django formset_factory vs modelformset_factory vs inlineformset_factory