如何将 robots.txt 与 gitlab 和 apache + 子域一起使用？

Posted 2023-02-25

【中文标题】如何将 robots.txt 与 gitlab 和 apache + 子域一起使用？

【英文标题】：How to use robots.txt with gitlab and apache + subdomain?

【发布时间】：2014-06-15 09:49:40

【问题描述】：

我无法访问我的 robots.txt（本地位于 /home/git/gitlab/public/robots.txt） 我关注this recipe在centos + apache上安装

我已经尝试排除 robots.txt 但这还不够 这是我当前的 gitlab 虚拟主机

<VirtualHost git.domain.tld:80>                                              
   ServerName git.domain.tld
   ServerSignature Off                                                    
   ProxyPreserveHost On                                                         

  <Location />                                                                  
    Order deny,allow                                                            
    Allow from all                                                              

    ProxyPassReverse http://127.0.0.1:8080                                      
    ProxyPassReverse http://git.domain.tld/
  </Location>                                                                   

  #apache equivalent of nginx try files                                         
  # http://serverfault.com/questions/290784/what-is-apaches-equivalent-of-nginxs-try-files                                                                      
  # http://***.com/questions/10954516/apache2-proxypass-for-rails-app-gitlab        

RewriteEngine on                                                              

  RewriteCond %DOCUMENT_ROOT/%REQUEST_FILENAME !-f                          

  RewriteRule .* http://127.0.0.1:8080%REQUEST_URI [P,QSA]                    
  # needed for downloading attachments                                          
  DocumentRoot /home/git/gitlab/public                                          


  #Set up apache error documents, if back end goes down (i.e. 503 error) then a maintenance/deploy page is thrown up.                                           
  ErrorDocument 404 /404.html                                                   
  ErrorDocument 422 /422.html                                                   
  ErrorDocument 500 /500.html                                                   
  ErrorDocument 503 /deploy.html                                                

  LogFormat "%X-Forwarded-Fori %l %u %t \"%r\" %>s %b" common_forwarded       
  ErrorLog  /var/log/httpd/logs/gitlab_error.log           
  CustomLog /var/log/httpd/logs/gitlab_forwarded.log common_forwarded           
  CustomLog /var/log/httpd/logs/gitlab_access.log combined env=!dontlog         
  CustomLog /var/log/httpd/logs/gitlab.log combined                             
</VirtualHost>            

【问题讨论】：

你添加 robots.txt 文件后是否运行sudo /etc/init.d/gitlab restart？

【参考方案1】：

尝试改变 /home/git/gitlab/config/environments/production.rb config.serve_static_assets = true （默认为假）