casraf/snpr
1
0
Fork 0
mirror of https://github.com/chenasraf/snpr.git synced 2026-05-18 01:39:01 +00:00
Code Issues Packages Projects Releases Wiki Activity

Tell bots not to crawl user snps, should ease some load (#419)

Browse Source
This commit is contained in:
Philipp Bayer
2017-07-11 14:21:02 +08:00
committed by Bastian Greshake
parent 6e9eaec4dc
commit 7c4d077760
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
public/robots.txt
View File

@@ -3,3 +3,4 @@
# To ban all spiders from the entire site uncomment the next two lines:
# User-Agent: *
# Disallow: /
Disallow: /user_snps