DEVELOPMENT ENVIRONMENT

~liljamo/robots.txt

ref: 35b09eb73a85cf8bcf95249fea0ff5e9065a0ae8 robots.txt/bases/src.quest -rw-r--r-- 198 bytes
35b09eb7 — Jonni Liljamo feat: add second nix package for src.quest robots.txt 28 days ago 
                                                                                
1
2
3
4
5
6
7
8
9
10

User-agent: *
Disallow: /*?*
Disallow: /*.tar.gz$
Disallow: /metrics
Disallow: /*/*/blame/*
Disallow: /*/*/log/*
Disallow: /*/*/tree/*
Disallow: /*/*/item/*
Disallow: /*/*/mbox
Disallow: /*/*/*/raw