User-agent: * Disallow: /_aux/ Disallow: /_btns/ Disallow: /_logs/ Disallow: /_progs/ Disallow: /_xtra/ Disallow: /_main/xscroll.php # Following directories have been deleted Disallow: /a02/ Disallow: /b01/ Disallow: /b03/ Disallow: /b07/ Disallow: /b08/ Disallow: /g02/ Disallow: /i01/ Disallow: /k02/ Disallow: /n02/ Disallow: /n10/ Disallow: /n11/ Disallow: /n12/ Disallow: /o02/ Disallow: /p01/ Disallow: /p02/ Disallow: /p03/ Disallow: /s02/ Disallow: /s07/ Disallow: /s08/ Disallow: /s12/ Disallow: /t02/ # And these files have Disallow: /coatarms.html Disallow: /dac.html Disallow: /gunthorpe/index.html Disallow: /hockerton/hhistory.html