chiark / gitweb /
add robots.txt to stop crawlers delving into lookup/ and doing searches etc.
[ypp-sc-tools.db-live.git] / yarrg / yppedia-ocean-scraper
2009-12-10 Ian Jacksonbreak out yppedia_chart_parse into CommodsScrape.pm... 6.2
2009-10-31 Ian JacksonMerge branch 'stable-5.x'
2009-10-31 Ian JacksonMerge branch 'refs/remote/t.fa.dict.test' into stable-5.x
2009-10-31 Ian JacksonAllow downloading of database tree source code via...
2009-09-24 Ian JacksonMerge branch 'stable-3.x'
2009-09-23 Ian JacksonBetter HTTP User-Agent strings (rot13 the library,...
2009-09-02 Ian JacksonMerge branch 'test-install'
2009-09-01 Ian JacksonFix charset problems; support Opal and Jade
2009-09-01 Ian JacksonMore robust way to find arch/islands table
2009-09-01 Ian JacksonCope with some features of the Cobalt WP chart
2009-09-01 Ian JacksonDo entity conversion ourselves; lenny's BS won't for...
2009-08-31 Ian Jacksonocean scraper can fetch charts
2009-08-31 Ian JacksonCope with spaces in arch names as found on Hunter
2009-08-31 Ian JacksonOcean scraper seems to work properly now
2009-08-31 Ian JacksonWIP ocean scraper seems to mostly work, need to do...
2009-08-31 Ian JacksonWIP ocean scraper before redo parser
2009-08-31 Ian JacksonMerge branch 'stable-3.x'
2009-08-31 Ian JacksonWIP scraper still not working right
2009-08-31 Ian JacksonInitial version of scraper for oceans' arches and islands