chiark / gitweb /
mirror-admin
9 years agoetc/post-mirror.d/worldofspectrum: Maintain an unzipped tree in parallel. distorted
Mark Wooding [Thu, 28 Aug 2014 14:56:15 +0000 (15:56 +0100)]
etc/post-mirror.d/worldofspectrum: Maintain an unzipped tree in parallel.

9 years agoMerge branch 'master' into distorted
Mark Wooding [Thu, 28 Aug 2014 14:55:56 +0000 (15:55 +0100)]
Merge branch 'master' into distorted

* master:
  bin/run-mirrors: Run post scripts after mirror jobs.

9 years agobin/run-mirrors: Run post scripts after mirror jobs. master
Mark Wooding [Thu, 28 Aug 2014 14:54:16 +0000 (15:54 +0100)]
bin/run-mirrors: Run post scripts after mirror jobs.

After a mirror JOB, run the scripts in etc/post-JOB.d/ to do any other
necessary things.  This is useful for jobs like `mirror' which do lots
of unrelated things.

9 years agoetc/mirror.packages: Mirror jobs for worldofspectrum.
Mark Wooding [Thu, 28 Aug 2014 13:58:04 +0000 (14:58 +0100)]
etc/mirror.packages: Mirror jobs for worldofspectrum.

These are currently disabled.  WoS is a bit temperamental, and I want to
populate the important parts first.

9 years agoetc/mirror.packages: Mirror job for IANA assignments.
Mark Wooding [Thu, 28 Aug 2014 13:56:25 +0000 (14:56 +0100)]
etc/mirror.packages: Mirror job for IANA assignments.

9 years agoMerge branch 'master' into distorted
Mark Wooding [Thu, 28 Aug 2014 13:55:23 +0000 (14:55 +0100)]
Merge branch 'master' into distorted

* master:
  bin/run-mirrors: Command line lists patterns limiting mirrors to run.

9 years agobin/run-mirrors: Command line lists patterns limiting mirrors to run.
Mark Wooding [Thu, 28 Aug 2014 13:53:39 +0000 (14:53 +0100)]
bin/run-mirrors: Command line lists patterns limiting mirrors to run.

10 years agoMerge branch 'master' into distorted
Mark Wooding [Mon, 10 Mar 2014 10:49:15 +0000 (10:49 +0000)]
Merge branch 'master' into distorted

* master:
  New ftpsync upstream.
  bin/fetch-ftpsync: Add a script to update the `ftpsync' machinery.
  lib/functions.sh: Tweak rsync options somewhat.
  Isolate ftpsync into its own branch.

10 years agoMerge branch 'ftpsync'
Mark Wooding [Mon, 10 Mar 2014 10:48:24 +0000 (10:48 +0000)]
Merge branch 'ftpsync'

* ftpsync:
  New ftpsync upstream.

Conflicts:
bin/ftpsync: `-excludes' -> `--excludes' now upstream

10 years agoNew ftpsync upstream. ftpsync
Mark Wooding [Mon, 10 Mar 2014 10:45:26 +0000 (10:45 +0000)]
New ftpsync upstream.

10 years agobin/fetch-ftpsync: Add a script to update the `ftpsync' machinery.
Mark Wooding [Mon, 10 Mar 2014 09:44:17 +0000 (09:44 +0000)]
bin/fetch-ftpsync: Add a script to update the `ftpsync' machinery.

It's very simple and stupid.  It can get better later.

10 years agolib/functions.sh: Tweak rsync options somewhat.
Mark Wooding [Mon, 10 Mar 2014 09:37:25 +0000 (09:37 +0000)]
lib/functions.sh: Tweak rsync options somewhat.

Add `--delete-delay --delay-updates' so that we try to avoid messing
things up until we're done.

10 years agoMerge branch 'ftpsync' into temp
Mark Wooding [Mon, 10 Mar 2014 10:42:25 +0000 (10:42 +0000)]
Merge branch 'ftpsync' into temp

* ftpsync:
  Isolate ftpsync into its own branch.

10 years agoIsolate ftpsync into its own branch.
Mark Wooding [Mon, 10 Mar 2014 10:24:34 +0000 (10:24 +0000)]
Isolate ftpsync into its own branch.

10 years agoetc/mirrors.d/50-distorted: Mirror of FTP archive on telecaster.
Mark Wooding [Sun, 9 Mar 2014 18:57:19 +0000 (18:57 +0000)]
etc/mirrors.d/50-distorted: Mirror of FTP archive on telecaster.

11 years agoMerge branch 'master' into distorted
Mark Wooding [Fri, 22 Feb 2013 01:15:07 +0000 (01:15 +0000)]
Merge branch 'master' into distorted

* master:
  etc/logrotate.conf: Actually rotate log files sometimes.

Conflicts:
etc/logrotate.conf

11 years agoetc/logrotate.conf: Actually rotate log files sometimes.
Mark Wooding [Fri, 22 Feb 2013 01:12:32 +0000 (01:12 +0000)]
etc/logrotate.conf: Actually rotate log files sometimes.

Rather than have them grow to enormous size.  Blue moons are too
infrequent.

11 years agoetc/mirrors.d/50-rfc: Fetch from rfc-editor.org.
Mark Wooding [Fri, 22 Feb 2013 01:11:19 +0000 (01:11 +0000)]
etc/mirrors.d/50-rfc: Fetch from rfc-editor.org.

11 years agoetc/mirrors.d/50-rfc: Build bibliographic database from the RFC index.
Mark Wooding [Fri, 22 Feb 2013 01:10:25 +0000 (01:10 +0000)]
etc/mirrors.d/50-rfc: Build bibliographic database from the RFC index.

11 years agoetc/mirrors.d/50-eprint-bib: Collect IACR ePrint bibliography.
Mark Wooding [Sat, 27 Oct 2012 12:26:43 +0000 (13:26 +0100)]
etc/mirrors.d/50-eprint-bib: Collect IACR ePrint bibliography.

It's worth considering collecting the entire archive.

11 years agoetc/mirrors.d/*: Use the new `MIRRORS' variable.
Mark Wooding [Sat, 27 Oct 2012 12:09:53 +0000 (13:09 +0100)]
etc/mirrors.d/*: Use the new `MIRRORS' variable.

Better than hardcoding the location.  Also, in .../50-rfc, change
current directory rather than writing the destination in full each
time.

11 years agoMerge branch 'master' into distorted
Mark Wooding [Sat, 27 Oct 2012 12:05:11 +0000 (13:05 +0100)]
Merge branch 'master' into distorted

* master:
  Keep track of the mirror target directory in an environment variable.

Conflicts:
bin/run-mirrors
etc/ftpsync-common.conf

11 years agoKeep track of the mirror target directory in an environment variable.
Mark Wooding [Sat, 27 Oct 2012 12:02:06 +0000 (13:02 +0100)]
Keep track of the mirror target directory in an environment variable.

Now we only need to configure it in one place.

11 years agoetc/ftpsync-common.conf: Track armel architecture too.
Mark Wooding [Wed, 4 Jul 2012 07:13:24 +0000 (08:13 +0100)]
etc/ftpsync-common.conf: Track armel architecture too.

Useful for Raspberry Pi and Android platforms.

11 years agoetc/mirrors.d/50-debian: Force IPv4 in rsync.
Mark Wooding [Thu, 3 May 2012 01:06:54 +0000 (02:06 +0100)]
etc/mirrors.d/50-debian: Force IPv4 in rsync.

Otherwise stage 2 tends to go wrong.  For some reason.

12 years agoMerge branch 'master' into distorted
Mark Wooding [Thu, 3 May 2012 01:16:25 +0000 (02:16 +0100)]
Merge branch 'master' into distorted

* master:
  bin/debian-excludes: Use rsync program configured in RSYNC variable.

12 years agobin/debian-excludes: Use rsync program configured in RSYNC variable.
Mark Wooding [Thu, 3 May 2012 01:04:30 +0000 (02:04 +0100)]
bin/debian-excludes: Use rsync program configured in RSYNC variable.

12 years agobin/run-mirrors, etc/logrotate.conf: Move mirror to /var/lib/mirror.
Mark Wooding [Tue, 1 May 2012 11:18:49 +0000 (12:18 +0100)]
bin/run-mirrors, etc/logrotate.conf: Move mirror to /var/lib/mirror.

12 years ago.userv/rc: Allow root to run the mirror.
Mark Wooding [Tue, 1 May 2012 11:18:23 +0000 (12:18 +0100)]
.userv/rc: Allow root to run the mirror.

12 years agoetc/ftpsync-*.conf: Switch back to UK mirror; abandon oldstable.
Mark Wooding [Sat, 21 Apr 2012 19:11:43 +0000 (20:11 +0100)]
etc/ftpsync-*.conf: Switch back to UK mirror; abandon oldstable.

12 years agoetc/ftpsync-debian-security.conf: No updates for `oldstable'.
Mark Wooding [Mon, 26 Mar 2012 16:51:28 +0000 (17:51 +0100)]
etc/ftpsync-debian-security.conf: No updates for `oldstable'.

12 years agoMerge branch 'master' into distorted
Mark Wooding [Mon, 26 Mar 2012 16:48:58 +0000 (17:48 +0100)]
Merge branch 'master' into distorted

* master:
  bin/ftpsync: `-exclude' means something completely wrong.

12 years agobin/ftpsync: `-exclude' means something completely wrong.
Mark Wooding [Mon, 26 Mar 2012 16:46:00 +0000 (17:46 +0100)]
bin/ftpsync: `-exclude' means something completely wrong.

Should be `--exclude' of course.

12 years agoetc/mirrors.d/50-rfc: Fetch RFCs from IETF; fetch IDs separately.
Mark Wooding [Fri, 16 Mar 2012 11:05:29 +0000 (11:05 +0000)]
etc/mirrors.d/50-rfc: Fetch RFCs from IETF; fetch IDs separately.

12 years agoetc/mirrors.d/50-debian: Actually mirror security updates.
Mark Wooding [Fri, 16 Mar 2012 11:28:38 +0000 (11:28 +0000)]
etc/mirrors.d/50-debian: Actually mirror security updates.

Looks like I splinched a commit.

12 years agoetc/ftpsync-common.conf: Adjust the mirror root directory.
Mark Wooding [Tue, 16 Aug 2011 09:24:09 +0000 (10:24 +0100)]
etc/ftpsync-common.conf: Adjust the mirror root directory.

12 years agoMove the mirror home directory to /var/lib/mirror-admin.
Mark Wooding [Tue, 16 Aug 2011 09:19:18 +0000 (10:19 +0100)]
Move the mirror home directory to /var/lib/mirror-admin.

Follow-on from the change in `master'.

12 years agoMerge branch 'master' into HEAD
Mark Wooding [Fri, 16 Mar 2012 11:38:07 +0000 (11:38 +0000)]
Merge branch 'master' into HEAD

* master:
  Move the mirror home directory to /var/lib/mirror-admin.
  bin/run-mirrors: If we have a keytab file, log in with it.
  bin/ftpsync: New version from upstream.

12 years agoMove the mirror home directory to /var/lib/mirror-admin.
Mark Wooding [Tue, 16 Aug 2011 09:19:18 +0000 (10:19 +0100)]
Move the mirror home directory to /var/lib/mirror-admin.

This seems like a place that will work everywhere.

12 years agobin/run-mirrors: If we have a keytab file, log in with it.
Mark Wooding [Fri, 16 Mar 2012 11:01:27 +0000 (11:01 +0000)]
bin/run-mirrors: If we have a keytab file, log in with it.

This stops the mirror job hanging if the filestore is mounted over
Kerberized NFS.

12 years agobin/ftpsync: New version from upstream.
Mark Wooding [Fri, 16 Mar 2012 11:08:59 +0000 (11:08 +0000)]
bin/ftpsync: New version from upstream.

12 years agoMerge branch 'master' into distorted
Mark Wooding [Wed, 17 Aug 2011 08:16:31 +0000 (09:16 +0100)]
Merge branch 'master' into distorted

* master:
  etc/ftpsync-debian-security.conf: Don't ask for unstable or experimental.

12 years agoetc/ftpsync-debian-security.conf: Don't ask for unstable or experimental.
Mark Wooding [Wed, 17 Aug 2011 08:14:46 +0000 (09:14 +0100)]
etc/ftpsync-debian-security.conf: Don't ask for unstable or experimental.

You just get a nasty error in the log.

12 years agoetc/ftpsync-common.conf: Include Debian sources.
Mark Wooding [Wed, 17 Aug 2011 08:08:53 +0000 (09:08 +0100)]
etc/ftpsync-common.conf: Include Debian sources.

12 years agoMerge branch 'master' into distorted
Mark Wooding [Tue, 16 Aug 2011 09:22:12 +0000 (10:22 +0100)]
Merge branch 'master' into distorted

* master:
  Mirror Ubuntu and the Debian multimedia packages.
  Refactor the Debian mirror configuration.

12 years agoMirror Ubuntu and the Debian multimedia packages.
Mark Wooding [Fri, 5 Aug 2011 10:30:23 +0000 (11:30 +0100)]
Mirror Ubuntu and the Debian multimedia packages.

New configuration snippets.

12 years agoRefactor the Debian mirror configuration.
Mark Wooding [Fri, 5 Aug 2011 10:28:09 +0000 (11:28 +0100)]
Refactor the Debian mirror configuration.

  * Factor the architecture-exclusion logic out into a separate
    program bin/debian-excludes.

  * Factor the common ftpsync configuration options into
    etc/ftpsync-common.conf, and source this from the archive-specific
    configuration scripts.

12 years agoMerge branch 'master' into distorted
Mark Wooding [Thu, 21 Jul 2011 15:55:27 +0000 (16:55 +0100)]
Merge branch 'master' into distorted

* master:
  etc/ftpsync-debian.conf: Fetch from the German mirror.
  bin/run-mirrors: Use id(1) to find current user name.
  etc/logrotate.conf: Somehow went missing.

12 years agoetc/mirrors.d: Local configuration.
Mark Wooding [Thu, 21 Jul 2011 15:36:38 +0000 (16:36 +0100)]
etc/mirrors.d: Local configuration.

12 years agoetc/ftpsync-debian.conf: Fetch from the German mirror.
Mark Wooding [Thu, 21 Jul 2011 15:23:04 +0000 (16:23 +0100)]
etc/ftpsync-debian.conf: Fetch from the German mirror.

Unfortunately, ftp.uk.debian.org is frequently broken.

12 years agobin/run-mirrors: Use id(1) to find current user name.
Mark Wooding [Thu, 21 Jul 2011 15:22:08 +0000 (16:22 +0100)]
bin/run-mirrors: Use id(1) to find current user name.

USER isn't set by sudo(8) -- at least in my configuration.

12 years agoetc/logrotate.conf: Somehow went missing.
Mark Wooding [Thu, 9 Jun 2011 01:58:16 +0000 (02:58 +0100)]
etc/logrotate.conf: Somehow went missing.

12 years agoMirror admin stuff, initial commit.
Mark Wooding [Wed, 8 Jun 2011 20:56:38 +0000 (21:56 +0100)]
Mirror admin stuff, initial commit.

Includes the Debian `ftpsync' mirror script suite, machinery for general
rsync(1) mirrors, and a skeleton configuration for Lee McLaughlin's
mirror(1) script.  By default the mirror does nothing useful whatever,
and requires local configuration; this should be maintained on a
different branch.