This site is now 100% read-only, and retired.

How manage a partial mirror with low bandwidth

Posted by moya on Wed 23 Mar 2005 at 03:56

I administer the lab for a research team. We all use Debian. Although I'd been network administrator for some time, I've never faced the problem of maintaining several Debian workstation (nice that all WS are identical). The first thing I did was to copy every CD of Sarge into a directory in the server and export it via http. Then I setup each workstation to update against this repository.

I also symlinked the /var/cache/apt/archives inside the exported dir. Nevertheless, that's the ugly way.

I'd like to build an archive from the contents of CDs, then update it, but I only have 150 MB/month and only http navigation. So, I would welcome advice on

  1. How can I build an archive structure from the contents of Sarge CDs
  2. How can I partially update that archive if I only have an http access to the internet

I welcome too suggestion of 'by-hand management'

Regards, maykel

 

 


Re: How manage a partial mirror with low bandwidth
Posted by davee (80.68.xx.xx) on Wed 23 Mar 2005 at 11:57
It sounds like what you actually want is the package apt-proxy. And you can import packages from your Sarge CDs using apt-proxy-import ...

http://packages.debian.org/stable/admin/apt-proxy

[ Parent ]

Re: How manage a partial mirror with low bandwidth
Posted by moya (200.55.xx.xx) on Fri 25 Mar 2005 at 01:50
The most useful part (importing of Sarge CDs), didn't work.

I had sarge/sarge-i386-disc{1,2,3 ...}. Then invoked apt-proxy -r -i sarge and failed.

[ Parent ]

Re: How manage a partial mirror with low bandwidth
Posted by davee (62.254.xx.xx) on Fri 25 Mar 2005 at 17:04
apt-proxy-import expects to see a directory full of .deb files and will import them into the proxy.

You may need to temporarily copy all the debs from each Sarge CD ... something like this:

mkdir /tmp/debs
cp `find /cdrom|egrep '\.deb'` /tmp/debs
apt-proxy-import /tmp/debs

That's untested, but is basically what I did.

[ Parent ]

Re: How manage a partial mirror with low bandwidth
Posted by leitao (80.172.xx.xx) on Wed 9 Nov 2005 at 17:29
cool... but remains untested..
I do installations and maintenance of POS (points of sale), using linux. Here, ppl still using redhat9 (because is simpler to install, comercial, etc) now i want to change it to debian, and it's very annoying to carry 14 CDs of Sarge for each installation..... i got a server, but i'm not sure about the commands i must do in order to create that repository from CDs... and it would be very usefull :D
if one of you already done that.. it would save me a lot of time.. and brain storm, perhaps :D
thx in advanced!
Nuno Leitao

[ Parent ]

Re: How manage a partial mirror with low bandwidth
Posted by suspended user Mihail (212.122.xx.xx) on Sat 11 Feb 2006 at 03:06
I've tried to do


#mkdir /tmp/debs
#cp `find /cdrom|egrep '\.deb'` /tmp/debs
#apt-proxy-import /tmp/debs


or

#apt-proxy-import -r -i /cdrom


but for every deb-file in directory i've got a message (in both cases):
<deb-file-name> skipped - no suitable backend found

What's wrong? How can i solve this?

Thank you.

[ Parent ]

Re: How manage a partial mirror with low bandwidth
Posted by davee (62.254.xx.xx) on Sun 12 Feb 2006 at 18:59
"no suitable backend found"

That sounds like you haven't got apt-proxy setup properly yet. You need to configure it so that it talks to at least one backend repository.

[ Parent ]

Re: How manage a partial mirror with low bandwidth
Posted by suspended user Mihail (212.122.xx.xx) on Sun 12 Feb 2006 at 23:23
But how should I set up this backend? (is there any article to read about apt-proxy setup?)

I'm trying to setup local apt mirror for use with dfsbuild and debootstrap, because these programs want to download packets from internet, but i don't want them to do it, cause i have 2 debian DVDs. Is it possible to make local mirror of these DVDs?

Thank you.

[ Parent ]

Re: How manage a partial mirror with low bandwidth
Posted by davee (62.254.xx.xx) on Tue 14 Feb 2006 at 19:19
OK, you want to make sure your apt-proxy server never tries to hit the internet? Might be tricky. Try http://apt-proxy.sourceforge.net/ for starters and perhaps follow up on the mailing list/IRC.

I've never tried to make items never use the 'net, I've only ever used the DVDs or CDs as a way to pre-populate an apt-proxy cache.

[ Parent ]