<Solved>On creating a Local repository???

[gezza]

ho to all,
I have suffered a lot of internet failures due to Telstra  upgrading their system.
Sometins it has been over 24 hours.
Soooo. I would like to rsync from aarnet.net.au to a local drive.
Could some kind folk give me the correct syntax, is rsync -aurv aarnet.net.au  /mnt/data
I used to do this many years ago,about 0.93 times,  but it has been wiped from my memory
Gezza

[Archie]

ho to all,
I have suffered a lot of internet failures due to Telstra  upgrading their system.
Sometins it has been over 24 hours.
Soooo. I would like to rsync from aarnet.net.au to a local drive.
Could some kind folk give me the correct syntax, is rsync -aurv aarnet.net.au  /mnt/data
I used to do this many years ago,about 0.93 times,  but it has been wiped from my memory
Gezza

You could try:

rsync -av --progress --delete --exclude=SRPM*/ mirror.aarnet.edu.au:pclinuxos/pclinuxos/apt/pclinuxos/2010/  /mnt/data

[Just17]

I suggest you use something like Grsync which will allow you to edit the 'extra' options and do a dummy run etc to see what you will download.
Also suggest you use  /mnt/Data/ Local_Repository  or some such to keep all the files/directories in their own sub-folder.

Be aware that some mirrors do not respond to rsync ....  they do not have that function. When doing a dummy run, if that is the case it will report it.

Here is one command I used in Grsync which excluded a whole lot of stuff like different language options for Firefox and repository sections I did not need at the time ...

Code: [Select]

rsync -r -n -t -p -o -g -v --progress -l --partial --numeric-ids --delete --exclude=SRPMS.* --exclude=RPMS.unstable --exclude=RPMS.xfce4 --exclude=base/*.unstable* --exclude=base/*.xfce4* --exclude=base/srclist.* --exclude=firefox-a* --exclude=firefox-b* --exclude=firefox-c* --exclude=firefox-d?-* --exclude=firefox-el* --exclude=firefox-eo* --exclude=firefox-es* --exclude=firefox-et* --exclude=firefox-eu* --exclude=firefox-f* --exclude=firefox-gl* --exclude=firefox-gu* --exclude=firefox-gd* --exclude=firefox-h* --exclude=firefox-i* --exclude=firefox-j* --exclude=firefox-k* --exclude=firefox-l* --exclude=firefox-m* --exclude=firefox-n* --exclude=firefox-o* --exclude=firefox-p* --exclude=firefox-q* --exclude=firefox-r* --exclude=firefox-s* --exclude=firefox-t* --exclude=firefox-u* --exclude=firefox-v* --exclude=firefox-w* --exclude=firefox-x* --exclude=firefox-y* --exclude=firefox-z* --exclude=mozilla-thunderbird-a* --exclude=mozilla-thunderbird-b* --exclude=mozilla-thunderbird-c* --exclude=mozilla-thunderbird-d?-* --exclude=mozilla-thunderbird-el* --exclude=mozilla-thunderbird-eo* --exclude=mozilla-thunderbird-es* --exclude=mozilla-thunderbird-et* --exclude=mozilla-thunderbird-eu* --exclude=mozilla-thunderbird-f* --exclude=mozilla-thunderbird-gl* --exclude=mozilla-thunderbird-gu* --exclude=mozilla-thunderbird-gd* --exclude=mozilla-thunderbird-h* --exclude=mozilla-thunderbird-i* --exclude=mozilla-thunderbird-j* --exclude=mozilla-thunderbird-k* --exclude=mozilla-thunderbird-l* --exclude=mozilla-thunderbird-m* --exclude=mozilla-thunderbird-n* --exclude=mozilla-thunderbird-o* --exclude=mozilla-thunderbird-p* --exclude=mozilla-thunderbird-q* --exclude=mozilla-thunderbird-r* --exclude=mozilla-thunderbird-s* --exclude=mozilla-thunderbird-t* --exclude=mozilla-thunderbird-u* --exclude=mozilla-thunderbird-v* --exclude=mozilla-thunderbird-w* --exclude=mozilla-thunderbird-x* --exclude=mozilla-thunderbird-y* --exclude=mozilla-thunderbird-z* ftp.heanet.ie::pub/pclinuxos/apt/pclinuxos/2010/ /media/1.5TB/32bit_Repository/pclinuxos/2010/

[craesz]

I suggest you use something like Grsync which will allow you to edit the 'extra' options and do a dummy run etc to see what you will download.
Also suggest you use  /mnt/Data/ Local_Repository  or some such to keep all the files/directories in their own sub-folder.

Be aware that some mirrors do not respond to rsync ....  they do not have that function. When doing a dummy run, if that is the case it will report it.

Here is one command I used in Grsync which excluded a whole lot of stuff like different language options for Firefox and repository sections I did not need at the time ...

Code: [Select]

rsync -r -n -t -p -o -g -v --progress -l --partial --numeric-ids --delete --exclude=SRPMS.* --exclude=RPMS.unstable --exclude=RPMS.xfce4 --exclude=base/*.unstable* --exclude=base/*.xfce4* --exclude=base/srclist.* --exclude=firefox-a* --exclude=firefox-b* --exclude=firefox-c* --exclude=firefox-d?-* --exclude=firefox-el* --exclude=firefox-eo* --exclude=firefox-es* --exclude=firefox-et* --exclude=firefox-eu* --exclude=firefox-f* --exclude=firefox-gl* --exclude=firefox-gu* --exclude=firefox-gd* --exclude=firefox-h* --exclude=firefox-i* --exclude=firefox-j* --exclude=firefox-k* --exclude=firefox-l* --exclude=firefox-m* --exclude=firefox-n* --exclude=firefox-o* --exclude=firefox-p* --exclude=firefox-q* --exclude=firefox-r* --exclude=firefox-s* --exclude=firefox-t* --exclude=firefox-u* --exclude=firefox-v* --exclude=firefox-w* --exclude=firefox-x* --exclude=firefox-y* --exclude=firefox-z* --exclude=mozilla-thunderbird-a* --exclude=mozilla-thunderbird-b* --exclude=mozilla-thunderbird-c* --exclude=mozilla-thunderbird-d?-* --exclude=mozilla-thunderbird-el* --exclude=mozilla-thunderbird-eo* --exclude=mozilla-thunderbird-es* --exclude=mozilla-thunderbird-et* --exclude=mozilla-thunderbird-eu* --exclude=mozilla-thunderbird-f* --exclude=mozilla-thunderbird-gl* --exclude=mozilla-thunderbird-gu* --exclude=mozilla-thunderbird-gd* --exclude=mozilla-thunderbird-h* --exclude=mozilla-thunderbird-i* --exclude=mozilla-thunderbird-j* --exclude=mozilla-thunderbird-k* --exclude=mozilla-thunderbird-l* --exclude=mozilla-thunderbird-m* --exclude=mozilla-thunderbird-n* --exclude=mozilla-thunderbird-o* --exclude=mozilla-thunderbird-p* --exclude=mozilla-thunderbird-q* --exclude=mozilla-thunderbird-r* --exclude=mozilla-thunderbird-s* --exclude=mozilla-thunderbird-t* --exclude=mozilla-thunderbird-u* --exclude=mozilla-thunderbird-v* --exclude=mozilla-thunderbird-w* --exclude=mozilla-thunderbird-x* --exclude=mozilla-thunderbird-y* --exclude=mozilla-thunderbird-z* ftp.heanet.ie::pub/pclinuxos/apt/pclinuxos/2010/ /media/1.5TB/32bit_Repository/pclinuxos/2010/

nice.... very nice.

[menotu]

That's some line of code J18 
=======================

sync -r -n -t -p -o -g -v --progress -l --partial --numeric-ids --delete --exclude=SRPMS.*
--exclude=RPMS.unstable --exclude=RPMS.xfce4 --exclude=base/*.unstable*
--exclude=base/*.xfce4* --exclude=base/srclist.* --exclude=firefox-a* --exclude=firefox-b*
--exclude=firefox-c* --exclude=firefox-d?-* --exclude=firefox-el* --exclude=firefox-eo*
--exclude=firefox-es* --exclude=firefox-et* --exclude=firefox-eu* --exclude=firefox-f*
--exclude=firefox-gl* --exclude=firefox-gu* --exclude=firefox-gd* --exclude=firefox-h*
--exclude=firefox-i* --exclude=firefox-j* --exclude=firefox-k* --exclude=firefox-l*
--exclude=firefox-m* --exclude=firefox-n* --exclude=firefox-o* --exclude=firefox-p*
--exclude=firefox-q* --exclude=firefox-r* --exclude=firefox-s* --exclude=firefox-t*
--exclude=firefox-u* --exclude=firefox-v* --exclude=firefox-w* --exclude=firefox-x*
--exclude=firefox-y* --exclude=firefox-z* --exclude=mozilla-thunderbird-a*
--exclude=mozilla-thunderbird-b* --exclude=mozilla-thunderbird-c*
--exclude=mozilla-thunderbird-d?-* --exclude=mozilla-thunderbird-el*
--exclude=mozilla-thunderbird-eo* --exclude=mozilla-thunderbird-es*
--exclude=mozilla-thunderbird-et* --exclude=mozilla-thunderbird-eu*
--exclude=mozilla-thunderbird-f* --exclude=mozilla-thunderbird-gl*
--exclude=mozilla-thunderbird-gu* --exclude=mozilla-thunderbird-gd*
--exclude=mozilla-thunderbird-h* --exclude=mozilla-thunderbird-i*
--exclude=mozilla-thunderbird-j* --exclude=mozilla-thunderbird-k*
--exclude=mozilla-thunderbird-l* --exclude=mozilla-thunderbird-m*
--exclude=mozilla-thunderbird-n* --exclude=mozilla-thunderbird-o*
--exclude=mozilla-thunderbird-p* --exclude=mozilla-thunderbird-q*
--exclude=mozilla-thunderbird-r* --exclude=mozilla-thunderbird-s*
--exclude=mozilla-thunderbird-t* --exclude=mozilla-thunderbird-u*
--exclude=mozilla-thunderbird-v* --exclude=mozilla-thunderbird-w*
--exclude=mozilla-thunderbird-x* --exclude=mozilla-thunderbird-y*
--exclude=mozilla-thunderbird-z* ftp.heanet.ie::pub/pclinuxos/apt/pclinuxos/2010/
/media/1.5TB/32bit_Repository/pclinuxos/2010/

[Archie]

Oh hell yeah ... just from looking at it, I bet he'd finish his rsync before he finishes typing all that! 

[menotu]

Oh hell yeah ... just from looking at it, I bet he'd finish his rsync before he finishes typing all that! 

 

Have to rsync "the code" to it's own HDD 

[Just17]

Ah!  the benefits of Grsync ....  which retains all those 'excludes' and keeps my local mirror a reasonable size 

...  and of course I have multiple such commands all kept by Grsync, so I neither have to remember nor type them 

just as well ....  it is difficult enought to remember to launch Grsync!   

[gezza]

Thanks Guys,
This will enable me, yet again.
I will copy all the replies to a text file then copy them to the screen to rsync.
Gezza

[Archie]

This is a wonderful thread ... it always is with Just18 and menotu.

[gezza]

hi,
I now have a local repository. But....I cannot get it to work!!!
I have the local mounted on /mnt/data750/pclinuxos
what i need now is--what do I put in the repository table in 'synaptic'?
No matter what I put in, it generates an error. A line 39-41 error.
Apart from this, the rsync from Heanet just works, but I cannot get aarnet to function at all.
I have tried 'ftp', 'http; front end but no go. Any thoughts?
Gezza

[Just17]

file:///mnt/data750/pclinuxos

is the format of the first line in Synaptic.

Apart from this, the rsync from Heanet just works, but I cannot get aarnet to function at all.
I have tried 'ftp', 'http; front end but no go. Any thoughts?

As I previously posted, some mirrors do not support rsync ......  have you checked whether that one does or not?

[Archie]

file:///mnt/data750/pclinuxos

is the format of the first line in Synaptic.

Apart from this, the rsync from Heanet just works, but I cannot get aarnet to function at all.
I have tried 'ftp', 'http; front end but no go. Any thoughts?

As I previously posted, some mirrors do not support rsync ......  have you checked whether that one does or not?

Are you sure? Mine use only one slash after file.

If Just18's suggestion have problems, try

Code: [Select]

file:/mnt/data750/pclinuxos
Check the child folders of your mounted repository. I suspect your URI might be more than what you posted. It could even be:

Code: [Select]

file:/mnt/data750/pclinuxos/pclinuxos/apt  the complete address should be before the pclinuxos/2010 folder.

[Just17]

Are you sure? Mine use only one slash after file.

Yes one slash should also work, but two won't.

http://
ftp://
file://<mount point>  is the way I have always entered it.

file:<mount point>  will also work

I guess I just have the habit of using the full  file://   

Maybe I have been wrong all along ..... 

[pupthai]

Some things to consider -

You can write your rsync command into a bash script and for the excludes you can use a text file to list them and rsync will check it when it runs.

--exclude-from=FILE
    This option is related to the --exclude option, but it specifies a FILE that contains exclude patterns (one per line). Blank lines in the file and lines starting with ';' or '#' are ignored. If FILE is -, the list will be read from standard input.  Easy to edit the text file and not change the script.

Check out the rsync web site.  http://rsync.samba.org/ftp/rsync/rsync.html