Author Topic: Revision of repository  (Read 1412 times)

Offline liberation

  • Full Member
  • ***
  • Posts: 54
Revision of repository
« on: January 16, 2013, 01:50:07 AM »
I tested the repository (without test section) to find broken packages. Found 229 packages (of 13,406). How should I do next? Describe each in section "Broken Packages"? Or?

p.s.
Here is a complete list on 1/15/2013.
pclos 2012.12 (x86) - KDE 4.9.2

Offline muungwana

  • Hero Member
  • *****
  • Posts: 6254
Re: Revision of repository
« Reply #1 on: January 16, 2013, 02:45:45 AM »

how did you do the test?
.. 3 things are certain in life : death, taxes and software bloat ..
.. tell me something i don't know, something i can use as i struggle to reason with the world around me ..

Offline liberation

  • Full Member
  • ***
  • Posts: 54
Re: Revision of repository
« Reply #2 on: January 16, 2013, 03:14:04 AM »

how did you do the test?

I wrote a simple script that will do the job. About 30% I checked manually.
pclos 2012.12 (x86) - KDE 4.9.2

Offline pags

  • Hero Member
  • *****
  • Posts: 2517
  • Keep it clean.
Re: Revision of repository
« Reply #3 on: January 16, 2013, 06:21:40 AM »
Can you post the script, and the contents of your /etc/apt/sources.list (if you're not using PASS)?

Offline sling-shot

  • PCLinuxOS Tester
  • Hero Member
  • *******
  • Posts: 1730
  • Satyameva Jayate | Truth Alone Triumphs.
Re: Revision of repository
« Reply #4 on: January 16, 2013, 06:44:27 AM »
Well, thank you very much for that.
Some of the things may easily be fixed by changing .spec Requires while others may need more brains.

For the time being please keep up the link to DropBox list you have posted above. In case any change is needed Neal or some other packager would be along soon to instruct.

Your script itself may become an important tool for good health of our repository.
Packaging well will cure headaches of many :) But learning to package will cause headaches in many :(

AMD AthlonX2 3600+/ASUS M2NPV-VM/ATi HD4670/Onboard sound/3.5GB DDR2-533 RAM/SEAGATE 160+320GB HDD/DELL S2240L FullHD/Creative SBS370 2.1/PCLinuxOS2013/KDE4
Samsung NP305U1-A06IN | Nokia E6

Online Tony

  • Hero Member
  • *****
  • Posts: 1744
  • Reason_able ;)
Re: Revision of repository
« Reply #5 on: January 16, 2013, 07:35:17 AM »
I suspect you may just have to update your sources.list liberation .
Best to wait for an expert to give you the go ahead as you may have some further problem to address.

http://www.pclinuxos.com/forum/index.php/topic,87378.0.html

Easier still, there's 'apt-sources-list package' in Synaptic which may be installed.

Most up to date info:
http://www.pclinuxos.com/forum/index.php/topic,87378.msg959613.html#msg959613
pinoc:
Quote
I will do an updated apt-sources-list package in about a week where the most recent mirrors will be added
« Last Edit: January 16, 2013, 07:37:12 AM by Tony »
*PCLOS 3.2.18-pclos2 - MiniMe 2013.x - KDE 4.10.1 - Intel(R) Pentium(R) 4 CPU 3.00GHz - 1GiB DIMM DDR 533 MHz RAM  = SHABANG ! ;) *Software Updates

Offline sling-shot

  • PCLinuxOS Tester
  • Hero Member
  • *******
  • Posts: 1730
  • Satyameva Jayate | Truth Alone Triumphs.
Re: Revision of repository
« Reply #6 on: January 16, 2013, 07:49:02 AM »
I doubt that. If his sources.list was outdated, it is unlikely he could finish this test.
Anyway lets wait for OP to reply.
Packaging well will cure headaches of many :) But learning to package will cause headaches in many :(

AMD AthlonX2 3600+/ASUS M2NPV-VM/ATi HD4670/Onboard sound/3.5GB DDR2-533 RAM/SEAGATE 160+320GB HDD/DELL S2240L FullHD/Creative SBS370 2.1/PCLinuxOS2013/KDE4
Samsung NP305U1-A06IN | Nokia E6

Offline liberation

  • Full Member
  • ***
  • Posts: 54
Re: Revision of repository
« Reply #7 on: January 16, 2013, 07:49:32 AM »
I suspect you may just have to update your sources.list liberation .


I installed "apt-sources-list", ver. 1.0.4-1pclos2013, and this additional listing /etc/apt/sources.list:

Code: [Select]
# 32bit package repository URL's, working as of 01/10/2013
#===================================================
# Please enable only ONE (1) entry apart from the megagames repo!!!
#==================================================================
rpm http://ftp.nluug.nl/pub/os/Linux/distr/pclinuxos/ megagames megagames
rpm http://ftp.nluug.nl/pub/os/Linux/distr/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://pclinuxos.fi/pub/linux/ 2010 main updates nonfree kde games xfce4
# rpm http://ftp.belnet.be/pclinuxonline.com/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp.cc.uoc.gr/mirrors/linux/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp-srv2.kddilabs.jp/Linux/packages/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://distrib-coffee.ipsl.jussieu.fr/pub/linux/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp.heanet.ie/pub/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp2.ie.freesbie.org/pub/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://mirror.internode.on.net/pub/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://kambing.ui.ac.id/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp.klid.dk/ftp/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://mirror.aarnet.edu.au/pub/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp.jaist.ac.jp/pub/Linux/PCLinuxOS/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
pclos 2012.12 (x86) - KDE 4.9.2

Offline pags

  • Hero Member
  • *****
  • Posts: 2517
  • Keep it clean.
Re: Revision of repository
« Reply #8 on: January 16, 2013, 07:51:36 AM »
I suspect you may just have to update your sources.list liberation .


I installed "apt-sources-list", ver. 1.0.4-1pclos2013, and this additional listing /etc/apt/sources.list:

Code: [Select]
# 32bit package repository URL's, working as of 01/10/2013
#===================================================
# Please enable only ONE (1) entry apart from the megagames repo!!!
#==================================================================
rpm http://ftp.nluug.nl/pub/os/Linux/distr/pclinuxos/ megagames megagames
rpm http://ftp.nluug.nl/pub/os/Linux/distr/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://pclinuxos.fi/pub/linux/ 2010 main updates nonfree kde games xfce4
# rpm http://ftp.belnet.be/pclinuxonline.com/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp.cc.uoc.gr/mirrors/linux/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp-srv2.kddilabs.jp/Linux/packages/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://distrib-coffee.ipsl.jussieu.fr/pub/linux/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp.heanet.ie/pub/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp2.ie.freesbie.org/pub/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://mirror.internode.on.net/pub/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://kambing.ui.ac.id/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp.klid.dk/ftp/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://mirror.aarnet.edu.au/pub/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4
# rpm http://ftp.jaist.ac.jp/pub/Linux/PCLinuxOS/apt/ pclinuxos/2010 main updates nonfree kde games xfce4


Does this differ from your previous file (that's why I asked to see it...)?
Does the script work, now?
Can we see the script?

Offline liberation

  • Full Member
  • ***
  • Posts: 54
Re: Revision of repository
« Reply #9 on: January 16, 2013, 08:03:50 AM »
Does this differ from your previous file (that's why I asked to see it...)?
Does the script work, now?
Can we see the script?

While I do not publish the script. There is no malicious intent. He works for a long time (about 18 hours) and, I suspect, leads to an additional load on the server. This tool should not be abused.

I tested with installed package apt-sources-list ver. 1.0.4-1pclos2013.
pclos 2012.12 (x86) - KDE 4.9.2

Offline Just17

  • PCLinuxOS Tester
  • Super Villain
  • *******
  • Posts: 10696
  • MLUs Forever!
Re: Revision of repository
« Reply #10 on: January 16, 2013, 08:06:29 AM »
Does this differ from your previous file (that's why I asked to see it...)?
Does the script work, now?
Can we see the script?

While I do not publish the script. There is no malicious intent. He works for a long time (about 18 hours) and, I suspect, leads to an additional load on the server. This tool should not be abused.

I tested with installed package apt-sources-list ver. 1.0.4-1pclos2013.

While not intending any disrespect, if your script is not open for perusal why should anyone pay attention to, or accept the results?


Also, I feel sure that it would work quicker on local copies of the repository ......  of which there are quite a few (based on posts about such things).

MLUs rule the roost!

Linux XPS 3.4.38-pclos1.bfs  64 bit
Intel Core2 Quad CPU Q9450 @ 2.66GHz
4 GB RAM
MCP51 High Def Audio
GeForce GTX 550 Ti
PHILIPS  ‎DVD+-RW DVD8701
‎Logitech ‎BT Mini-Receiver
Afatech DTT

Offline pags

  • Hero Member
  • *****
  • Posts: 2517
  • Keep it clean.
Re: Revision of repository
« Reply #11 on: January 16, 2013, 08:10:56 AM »
Does this differ from your previous file (that's why I asked to see it...)?
Does the script work, now?
Can we see the script?

While I do not publish the script. There is no malicious intent. He works for a long time (about 18 hours) and, I suspect, leads to an additional load on the server. This tool should not be abused.

I tested with installed package apt-sources-list ver. 1.0.4-1pclos2013.

While not intending any disrespect, if your script is not open for perusal why should anyone pay attention to, or accept the results?


Also, I feel sure that it would work quicker on local copies of the repository ......  of which there are quite a few (based on posts about such things).



Agreed.

Not to mention, additional eyes will give you additional troubleshooting...the request was only made so we could review the script and see if anyone might spot possible issues, or question aspects that you could comment on...

Also, why might it take 18 hours to check broken packages (unless I'm missing something, here).  Synaptic does it in a minute.  And, without the source, we can only go on your assumption that this time is all spent adding load to the server...
There are many people here who could review and troubleshoot the script without running it...

Did you testing with the new sources.list produce different results?

Online Tony

  • Hero Member
  • *****
  • Posts: 1744
  • Reason_able ;)
Re: Revision of repository
« Reply #12 on: January 16, 2013, 08:33:40 AM »
Quote
I installed "apt-sources-list", ver. 1.0.4-1pclos2013, and this additional listing /etc/apt/sources.list:

As you've done both, it's not a bad idea to open /etc/apt/sources.list, in root, and display what is in it, the "apt-sources-list", ver. 1.0.4-1pclos2013 being older than the latest list posted by pinoc of additions to the sources.list.

We're a bit in the dark as to the Broken packages, if it is found that your sources.list is corrupted it can be simply erased and corrected.

During this time of syncing a whole new primary server, with the additional ones, a feature of Synaptic; "Fix Broken Packages" shouldn't be used. Not sure if you are aware there is such a function.

Basically checking that the sources.list is correct is first step.
 
*PCLOS 3.2.18-pclos2 - MiniMe 2013.x - KDE 4.10.1 - Intel(R) Pentium(R) 4 CPU 3.00GHz - 1GiB DIMM DDR 533 MHz RAM  = SHABANG ! ;) *Software Updates

Offline pags

  • Hero Member
  • *****
  • Posts: 2517
  • Keep it clean.
Re: Revision of repository
« Reply #13 on: January 16, 2013, 08:39:19 AM »
Quote
I installed "apt-sources-list", ver. 1.0.4-1pclos2013, and this additional listing /etc/apt/sources.list:

As you've done both, it's not a bad idea to open /etc/apt/sources.list, in root, and display what is in it, the "apt-sources-list", ver. 1.0.4-1pclos2013 being older than the latest list posted by pinoc of additions to the sources.list.

We're a bit in the dark as to the Broken packages, if it is found that your sources.list is corrupted it can be simply erased and corrected.

During this time of syncing a whole new primary server, with the additional ones, a feature of Synaptic; "Fix Broken Packages" shouldn't be used. Not sure if you are aware there is such a function.

Basically checking that the sources.list is correct is first step.
 

Ohhh...syncing.  Hadn't thought of that.

If the script is taking 18 hours to run, I imagine there is a distinct possibility that it running across regular syncing periods (I believe many mirrors sync multiple times per day).
Again, without source, nobody can elucidate further...

Offline liberation

  • Full Member
  • ***
  • Posts: 54
Re: Revision of repository
« Reply #14 on: January 16, 2013, 08:41:13 AM »
Agreed.

Not to mention, additional eyes will give you additional troubleshooting...the request was only made so we could review the script and see if anyone might spot possible issues, or question aspects that you could comment on...

Also, why might it take 18 hours to check broken packages (unless I'm missing something, here).  Synaptic does it in a minute.  And, without the source, we can only go on your assumption that this time is all spent adding load to the server...
There are many people here who could review and troubleshoot the script without running it...

Did you testing with the new sources.list produce different results?


1. Just check the result - run Synaptics. I did so. ;)

2. The execution time is so great, because you need to install each package in the repository. But "Apt" to optimize the process. I'm no expert, but the script written just carefully reading the documentation on "Apt". If it is written on the Bash, you get about 5 lines. :)

However, if the script is very necessary, I will publish it.

3. Where can I get a new source.list?

p.s.
I am sorry for mistakes, but I write through google translate.
pclos 2012.12 (x86) - KDE 4.9.2