Author Topic: Revision of repository  (Read 1377 times)

Online pinoc

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 2843
    • other projects...
Re: Revision of repository
« Reply #15 on: January 16, 2013, 01:34:38 PM »
if you have  "apt-sources-list", ver. 1.0.4-1pclos2013 installed then you have the latest info. At present there are 2 new mirror servers not yet packaged into  "apt-sources-list" but that doesn't change anything. You have the most recent mirror info.

Broken packages, even if not installed, can also be detected with smart, that takes about 10 secs to scan the entire repo. Would be interesting to compare the results from the two.
-p.

Online JohnW_57

  • PCLinuxOS Tester
  • Hero Member
  • *******
  • Posts: 2117
Re: Revision of repository
« Reply #16 on: January 16, 2013, 01:57:47 PM »
There's no script needed to test  the repository.

Start konsole and su to root.
Type: apt-cache unmet
Then you see what's is broken in repsitory.

It needs only a few seconds to get a list.

Also it can be done with the smart package manager.

JohnW
« Last Edit: January 16, 2013, 02:06:32 PM by JohnW_57 »
PCLinuxOS 2013 KDE4 (64 bit) on: home build system:  Intel Core 2 Quad (q6700) (2.66ghz), Asus P5K motherboard, 4 gig ddr2 memory, Asus Nvidia Geforce GTS 250 1024 mb gddr3, Crucial M4 128 SSD,  2x Samsung 500 gig HDD (sata), TSSTcorp CDDVDW SH-224BB.

Offline Just17

  • PCLinuxOS Tester
  • Super Villain
  • *******
  • Posts: 10648
  • MLUs Forever!
Re: Revision of repository
« Reply #17 on: January 16, 2013, 02:08:14 PM »
There's no script needed to test  the repository.

Start konsole and su to root.
Type: apt-cache unmet
Then you see what's is broken in repsitory.

It needs only a few seconds to get a list.

Also it can be done with the smart package manager.

JohnW

The output from the above command is completely different to that (link) posted in this thread .......

« Last Edit: January 16, 2013, 02:31:18 PM by Just17 »
MLUs rule the roost!

Linux XPS 3.4.38-pclos1.bfs  64 bit
Intel Core2 Quad CPU Q9450 @ 2.66GHz
4 GB RAM
MCP51 High Def Audio
GeForce GTX 550 Ti
PHILIPS  ‎DVD+-RW DVD8701
‎Logitech ‎BT Mini-Receiver
Afatech DTT

Online JohnW_57

  • PCLinuxOS Tester
  • Hero Member
  • *******
  • Posts: 2117
Re: Revision of repository
« Reply #18 on: January 16, 2013, 02:26:09 PM »
A list only packages names is fine but not useable.

apt-cache unmet gives also output why its broken.

JohnW
« Last Edit: January 16, 2013, 02:30:15 PM by JohnW_57 »
PCLinuxOS 2013 KDE4 (64 bit) on: home build system:  Intel Core 2 Quad (q6700) (2.66ghz), Asus P5K motherboard, 4 gig ddr2 memory, Asus Nvidia Geforce GTS 250 1024 mb gddr3, Crucial M4 128 SSD,  2x Samsung 500 gig HDD (sata), TSSTcorp CDDVDW SH-224BB.

Online JohnW_57

  • PCLinuxOS Tester
  • Hero Member
  • *******
  • Posts: 2117
Re: Revision of repository
« Reply #19 on: January 16, 2013, 02:39:45 PM »
A example with smart package manager you get here: http://www.pclinuxos.com/forum/index.php/topic,112291.msg958858.html#msg958858
(used on the 64-bit repository).

JohnW
« Last Edit: January 16, 2013, 02:42:57 PM by JohnW_57 »
PCLinuxOS 2013 KDE4 (64 bit) on: home build system:  Intel Core 2 Quad (q6700) (2.66ghz), Asus P5K motherboard, 4 gig ddr2 memory, Asus Nvidia Geforce GTS 250 1024 mb gddr3, Crucial M4 128 SSD,  2x Samsung 500 gig HDD (sata), TSSTcorp CDDVDW SH-224BB.

Offline liberation

  • Full Member
  • ***
  • Posts: 54
Re: Revision of repository
« Reply #20 on: January 16, 2013, 02:43:16 PM »
A list only packages names is fine but not useable.

apt-cache unmet gives also output why its broken.

JohnW

It all started with the fact that I manually found some broken packages. Then began to read the document on APT. I tried the command apt-cache-i unmet, but she could not find some packages that I found manually. Then I decided to go another way. But he also needs some work. Some packages that are on the list, can I install on my home machine, but not working. Why? Not yet clear. Similarly, we can say that in a lot of broken packages repository. And we need to do something to improve the stability of the repository.
pclos 2012.12 (x86) - KDE 4.9.2

Online JohnW_57

  • PCLinuxOS Tester
  • Hero Member
  • *******
  • Posts: 2117
Re: Revision of repository
« Reply #21 on: January 16, 2013, 03:37:53 PM »
Quote
Some packages that are on the list, can I install on my home machine, but not working. Why? Not yet clear.
Guess some packages are rebuild in 1 rpm package (to replace multiple rpms).

A example what could be done: LibreOffice: there are multiple rpms needed to have LibreOffce.
But a packager could be decide to  package LibreOffice in 1 rpm package.

A example  is VLC 2.0.5.
The old VLC releases  where build  with 1 main package vlc (number) rpm and all plugins where build as separate rpms
VLC is 1 rpm now with all plugins build in.

JohnW
« Last Edit: January 16, 2013, 03:42:28 PM by JohnW_57 »
PCLinuxOS 2013 KDE4 (64 bit) on: home build system:  Intel Core 2 Quad (q6700) (2.66ghz), Asus P5K motherboard, 4 gig ddr2 memory, Asus Nvidia Geforce GTS 250 1024 mb gddr3, Crucial M4 128 SSD,  2x Samsung 500 gig HDD (sata), TSSTcorp CDDVDW SH-224BB.

Offline Tony

  • Hero Member
  • *****
  • Posts: 1744
  • Reason_able ;)
Re: Revision of repository
« Reply #22 on: January 17, 2013, 03:01:08 AM »
liberation said:
3. Where can I get a new source.list?
HERE: https://dl.dropbox.com/u/2000125/sources.list
That list is missing two servers, but it does not effect anything; pinoc will ammend all servers in a new 'apt-sources-list' at the appropriate time.

liberation, Please read this thread.
PCLinuxOS mirrors moving
And this first post of this thread: PCLinuxOS Synaptic File/Software Mirror Status Report

Use this server, it has been in sync with the main server for over a week, and is very fast.
rpm http://ftp.nluug.nl/pub/os/Linux/distr/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4

Pinoc advises:
Quote
if you have  "apt-sources-list", ver. 1.0.4-1pclos2013 installed then you have the latest info. At present there are 2 new mirror servers not yet packaged into  "apt-sources-list" but that doesn't change anything. You have the most recent mirror info.


Personally I feel there's too much jibberish nonsense being applied to a very simple task, my two cents worth.  ::)

*PCLOS 3.2.18-pclos2 - MiniMe 2013.x - KDE 4.10.1 - Intel(R) Pentium(R) 4 CPU 3.00GHz - 1GiB DIMM DDR 533 MHz RAM  = SHABANG ! ;) *Software Updates

Offline liberation

  • Full Member
  • ***
  • Posts: 54
Re: Revision of repository
« Reply #23 on: January 17, 2013, 04:02:36 AM »
liberation said:
3. Where can I get a new source.list?
HERE: https://dl.dropbox.com/u/2000125/sources.list
That list is missing two servers, but it does not effect anything; pinoc will ammend all servers in a new 'apt-sources-list' at the appropriate time.

liberation, Please read this thread.
PCLinuxOS mirrors moving
And this first post of this thread: PCLinuxOS Synaptic File/Software Mirror Status Report

Use this server, it has been in sync with the main server for over a week, and is very fast.
rpm http://ftp.nluug.nl/pub/os/Linux/distr/pclinuxos/pclinuxos/apt/ pclinuxos/2010 main updates nonfree kde games xfce4



Sorry, but I have no problem with access to the repository. I have already given my source.list. I use ftp.nluug.nl/pub/os/Linux/distr/pclinuxos/pclinuxos/apt/.

There was no answer to the main question. What to do with the list of broken packages? Publish them one by one under Broken Packages?

Or is it totally unnecessary work?
pclos 2012.12 (x86) - KDE 4.9.2

Offline TerryN

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 723
Re: Revision of repository
« Reply #24 on: January 17, 2013, 04:16:02 AM »
There was no answer to the main question. What to do with the list of broken packages? Publish them one by one under Broken Packages?
Or is it totally unnecessary work?

If there is a package that you actually need and can't install because it's broken then it is reasonable to post as a Broken Package.  Making multiple posts for packages that are not needed is just wasting everybody's time which wouldn't win you many friends around here  ;)

Terry.
« Last Edit: January 17, 2013, 04:19:39 AM by TerryN »
Dell E521 - AMD 64 X2 5000+, 4GB RAM, ATI X1300 graphics
PCLinuxOS 2013 (KDE)
|Twitter|

Offline sling-shot

  • PCLinuxOS Tester
  • Hero Member
  • *******
  • Posts: 1730
  • Satyameva Jayate | Truth Alone Triumphs.
Re: Revision of repository
« Reply #25 on: January 17, 2013, 05:01:03 AM »
It may not be a bad idea to have a single place where all of them are listed. Preferably wiki? But not 100's of individual posts in Broken  Packages :(
Some of them might just be waiting for a simple .spec edit.
I had a look at pclinuxos-black series yesterday because I loved that and it looks like it may be easy to correct them. Most of the themes may fall into similar category.

Just my thought.
Packaging well will cure headaches of many :) But learning to package will cause headaches in many :(

AMD AthlonX2 3600+/ASUS M2NPV-VM/ATi HD4670/Onboard sound/3.5GB DDR2-533 RAM/SEAGATE 160+320GB HDD/DELL S2240L FullHD/Creative SBS370 2.1/PCLinuxOS2013/KDE4
Samsung NP305U1-A06IN | Nokia E6

Offline liberation

  • Full Member
  • ***
  • Posts: 54
Re: Revision of repository
« Reply #26 on: January 18, 2013, 07:37:54 AM »
I post the script for testing repository. I was wrong when I wrote about the additional load on the server. Running time depends on your PC.

Code: [Select]
#!/usr/bin/php

<?php 

  $start_time 
time();

  
exec('apt-cache gencaches'$nil$result);
  unset(
$nil);

  if (
$result == 0) {
    
exec('apt-cache pkgnames'$packages$result);

    if (
$result == 0) {
      
$brokens = array();

      foreach (
$packages as $key => $package) {
echo "{$key} : {$package} ";

exec("apt-get -s install {$package}"$out$result);
unset($out);

if ($result != 0) {
  $brokens[] = $package;
}

echo "\n";
      }

      
file_put_contents('./rep_result.txt'implode("\n"$brokens));
      
sort($brokensSORT_STRING);
      
file_put_contents('./rep_result_sort.txt'implode("\n"$brokens));
    }
  }

  
$end_time time();

  echo 
date('Y-m-d H:i:s'$start_time) . " - " date('Y-m-d H:i:s'$end_time) . "\n";

?>

pclos 2012.12 (x86) - KDE 4.9.2

Offline Tony

  • Hero Member
  • *****
  • Posts: 1744
  • Reason_able ;)
Re: Revision of repository
« Reply #27 on: January 18, 2013, 08:09:51 AM »
My main point, and I apologise if ignoring the importance of a "revision of repository", was that a lot of the 'Broken Packages' may have been just a result of not having synched your Repo with the New main server.

From my standpoint, if it says in Synaptic that "I" have no Broken Packages", I leave it at that.  ;)
*PCLOS 3.2.18-pclos2 - MiniMe 2013.x - KDE 4.10.1 - Intel(R) Pentium(R) 4 CPU 3.00GHz - 1GiB DIMM DDR 533 MHz RAM  = SHABANG ! ;) *Software Updates

Online pags

  • Hero Member
  • *****
  • Posts: 2518
  • Keep it clean.
Re: Revision of repository
« Reply #28 on: January 18, 2013, 08:35:00 AM »
Ok.  This is just a quick review.  I did a cursory inspection of the script (well, actually, the commands you're running), and have a couple comments (questions?).  Feel free to respond, disagree, justify, etc. as you see fit.  ;)

Code: [Select]
apt-cache pkgnames

According to the man page:
Quote
       pkgnames prefix
              Prints  the name of each package in the system. The optional argument is a prefix
              match to filter the name list. The output is suitable for use in a shell tab com‐
              plete  function  and  the output is generated extremely quickly.  This command is
              best used with the --generate option.
...and, regarding the --generate option:
Quote
       -g, --generate
              Perform automatic package cache regeneration, rather than use the cache as it is.
              This is the default; to turn it off, use --no-generate.

              Configuration Item: APT::Cache::Generate.

Since this is the default, it would seem to make your first command:
Code: [Select]
apt-cache gencaches
superfluous.

Next, regarding your apt-get command, which appears to be how your determining the broken packages:
Code: [Select]
apt-get -s install
The only comment I have here, is that your essentially trying to install the entire repository.  Whether this is a failing of PCLOS (I doubt it, more to follow), or apt-get or Synaptic, this is going to be a problem.  Due to the order of installation, number of packages, unmet dependencies that are available but pending install, or whatever, I've never seen an operation like this succeed.
As a test (or, just for fun, however you want to look at it), I've tried this with both PCLOS and U****u, and never succeeded.  This is why i don't think it is a PCLOS fault.  In fact, I wasn't even trying install an entire repo, just trying to re-install an existing system, and even that couldn't be resolved properly.  It had to be done in "pieces"  (that is to say, I had to run multiple installs for individual groups of packages, until I had replicated the pre-existing install...I couldn't do it all in one fell swoop).

This, I think, is the failing in your testing method.

Not to mention (well, it's been kind of mentioned), that apt provides this functionality already.  Why not
Code: [Select]
apt-cache unmet
or, use Synaptic?

I'm OK if you want to continue this as civil debate.  It always a chance to learn (new methods, old paradigms, etc.)

Thanks for listening.
 ;D

Offline liberation

  • Full Member
  • ***
  • Posts: 54
Re: Revision of repository
« Reply #29 on: January 18, 2013, 09:34:09 AM »
Code: [Select]
apt-cache pkgnames

According to the man page:
Quote
       pkgnames prefix
              Prints  the name of each package in the system. The optional argument is a prefix
              match to filter the name list. The output is suitable for use in a shell tab com‐
              plete  function  and  the output is generated extremely quickly.  This command is
              best used with the --generate option.

...and, regarding the --generate option:
Quote
       -g, --generate
              Perform automatic package cache regeneration, rather than use the cache as it is.
              This is the default; to turn it off, use --no-generate.

              Configuration Item: APT::Cache::Generate.


Since this is the default, it would seem to make your first command:
Code: [Select]
apt-cache gencaches
superfluous.


This stuff. The script is not perfect. This is just a tool.

Next, regarding your apt-get command, which appears to be how your determining the broken packages:
Code: [Select]
apt-get -s install
The only comment I have here, is that your essentially trying to install the entire repository.  Whether this is a failing of PCLOS (I doubt it, more to follow), or apt-get or Synaptic, this is going to be a problem.  Due to the order of installation, number of packages, unmet dependencies that are available but pending install, or whatever, I've never seen an operation like this succeed.
As a test (or, just for fun, however you want to look at it), I've tried this with both PCLOS and U****u, and never succeeded.  This is why i don't think it is a PCLOS fault.  In fact, I wasn't even trying install an entire repo, just trying to re-install an existing system, and even that couldn't be resolved properly.  It had to be done in "pieces"  (that is to say, I had to run multiple installs for individual groups of packages, until I had replicated the pre-existing install...I couldn't do it all in one fell swoop).

This, I think, is the failing in your testing method.


Take a look:
http://www.pclinuxos.com/forum/index.php/topic,112445.0.html
http://www.pclinuxos.com/forum/index.php/topic,112359.0.html
http://www.pclinuxos.com/forum/index.php/topic,112331.0.html
http://www.pclinuxos.com/forum/index.php/topic,112358.0.html
http://www.pclinuxos.com/forum/index.php/topic,112357.0.html
http://www.pclinuxos.com/forum/index.php/topic,109297.0.html
http://www.pclinuxos.com/forum/index.php/topic,110664.0.html
http://www.pclinuxos.com/forum/index.php/topic,112126.0.html

Just try to install calligra, eric, remmina etc.

Not to mention (well, it's been kind of mentioned), that apt provides this functionality already.  Why not
Code: [Select]
apt-cache unmet
or, use Synaptic?

Discussed above.

I'm OK if you want to continue this as civil debate.  It always a chance to learn (new methods, old paradigms, etc.)


Debate? And who's going to fix broken packages? ;)
pclos 2012.12 (x86) - KDE 4.9.2