mylivecd challenging me with crashing

[wedgetail]

I notice that my KDE has updates and decided since I was rather happy with the present performance to make a bakcup remaster just in case.    I have made quite a few re-masters lately with no problems apart from forgetting too big filesystem, however this time I am a bit lost.

Code: [Select]

[root@localhost gert]# uname -r
2.6.33.7-pclos6.bfs
[root@localhost gert]#

It is my understanding that I should be able to run --gzip (as I have been doing), today first I forgot and used default this got nowhere and reason no doubt that I had a total of 16GB (forogt a few movie files in Videos) clearing this I now have

1.. Cleared out /tmp not sure if that is needed

2.. partition usage

Code: [Select]

[root@localhost gert]# df
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda3              28G  7.2G   19G  28% /
[root@localhost gert]#

3.. System usage

Code: [Select]

[root@localhost gert]# du -sh
1.8G    .
[root@localhost gert]#

4.. myliveCD

Code: [Select]

[root@localhost gert]# mylivecd  --gzip 110519_KDE_myliveCD.iso
mylivecd, version 0.9.3, http://pclinuxos.com/
Copyright (C) 2010, Texstar <texstar at gmail.com>

This program is free software; you can redistribute it and/or
modify it under the terms of the GNU General Public License
as published by the Free Software Foundation; either version 2
of the License, or (at your option) any later version.

Disabling Services not needed on the LiveCD

running: /sbin/chkconfig --list
running: /sbin/chkconfig --list
running: /sbin/chkconfig --list
running: /sbin/chkconfig --list
running: /sbin/chkconfig --list


Creating initrd:                                   [101.71% 00:00:01/00:00:01]tar: ./etc/sysconfig/harddrake2/kernel: time stamp 2011-05-19 20:00:43 is 28868.981987667 s in the future=]
tar: ./etc/sysconfig/harddrake2/previous_hw: time stamp 2011-05-19 20:00:43 is 28868.981701855 s in the future
tar: ./etc/sysconfig/harddrake2/xorg: time stamp 2011-05-19 20:00:43 is 28868.981665695 s in the future
                                                   [100.00% 00:00:04/00:00:04]
Setting filesystem parameters:                     [100.00% 00:00:01/00:00:01]
Creating compressed image:                         [100.00% 00:07:36/00:07:36]
Creating isolinux boot:                            [100.00% 00:00:00/00:00:00]
Creating final iso:                                [100.00% 00:00:00/00:00:00]
ls: cannot access 110519_KDE_myliveCD.iso: No such file or directory
Embedding MD5 checksum:
[                                                                            ]Argument "" isn't numeric in division (/) at /usr/sbin/mylivecd line 278.       [  0.00% 00:00:00/00:00:00]Error - Unable to open file 110519_KDE_myliveCD.iso

Illegal division by zero at /usr/sbin/mylivecd line 296.
[root@localhost gert]#

Am I doing anything obviously wrong??

[menotu]

Does this help wedgetail ?

http://www.pclinuxos.com/forum/index.php/topic,91331.msg765812.html#msg765812

[Was_Just19]

I would try the --lzma compression option on the older kernel

[wedgetail]

menotu
Thanks for the link, I have speculated over the information here. I kept coming back to that I have probably done 5 remasters on the mentioned kernel but also each time just before doing some size able updates (200 + megabytes).

To maintain speed I have used --gzip as I was lucky to read a thread started by Just19 not sure how many times I used --gzip, but I have been happy with the results.

Just19
Nahh, your thread about extensive increase in re-master time using 'new' compression convinced me that for my purposes --gzip is fine.

General
Having looked around here in the mylivecd information I have decided to take the plunge and install the later kernel 2.6.38.6.bfs, which I am using right now. A few thing are not working quite as well as I was hoping, but I do have my previous setup, both rsync -av and re-master backup.  It worked too well to risk anything with an update.

Just before getting the update done to KDE I managed to get my re-master as follows.

Code: [Select]

[root@localhost gert]# mylivecd  --gzip 110519_KDE_myliveCD.iso
mylivecd, version 0.9.3, http://pclinuxos.com/
Copyright (C) 2010, Texstar <texstar at gmail.com>

This program is free software; you can redistribute it and/or
modify it under the terms of the GNU General Public License
as published by the Free Software Foundation; either version 2
of the License, or (at your option) any later version.

Disabling Services not needed on the LiveCD

running: /sbin/chkconfig --list
running: /sbin/chkconfig --list
running: /sbin/chkconfig --list
running: /sbin/chkconfig --list
running: /sbin/chkconfig --list


Creating initrd:                                   [101.71% 00:00:02/00:00:02]
tar: ./etc/sysconfig/harddrake2/kernel: time stamp 2011-05-19 20:00:43 is 26548.805293099 s in the future=]
tar: ./etc/sysconfig/harddrake2/previous_hw: time stamp 2011-05-19 20:00:43 is 26548.804990012 s in the future
tar: ./etc/sysconfig/harddrake2/xorg: time stamp 2011-05-19 20:00:43 is 26548.804948773 s in the future
                                                   [100.00% 00:00:04/00:00:04]
Setting filesystem parameters:                     [100.00% 00:00:01/00:00:01]
Creating compressed image:                         [100.00% 00:06:56/00:06:56]
Creating isolinux boot:                            [100.00% 00:00:01/00:00:01]
Creating final iso:                                [100.00% 00:00:45/00:00:45]
Embedding MD5 checksum:                            [100.00% 00:00:27/00:00:27]

Restoring Services on the installed system


Created '110519_KDE_myliveCD.iso' (2365,966,336 bytes) in 00:08:15

[root@localhost gert]#

I tried about 5 times, initially relying too much on my memory and stuffing up. I will put my problem down to running too close to the limit on my partition.  I run single partition systems, ie /home is generally included in / but not as a partition mount.  

As I am now using the new kernel I will do a test run re-mastering.

The test using mylivecd --gzip ... worked fine, no problems showed up.

Not sure why my system increased about 700 MB, I deleted my /tmp directory first I think I must have forgotten something in the /home.

[pinoc]

Hi wedgetail,

your konsole output indicates a previous incomplete remaster attempt. Enter the following in a root-terminal and then reboot:

Code: [Select]

/sbin/chkconfig --add atd
/sbin/chkconfig --add crond
/sbin/chkconfig --add syslog
/sbin/chkconfig --add kheader
/sbin/chkconfig --add xinetd

After the reboot go in /tmp and check for and delete any leftovers of previous remaster attempts. Then, and as mentioned by Just19, use the option --lzma in mylivecd if running a kernel older than 2.6.37 or upgrade to the latest 2.6.38 kernel.
hope this helps,
-p.

[wedgetail]

pinoc
Oooops, I think we crossed over a bit here. Thanks for your post.   You are correct about the previous incomplete attempt.  I think I found some big files in /tmp and deleted them.  Now the: /sbin/chkconfig --list I am guessing is the telling sign  

I am running the 2.6.38 kernel and again have success with --gzip I assume I can skip your suggestion ??

[pinoc]

pinoc
Oooops, I think we crossed over a bit here. Thanks for your post.   You are correct about the previous incomplete attempt.  I think I found some big files in /tmp and deleted them.  Now the: /sbin/chkconfig --list I am guessing is the telling sign  

I am running the 2.6.38 kernel and again have success with --gzip I assume I can skip your suggestion ??

no you can not skip the suggestion... 
After a completed mylivecd run these services are added back by the script. This does not happen if the script crashed in between, so yo uneed to add them back manually. -> Please enter the 5 commands to re-establish the correct services in your system, then reboot. After that when you run mylivecd you then see that these services are listed and stopped which was not the case before in your output. Anyway, just enter these commands now and do another reboot (to be safe) before running mylivecd again. Should work then with 2.6.38.
-p.

[wedgetail]

Pinoc

You are quite right, I am having a bit of trouble focusing.  Here is the run that I thought was right, and the 'lines' still show. I will make immediate amends  

Code: [Select]

[root@localhost gert]# mylivecd --gzip /media/USB465-1B/Data-Recovered-100711/Data/x8-ISO_Files/MyLiveCDs/110519-kde2010.12_06.iso
mylivecd, version 0.9.3, http://pclinuxos.com/
Copyright (C) 2010, Texstar <texstar at gmail.com>

This program is free software; you can redistribute it and/or
modify it under the terms of the GNU General Public License
as published by the Free Software Foundation; either version 2
of the License, or (at your option) any later version.

Disabling Services not needed on the LiveCD

running: /sbin/chkconfig --list
running: /sbin/chkconfig --list
running: /sbin/chkconfig --list
running: /sbin/chkconfig --list
running: /sbin/chkconfig --list


Creating initrd:                                   [100.00% 00:00:05/00:00:05]
Setting filesystem parameters:                     [100.00% 00:00:05/00:00:05]
Creating compressed image:                         [100.00% 00:07:27/00:07:27]
Creating isolinux boot:                            [100.00% 00:00:00/00:00:00]
Creating final iso:                                [100.00% 00:01:52/00:01:52]
Embedding MD5 checksum:                            [100.00% 00:01:34/00:01:34]

Restoring Services on the installed system


Created '/media/USB465-1B/Data-Recovered-100711/Data/x8-ISO_Files/MyLiveCDs/110519-kde2010.12_06.iso' (3076,171,776 bytes) in 00:11:03

[root@localhost gert]#
I have also located a number of files in the /home/gert/Music that explains why my test re-master went up about 700GB I will employ --nodir in next run after I have followed your advice.

Code: [Select]

[root@localhost gert]# /sbin/chkconfig --add atd
[root@localhost gert]# /sbin/chkconfig --add crond
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
[root@localhost gert]# /sbin/chkconfig --add syslog
[root@localhost gert]# /sbin/chkconfig --add crond
[root@localhost gert]# /sbin/chkconfig --add kheader
[root@localhost gert]# /sbin/chkconfig --add xinetd
[root@localhost gert]#

Seems the order could be slightly changed 

Code: [Select]

[root@localhost gert]# /sbin/chkconfig --add atd
[root@localhost gert]# /sbin/chkconfig --add syslog
[root@localhost gert]# /sbin/chkconfig --add crond
[root@localhost gert]# /sbin/chkconfig --add kheader
[root@localhost gert]# /sbin/chkconfig --add xinetd
[root@localhost gert]#

[pinoc]

well, put in the commands and then reboot. When running mylivecd you should get something like:

running: /sbin/chkconfig --list
running chkconfig --del atd
running: /sbin/chkconfig --list
running: chkconfig --del crond
etc.
...

Restoring Services on the installed system
running chkconfig --add atd
running chkconfig --add crond
etc.

Created '/media/USB465-1B/Data-Recovered-100711/Data/x8-ISO_Files/MyLiveCDs/110519-kde2010.12_06.iso' (3076,171,776 bytes) in whatever time

Note that you do not, but you should, get the output marked in green, so just add the services from a root-terminal, reboot, and you should be good to go,
-p.

[wedgetail]

pinoc
This post I have modified, the problem I had listed in here was a silly mistake, I was not running the latest kernel but thought I was. This time with belts and braces:

Code: [Select]

[root@localhost ~]# uname -r
2.6.38.6-pclos1.bfs


Code: [Select]

[root@localhost ~]# df
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda3              28G  6.2G   20G  24% /
[root@localhost ~]#

[code][root@localhost gert]# du -sh
4.9G    .
[root@localhost gert]#

Cleaned out /tmp

Now running mylivecd:

Code: [Select]

[root@localhost gert]# mylivecd --gzip --nodir ^/home/gert/Music 110519-kde2010.12_07.iso
mylivecd, version 0.9.3, http://pclinuxos.com/
Copyright (C) 2010, Texstar <texstar at gmail.com>

This program is free software; you can redistribute it and/or
modify it under the terms of the GNU General Public License
as published by the Free Software Foundation; either version 2
of the License, or (at your option) any later version.

Disabling Services not needed on the LiveCD

running: /sbin/chkconfig --list
running: chkconfig --del atd
running: /sbin/chkconfig --list
running: chkconfig --del crond
running: /sbin/chkconfig --list
running: chkconfig --del syslog
Warning: syslog is needed by script(s) in runlevel 3: nscd(start)
Warning: syslog is needed by script(s) in runlevel 4: nscd(start)
Warning: syslog is needed by script(s) in runlevel 5: nscd(start)
running: /sbin/chkconfig --list
running: chkconfig --del kheader
running: /sbin/chkconfig --list
running: chkconfig --del xinetd


Creating initrd:                                   [100.00% 00:00:05/00:00:05]
Setting filesystem parameters:                     [100.00% 00:00:01/00:00:01]
Creating compressed image:                         [100.00% 00:06:40/00:06:40]
Creating isolinux boot:                            [100.00% 00:00:01/00:00:01]
Creating final iso:                                [100.00% 00:00:51/00:00:51]
Embedding MD5 checksum:                            [100.00% 00:00:26/00:00:26]
                                                                              
Restoring Services on the installed system

running: chkconfig --add atd
running: chkconfig --add crond
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
running: chkconfig --add syslog
running: chkconfig --add kheader
running: chkconfig --add xinetd

Created '110519-kde2010.12_07.iso' (2523,412,480 bytes) in 00:08:06

[root@localhost gert]#

I don't know if it is me that has caused some 're-work' of the order of the Services, but earlier I found when manually  running services as suggested that if the order is changed then those warnings will not show:

[root@localhost gert]# /sbin/chkconfig --add atd
[root@localhost gert]# /sbin/chkconfig --add syslog
[root@localhost gert]# /sbin/chkconfig --add crond
[root@localhost gert]# /sbin/chkconfig --add kheader
[root@localhost gert]# /sbin/chkconfig --add xinetd
[root@localhost gert]#

I have interchanged the syslog and crond in above as I think it should be.

In this case I have let the ISO file be stored in default location, I thought the external USB was part of the problem with the failing runs.[/code]

[wedgetail]

Since I was doing some extra re-master runs I checked the time required, time is more important to me than size when making a backup.

Created '110519-kde2010.12_07--gzip.iso' (2523,412,480 bytes) in 00:08:06

Created '/media/USB465-1B/Data-Recovered-100711/Data/x8-ISO_Files/MyLiveCDs/110519-kde_custom_08_gzip.iso' (2531,225,600 bytes) in 00:09:53

Created '110519-kde_custom_08_lzma.iso' (2353,438,720 bytes) in 00:18:26

The first run uses --gzip option, stores result in default location /home/gert/

The second run stores a --gzip option on the external USB465 HDD and it is correct that it takes about 120 seconds to transfer 2.5GB

The third run was a test of --lzma option and stored in default location.  More than double the time and givng about 10% smaller file, since size not important, --lzma not attractive to me.

[pinoc]

yes, gzip compresses less but much faster than lzma or xz. BUT most important, it seems to work now, correct? Can you then mark this as Solved?
-p.

[wedgetail]

pinoc
Well, I am not totally satisfied, having 32 warnings every time I run the program seems to indicate that all is not quite right 

I have not yet tried to run any of the backups either.  I will just leave the topic open for a little bit longer.

[wedgetail]

The last successful re-master, I have run as LiveHDD, it was surprisingly fast and ran fine.

Then I updated the system and tried to re-master again, which failed.

I added the five services
Rebooted
cleaned /tmp
df to check size ok
re-master as below (done it twice)

All goes well until:

Code: [Select]

..
..
Creating final iso:                                [100.00% 00:00:00/00:00:00]
ls: cannot access /media/USB465-1B/Data-Recovered-100711/Data/x8-ISO_Files/MyLiveCDs/110519-kde_custom_09.iso: No such file or directory
Embedding MD5 checksum:
[                                                                            ]Argument "" isn't numeric in division (/) at /usr/sbin/mylivecd line[  0.00% 00:00:00/00:00:00]Error - Unable to open file /media/USB465-1B/Data-Recovered-100711/Data/x8-ISO_Files/MyLiveCDs/110519-kde_custom_09.iso

Illegal division by zero at /usr/sbin/mylivecd line 296.

I repeat the steps but this time I store the result locally in default and I get, leaving out the start bit:

Code: [Select]

Embedding MD5 checksum:                            [100.00% 00:00:40/00:00:40]
                                                                              
Restoring Services on the installed system

running: chkconfig --add atd
running: chkconfig --add crond
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
Warning: syslog is needed by crond in runlevel 2
Warning: syslog is needed by crond in runlevel 3
Warning: syslog is needed by crond in runlevel 4
Warning: syslog is needed by crond in runlevel 5
running: chkconfig --add syslog
running: chkconfig --add kheader
running: chkconfig --add xinetd

Created '/110519-kde_custom_09.iso' (2548,932,608 bytes) in 00:12:57

[root@localhost gert]#

Is the warning just an interactive way of keeping the operator alert   

[pinoc]

yes, remaster to the system disk (/) and then copy the final result elsewhere. The warnings are just informative and harmless, they are caused by certain services being disabled for doing the remaster. After the remaster these services are re-enabled and the warnings will no longer appear after the next reboot.