Author Topic: (solved) Re-master size: Trimming out files, made my re-master larger?  (Read 1509 times)

Offline Dragynn

  • Hero Member
  • *****
  • Posts: 1436
  • Abide.
Well tried this 3 times with same result today. Yesterday I made a re-master that came out to be 382.1 mb. Today, I spent a couple of hours trimming the install down even more, not that it should have made a huge difference, but by my calculations I should have gotten the iso down to 380, maybe a tad lower. Instead, it kicked out a 386.5 mb iso...3 times in a row, and I checked and re-checked everything, ran bleachbit repeatedly, cleared out all histories, caches, clipboard, everything. I shaved about about 7 megs (uncompressed) from the system and yet came out almost 5 megs larger on the iso?  At the compression rate of somewhere around 3-4 to 1, that would mean I somehow added 15-18 mb's?

Ran mylivecd the same way as I did yesterday, straight-up with no options, which now defaults to xz with max compression from what i've read. Any ideas y'all? Is the utility kinda arbitrary with regards to size from day to day? That partition is pristine, I didn't even run the browser in it today, or utilize any programs whatsoever except Synaptic, Bleachbit, and terminal.
« Last Edit: April 20, 2011, 01:51:51 PM by Texstar »
This aggression will not stand man.

Offline Old Uncle

  • Full Member
  • ***
  • Posts: 122
  • This is SparTUX!
    • Thanks Texstar for PCLinuxOS!
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #1 on: April 17, 2011, 01:58:11 AM »
Hi Dragynn!

Which kernel is used in your system?

Maybe you need to read this link http://www.pclinuxos.com/forum/index.php/topic,89314.0.html

Hope that helps.

Old Uncle
Dell Vostro 1500, Intel Core 2 Duo T5270, 1.4GHz, 800Mhz
2GB (2x1024MB), DDR2, 667MHz 2 DIMM
128MB NVIDIA GeForce 8400M GS
Fujitsu 120GB 5400RPM SATA
15.4 Wide Screen XGA LCD
PCLinuxOS

Thanks Texstar for PCLinuxOS!

Offline Dragynn

  • Hero Member
  • *****
  • Posts: 1436
  • Abide.
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #2 on: April 17, 2011, 06:59:52 AM »
Hi Dragynn!

Which kernel is used in your system?

Maybe you need to read this link http://www.pclinuxos.com/forum/index.php/topic,89314.0.html

Hope that helps.

Old Uncle


Hi Old Uncle,

Using the 2.6.38.2 kernel bfs kernel (which I am enjoying thoroughly!), yep, read that post and some more on the new compression methods before I started this project. Kinda scratching my head over this one though, going to dig a little deeper today, i'll post my findings should i figure it out since it doesn't seem like anyone else has an idea either :D, i'm thinking maybe the compression process might just be a little arbitrary, which is fine for everyday use and not really an issue, I was just trying to tweak this iso down to the nth degree.

Have a great one!
This aggression will not stand man.

Offline Neal ManBear

  • Administrator
  • Super Villain
  • *****
  • Posts: 15845
  • LXDE! Coffee, Bacon and Cheesecake!
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #3 on: April 17, 2011, 07:28:53 AM »
Check your tmp directories.

Offline Dragynn

  • Hero Member
  • *****
  • Posts: 1436
  • Abide.
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #4 on: April 17, 2011, 08:16:02 AM »
Check your tmp directories.

Hey Neal,

yep, did that like 28 times :D, /tmp and also home/dragynn/tmp, also cleared clipboard, synaptic history, logs, ran and re-ran bleachbit and inspected caches just to make sure bleachbit was actually cleaning them. It's a puzzler to be sure. But like I said, in the grand scheme of things, a few megs isn't a big deal, i'm real happy with the size and performance of this re-master. But just strange, made a 382.1, went to bed, got up next and shaved off another 6-7 megs (uncompressed) and that's all that changed from the previous day, and got a larger iso, just one of those little things that nags at ya :D.

Hey, while i'm on subject of trimming, didn't you have an easy way to strip a jpeg of it's metadata for use as a gdm background?
This aggression will not stand man.

Offline Neal ManBear

  • Administrator
  • Super Villain
  • *****
  • Posts: 15845
  • LXDE! Coffee, Bacon and Cheesecake!
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #5 on: April 17, 2011, 09:06:05 AM »
.Hey, while i'm on subject of trimming, didn't you have an easy way to strip a jpeg of it's metadata for use as a gdm background?

Easy. Open your image.jpg with gimp. Save it as image.png. Exit gimp completely. Open your image.png with gimp. Using the Save As dialog, save it as image.jpg. As you go through the save dialogs, watch carefully for Advanced Options, which will be in bold text. Click to expand it. At the bottom is an entry field. Make sure that it is empty. Click to save. Exit gimp.
The metadata has been stripped from your image.

Offline Dragynn

  • Hero Member
  • *****
  • Posts: 1436
  • Abide.
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #6 on: April 17, 2011, 09:12:00 AM »
.Hey, while i'm on subject of trimming, didn't you have an easy way to strip a jpeg of it's metadata for use as a gdm background?

Easy. Open your image.jpg with gimp. Save it as image.png. Exit gimp completely. Open your image.png with gimp. Using the Save As dialog, save it as image.jpg. As you go through the save dialogs, watch carefully for Advanced Options, which will be in bold text. Click to expand it. At the bottom is an entry field. Make sure that it is empty. Click to save. Exit gimp.
The metadata has been stripped from your image.


Awesome, bookmarked and copied for future reference (just knew I should have done so the first time I saw it :D ), thanks Neal!
This aggression will not stand man.

Offline Dragynn

  • Hero Member
  • *****
  • Posts: 1436
  • Abide.
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #7 on: April 17, 2011, 12:03:32 PM »
Got it.

Firefox has a file deep down in the .mozilla folder in your home file, called "urlclassifier3.sqlite", this file is generated if you enable "block reported forgery sites" and "enable phishing and malware protection". It's generated by downloading a complete list from Google every day, problem is it seems like it doesn't delete the previous day's download, and in my observations, it even adds to it on the fly as you surf, an extra megabyte was generated just opening the browser and doing a search and checking 3-4 links, it was up to 40 mb total by the time I found it.  This is not a bad thing at all as extra security is good, but it was the cause of my iso-size spontaneously growing overnight.  Solution was to uncheck the two boxes in preferences, close the browser, and delete the file. Firefox will generate a new one if the two boxes are re-checked again.

New iso= 377.7 mb :)

*edit* Just noticed that good ol' Bleachbit vacuums out that file too, man I luv me some Bleachbit! ;D
« Last Edit: April 24, 2011, 04:06:13 PM by Dragynn »
This aggression will not stand man.

Offline Was_Just19

  • Hero Member
  • *****
  • Posts: 6852
  • MLU
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #8 on: April 17, 2011, 12:06:55 PM »
Don't forget

/home/user/.local/share/Trash ......  if it exists ....

Offline Dragynn

  • Hero Member
  • *****
  • Posts: 1436
  • Abide.
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #9 on: April 17, 2011, 02:21:15 PM »
Don't forget

/home/user/.local/share/Trash ......  if it exists ....

Not on mine.

Can't wait to try this on USB, ought to run like a champ on as small as a 2 gig stick with room to spare for files ;)
This aggression will not stand man.

Offline gseaman

  • PCLinuxOS Tester
  • Hero Member
  • *******
  • Posts: 3787
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #10 on: April 24, 2011, 04:02:51 PM »
Hey, while i'm on subject of trimming, didn't you have an easy way to strip a jpeg of it's metadata for use as a gdm background?

Try out a new program I packaged, called Trimage. It will compress .pngs and .jpgs losslessly, including all metadata. Just open a file manager and trimage, and click and drag pictures into the trimage window. There are no options, so be sure to make backups and test your compressed pictures before you delete your backups. It's supposed to be lossless, but I would check first ;)

Galen

Offline Neal ManBear

  • Administrator
  • Super Villain
  • *****
  • Posts: 15845
  • LXDE! Coffee, Bacon and Cheesecake!
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #11 on: April 25, 2011, 02:00:04 AM »
......... including all metadata.
Galen

So far as I know, the metadata needs to be stripped, and grub doesn't use compressed images, except those compressed as part of the gfxmenu archive.

Offline Texstar

  • Administrator
  • Super Villain
  • *****
  • Posts: 12495
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #12 on: April 25, 2011, 02:27:05 AM »
......... including all metadata.
Galen

So far as I know, the metadata needs to be stripped, and grub doesn't use compressed images, except those compressed as part of the gfxmenu archive.

Nifty tool in the repo to strip medata from jpgs.

jhead -purejpg *.jpg


Thanks to everyone who donates. You keep the servers running.

Offline gseaman

  • PCLinuxOS Tester
  • Hero Member
  • *******
  • Posts: 3787
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #13 on: April 25, 2011, 07:56:12 AM »
......... including all metadata.

Galen

So far as I know, the metadata needs to be stripped, and grub doesn't use compressed images, except those compressed as part of the gfxmenu archive.

I meant that the compression removes metadata. I haven't used this for grub, it was just an idea , but I thought that all .pngs and .jpgs were compressed, just to different degrees.

Galen

Offline Dragynn

  • Hero Member
  • *****
  • Posts: 1436
  • Abide.
Re: Re-master size: Trimming out files, made my re-master larger?
« Reply #14 on: April 25, 2011, 09:23:27 AM »
......... including all metadata.

Galen

So far as I know, the metadata needs to be stripped, and grub doesn't use compressed images, except those compressed as part of the gfxmenu archive.

 I thought that all .pngs and .jpgs were compressed, just to different degrees.

Galen


I think the term as applied to jpegs is kind of a misnomer, re-sized by reducing resolution is what is happening, it's still "compression" per se, but it's not "un-compressable" like a zip file or such.
This aggression will not stand man.