PDA

View Full Version : some kind of compressed images support



xrmb
30.05.2003, 16:39
I know DT is there to emulate cd-images, but one thing I hate is that I have to have them uncompressed, since no supported format supports compression.

At the moment I have like 34-cd images of a clipart-collection on my hdd, pretty good waste of space, because every image can be compressed from 650mb to <100mb with gzip!

I can't use ntfs-file compression because its a software raid.

Ok, here is my idea ;)

If I'm right every cd-image consists of many blocks (2048, 2352 or what ever bytes in size);

since i don't wanna loose the amazing speed of DT I would compress every sector by its own, gzip and bz2 are pretty good in compressing small amounts of data. So all you would need is a second file for faster seeking in the compressed image, since the compression will change position of the sector in the image file. A converter from ISO to this gziso format should be easy to write...

If somebody is interessted in a comparison between rar/zip-packed, ntfs-compressed isos and this idea I could write a small program that estimates the compression (even if i dont know everything about iso, but enough for the quick-shoots).

And one more point... gzip and bz2 are fast and free. Only disadvantage, we would have to specify our own format, and I don't know if that is in the scope of the DT developers.

Maybe, in a near future (tomorrow) DT will have an open plug-in system that allows us to write our own cd reader ;)

thanks for reading, ever comment is welcome.

Development
31.05.2003, 03:43
Maybe. If you want to contribute to development of such compression - mail me and we can discuss it.

xrmb
05.06.2003, 05:21
ok, took me a little bit more time than expected, but you get details and tools...

I don't know where to start...

Ok, I grabbed some cds and a dvd from my desktop and created isos, 2048 bytes sectors.

1. games: civilization 3, and freelancer (btw I own these games!)
2. data: a clipart cd (with wmf files)
3. applications: office xp and the vs.net 2003 60day-trial-dvd

Then I took some common used compressors (rar and zip) and packed all images as good as possible to get the compressed size.

After that I picked two free available compression algorithms we could use for this project:
gzip = pretty old, but still good, excelent for small data-blocks
bz2 = almost like rar in compression, but much faster

And I compressed the images with these tools too.

Now I there are some points I was thinking about. I assume the DT needs the data somehow blockwise (like it is in the image or on cd);

that means one big stream like rar, zip aso create are useless. Every block in the compressed image has to be compressed by its own. Only this way you can seek to every block w/o reading and expanding data (useless data).
Since the compression is not that good in single blockmode, I started playing with compressing 16 blocks (32... 64... aso). From 1 to 16 is big gain in saved bytes, and there could also be a speed advantage, since in most cases more than one block is requested. In every case you wanna access one single block you would have to expand 16, 32... block, could be a waste of resource, we have to find the best value for this.

Take a look at the linke results files, or play around with the gziso (analysis tool) to get an impression.

Here are some things i figured out so far:
- the difference between gz and bz2 becomes bigger with higher number of merged blocks
- single block compression is really worse, but at 16-block compression you are already close to zip (with gz) and rar (bz2)
- speed is no reason, maybe for creating a compressed image, but decompression is in both case lightning fast

things to think about:
- now a block/merged blocks can be either compressed or uncompressed, maybe you should be able to set a threshold, like if the compression only brings 5%, store it uncompressed
- for the file format I thinking about something like png, jpg aso. like: <tag><size><crc><...data...>, but only for the header, not for the image data, has a big advantage for enhancing the format and being backward compatible, trust me... I know what I talking about


ok, enough for now... I'll answer every question, and I thank for every hint...

links:

http://home.attbi.com/~xrmb/gziso/compare1/compare1.html (http://home.attbi.com/%7Exrmb/gziso/compare1/compare1.html) the results

http://home.attbi.com/~xrmb/gziso/bzip2.zip (http://home.attbi.com/%7Exrmb/gziso/bzip2.zip) bzip2 compressor (win32 exe)

http://home.attbi.com/~xrmb/gziso/minigzip.zip (http://home.attbi.com/%7Exrmb/gziso/minigzip.zip) gzip compressor (win32 exe)

http://home.attbi.com/~xrmb/gziso/gziso-v0.1.1-bin.zip (http://home.attbi.com/%7Exrmb/gziso/gziso-v0.1.1-bin.zip) gziso, the analyzer tool I wrote for details (win32 exe)

http://home.attbi.com/~xrmb/gziso/gziso-v0.1.1-src.zip (http://home.attbi.com/%7Exrmb/gziso/gziso-v0.1.1-src.zip) the source code for courios people

http://home.attbi.com/~xrmb/gziso/gziso-results.zip (http://home.attbi.com/%7Exrmb/gziso/gziso-results.zip) details gziso result file from my test

http://home.attbi.com/~xrmb/gziso/compare1.sxc (http://home.attbi.com/%7Exrmb/gziso/compare1.sxc) numbers and charts in a StarOffice spreadsheet

http://home.attbi.com/~xrmb/gziso/compare1.xls (http://home.attbi.com/%7Exrmb/gziso/compare1.xls) numbers and charts in an Excel spreadsheet


upcoming things:
- compare with ntfs compression
- make source code ansi-c
- enhance gziso to write the images
- add an audio cd to comparison


I hope you guys like the work I've done, ok... I'm a little bit upset about the week compression of all the available algorithms :) But thats out of my range...

Development
05.06.2003, 08:18
Yes, you've done great work, thanks!. And it is clearly seen that there is almost no gain in compression of typical games CD - they are usually already compressed. That is main point why compression of images we never on our priority list. It would be nice if you could make som NTFS comparisons! I guess we need to pin this topic so all interested could see it.

xrmb
06.06.2003, 02:59
the day after... finally I know what I've the P4 3.0ghz for ;) 100% load for 18h...

here what I added:
- ntfs compression stats
- more isos
- more stats


ntfs compression stats:
well, its a freebe from microsoft, worst compression possible ;)


more isos:
I added Diablo 1, because this game only copies 2mb from the cd to the hdd... well, but Blizzard knows how to compress data

Added a MSDN (documentation) version too, thats also something that you can use from cd, not much to get out of it :'(

And the Autoroute Data-cd, another cd you dont need to copy on the hdd... Microsoft can compress data if they want...


conclusions:
The gz-compression with 16 blocks merged seems to be the best and fastest solution, not as good as rare, but closer than ntfs compression. On my sample iso you could save 22% with this, its almost 2gb out of 8.5gb. Another highlight (I really like);

is, that the biggest benefit is on application-install cds, like office or visual studio, because windows always wants them to reinstall something.
There was no surprise that the clipart cds are melting like ice in the sun...
For the games I didnt expect a different result, it seems anyway so that every game has to be copied for the cds entirely :(


@Venom386: well this idea wasnt about saving some bytes on game-cds, I have the originals, so I only need them to install... but its different with data and application cds...

ok, as always, read and ask... btw, a ungziso tool to rebuild the iso to burn it will be provided if needed ;) It anyway only looks like a few lines of code...


new links:
http://home.attbi.com/~xrmb/gziso/compare2/compare2.html (http://home.attbi.com/%7Exrmb/gziso/compare2/compare2.html) the updated stats page

http://home.attbi.com/~xrmb/gziso/compare2.sxc (http://home.attbi.com/%7Exrmb/gziso/compare2.sxc) stats for star office

http://home.attbi.com/~xrmb/gziso/compare2.xls (http://home.attbi.com/%7Exrmb/gziso/compare2.xls) stats for excel lover

PixelaseR
29.07.2003, 05:35
Just outta curiosity, is this GZISO idea even been considered or worked on yet? :)

Development
29.07.2003, 06:50
Support for compressed files is planned later as special file access plugin system (parallel with image access plugins).

PixelaseR
29.07.2003, 15:35
Support for compressed files is planned later as special file access plugin system (parallel with image access plugins).

I see....and this, I am guessing, won't be done anytime soon?

xrmb
01.08.2003, 01:31
I see....and this, I am guessing, won't be done anytime soon?

once they released a version with plugins they can get my full support for compressed iso format, I'd like to write the converter-tools or something like this :)

PixelaseR
01.08.2003, 04:58
I see....and this, I am guessing, won't be done anytime soon?

once they released a version with plugins they can get my full support for compressed iso format, I'd like to write the converter-tools or something like this :)

I'd love to help with this plugins, though I guess I am gonna have to do some research on ISO formats...lol :)

Of course....unless they can implement a global function that will return raw ISO data which can then be converted by the plugin. For example, ISOData readISO(FILE* file)...hehe :)

Development
01.08.2003, 12:41
File access plugins will work independetnly from image plugins - they will not know what is ISO, CUE etc. They will handle only pure access to blocks inside file. Please also not that most likely all these compression plugins will be written as system drives (*.sys) - no Win32 API can be used. During image access no switch from Ring0 to Ring3 will be allowed.

PixelaseR
02.08.2003, 02:10
File access plugins will work independetnly from image plugins - they will not know what is ISO, CUE etc. They will handle only pure access to blocks inside file. Please also not that most likely all these compression plugins will be written as system drives (*.sys) - no Win32 API can be used. During image access no switch from Ring0 to Ring3 will be allowed.

Actually, on 2nd thought, I shouldn't be talking about conversion with D-Tools...lol...my bad :)

I was actually talking about the converter...bleah....two different programs.

I'd like to help with the plugins...but it looks like I am gonna be lost with the fact that I have no idea what Ring0 & 3 is...lol....off I go to do some research... :)

xrmb
02.08.2003, 04:18
The protected mode offers 4 different 'privilege
levels' (ranging from 0..3, aka ring0..ring3). Userland applications
are usually executed in ring3. The kernel on the other hand is executed
in the most privileged mode, ring0.

damn, I learned all that in schools a view years ago, but never used it again... stupid c++, but at least some guys here still know how the system works, no its not the start menu I'm talkin' about :)

Development
02.08.2003, 09:19
I will try to make design as simple as possible to reduce number of kernel code. All this will need some work and testing. The main limitation is 9x OS - on 2000/XP it is practicaly possible to avoid kernel code at all (at some performance hit maybe, but i don't think it matters at all as anyway performance will be lost during decompression).

PixelaseR
02.08.2003, 10:47
The protected mode offers 4 different 'privilege
levels' (ranging from 0..3, aka ring0..ring3). Userland applications
are usually executed in ring3. The kernel on the other hand is executed
in the most privileged mode, ring0.

damn, I learned all that in schools a view years ago, but never used it again... stupid c++, but at least some guys here still know how the system works, no its not the start menu I'm talkin' about :)

Actually....now that you mention it...I do remember having learnt about privileges when I took Windows Programming. I just didn't know they were called "ring". :P Actually, in reality, I haven't touched C/C++ for a long time since for some reason, everyone went for Java all of a sudden. I just started picking C/C++ along with C# back up about 2 months ago....sigh....industry transformation can be devastating....

Now....as for not switching from ring3 to ring0, you mean not using any Windows kernel code but completely "rewrite" the entire ASM code to emulate communication of DVD drives as well as decompression? I believe that would be somewhat very complicated and may takes a long time to optimize wouldn't it?

PixelaseR
02.08.2003, 10:49
I will try to make design as simple as possible to reduce number of kernel code. All this will need some work and testing. The main limitation is 9x OS - on 2000/XP it is practicaly possible to avoid kernel code at all (at some performance hit maybe, but i don't think it matters at all as anyway performance will be lost during decompression).

Regarding performance hit.....maybe after the code is done, minor code optimization can be done to pull it back up a little bit. I certainly don't think the performance hit would be that great. :)

Development
02.08.2003, 11:06
It can be done in C (not ASM) but it is complex task indeed - experience in writing drivers needed.

CeeJay
02.08.2003, 21:27
Xrmb : Could you do test with my favorite compressors too ?
7-zip - http://www.7-zip.org/ - For superb compression
LZOP - http://www.lzop.org/ - For superb speed
(The other datacompression libraries by Markus Oberhumer might also be worth a look)

Both are opensource.

Also note that while the g-zip rutine in 7-zip is about 10% more efficient that G-zip itself the really interesting format is it's own 7z format.
The only problem I can see with it is that it's hard finding the perfect settings for your specific file with so many options available.

0=BCJ2 1=LZMA 2=LZMA 3=LZMA b0:1 b0s1:2 b0s2:3 1d=25 2d=20 3d=20 1mf=bt4b 2mf=bt2 3mf=bt2 seems to work really good

Also you are only compression ISO images, try also to compress CloneCD and Alcohol 120% images , because while it's true that gamecontent can't always be compressed that well , copy-protection data like custom subsectors and etc can be compressed REALLY well.

I did some tests on a CloneCD image a few years back when I first suggested that Daemon should support compressed images and the .sub was compressed down to something like 8% of the original size

BTW they told me I was nuts and that there would be no gain from it since games were compressed already and it would never happen and if they were ever going to support compressed images they would make their own compression algorithm that would be so much better than anything else seen before.

Ofcourse they said something along the same lines when I suggested the analog audio feature and look ! It's in daemon now *g*

I suspect that audio CD's can be compressed to something like 50% of the original size ..
FLAC is a very good codec for that (since it's lossless and backed by Xiph.org)
http://flac.sourceforge.net/

It is ofcourse also opensource.

And while we are on the subject of custom format plugins consider a mp3/ogg vorbis -> audioCD plugin.
I also suggested this years ago - It's intent was to make it possible to hear the music YOU wanted in games that otherwise didn't support custom music and loaded its own music from an audio CD.
I think the developers response back then was that it was completely unnecessary because you could just burn the files to a CD and use it instead *g*

Jaime
03.08.2003, 10:31
The amount of compression always depends on the data entrophy level. Entrophy can be assimilated to the concept of disorder (in the sense of lack of unicity);
so compression reduces the entrophy level, reduces the disorder.

Audio data is not as disordered as you may think, in fact, if you take a mono wave file containing music or voice (without silence);
the compression level that can be achieved will be very low. Losless audio compressors capitalize mainly on the concept of 'joint stereo', i.e. in the differences between the channels, so the results will depend on the kind of music/audio data that is processed.

Typical results can vary betwen 45-80% of the original size, more towards the higher values for pop/rock music. If you want to achieve good ratios there's no other way than using lossy compression formats (mp3/mp4/aac/...).

But in my oppinion this is irrelevant, most people will desist on using compression when they see that compressing their game CDs almost gets them no savings at all. The interesting thing is that implementing a flexible plug-in architecture for data processing will open a new range of possibilities, that are good for but not limited to compression; data encryption is a very interesting field that can open new markets for this software.

Following with the previous reasonement, one of Daemon Tools' strong points is the ability to filter data coming from CD/DVD drives, so why not make this feature expandable so data decryption (or other kind of things) can be performed in real-time from physical drives?.

I would suggest to take a look at the BestCrypt's development kit that can be found at http://www.jetico.com, BestCrypt has a kernel mode API and plug-in system.

LocutusofBorg
03.08.2003, 16:05
a very good idea, after all new plugin method will provide us with many new concepts and advantages, that I'm sure about

ivan
15.09.2003, 00:21
Maybe you should add support for paragon's compressed image format (cdi). Paragon CDI is the native cd image format used by for the Paragon CD-ROM Emulator program to create backup copies of cds. The special thing about Paragon CDI is that it supports data compression.

I'm not competent in cd image file formats, but I think that Paragon CDI is different from DiskJuggler's CDI, because when I try to load a Paragon CDI in DT the only thing I get is an error message.

Paragon homepage: http://www.cdrom-emulator.com/

I hope this helps you.

Benji99
05.10.2003, 04:00
I also eagerly wait the compression iso feature, but I have a slightly different advantage in mind.

Basically I plan in the near future to rip every single cd I own to the harddrives (those are anything from application cds, to games, training cds etc...).

Basically I have a few problems (albeit very minor problems) with this, one of which was already mentioned, I would be wasting space, and If I rar them, I have to decompress them before I use them, which would suck.

THe other issues I have is that since I like to use the ripping program which I think is best for the job, clone, BW, cdrwin, DJ, etc... I will use several programs, and this will result in various different formats which will look unclean, but at the same time, clone creates 4 files, cdrwin 2, etc..., It would be nice to have a universal "container" compressed or compressed where 4 files would look as 1 on the file system, and they will use the same extension regardless of the actual image format used within.

I know my problems are very minor, but I'm anal retentive, and would love to see compression added to daemon tools, which would solve practically all my problems, hell I'd even be able to burn the cds directly without decompressing first...

Benji99

shawn8888
29.10.2003, 20:42
I am wondering if it is difficult to apply this feature. (Support Zip or Rar)
Could it be possible in the next version?

The_Morph
04.11.2003, 15:23
One of the biggest problems will be that several of the mentioned compression algos are not documented nor available for free. I stumbled across an almost perfect replacement for rar recently: sqx. sqx is a freely available compression/decompression library from Rainer Nausedat (www.sqx-archiver.org) which comes will full source code and a complete SDK. This will surely ease up things a lot. Even more, SQX comes with support for archive encryption, so no need to create another plugin. (And just for the records, I'm not connected to SQX in any way, I just like it almost as much as my beloved winrar ;) )

If I remember correctly, the daemon drives have 512 kbytes cache by default so why not compressing chunks of 214 blocks. Data is read sequentially in most cases anyway so there wouldn't be a large overhead but better compression in return. Why 214 blocks? A cd sector can have 2448 bytes maximum size, depending on the image format ofcourse.
A raw sector has 2352 bytes, plus 96 bytes subchannel data makes 2448 bytes. As we have to take care about the maximum allowed cache size, we will have to stick to 214 blocks per chunk or use variable chunksizes depending on the current image data.

Audio CD support will be a bit more difficult, at least for lossy compressors like mp3. Anyone who reads the lame discussion boards will know why.

I haven't had a look at FLAC and other lossless compressors, so I don't know how accurate chunk compression will be with these compressors, however, audio compression may turn out to be a real beast.

By the way, great idea with the image plugin system. Is any documentation about it available? I don't have much time these days :(

zagnut
25.12.2003, 09:45
this whole compressed iso concept is interesting... i've considered it in several respects, particularly with regard to:

1) transparency to the user
2) responsibility of this product's developers and this particular product
3) demand
4) comparable solutions/alternative approaches

with respect to .1, existing formats (rar, gzip, bz2);
none of them have really been designed with random access in mind, so the compression is always quite block-oriented (ie, files are compressed as whole chunks for a size that is often chosen for how it affects compresability -- ex, by file, by set of files, or by some maximum size premited by memory)... while this helps get a good ratio, it doesn't make for quick/easy decompression (random access and speed)... so, just like with Zipfolders, i fear existing formats will tend to require long waits before access... this is less of an issue on pimped-out boxes, but not everyone has 2gb ram and 4ghz idling... interestingly, flac HAS been designed with decompression speed/random access in mind AND it gets a better ratio than winrar on a 700mb audio cd image i tried the other day... i wonder... has anyone tried compressing data with flac? i might have to...

with respect to .2, i think it's hard to justify the suggestion that dtools be responsible for compression (or at least the definition of a compressed format -- tho if another app/group did, it might be worth simple SUPPORTING it... but no such format exists, and surely competition would quickly negate the effort spent as the first...)... also, if anything was definied it would have to be opensource in nature since surely dtools can't be turned into a conversion app -- that's something for another program to do... dtools just deals with images... any broaders scope would turn this nice small util into a 4bm fatso... the open nature of such a scep would lead to competing implimentations and less advantage.

with respect to .3 the demand is there, and growing... ppl are getting sick of discs, and want a good way to virtualize them. this - lack of compression - is becoming representative of a glass ceiling for many disc junkies; i mean: even 100gb drives fill up quickly when files are 600+mb each...

with respect to .4, as was noted there ARE file-based solution like ntfs, and just because it doesn't work for one person with software raid, doesn't mean it's not a relatively effective solution for others... i mean, even zipfolders would work if you could cope with the lag (in fact, who's to say the under-performing ntfs compression wasn't the lesser of evils... it could be high-compression and lots of lag... i suspect ms considered that issue thoroughly...). so there are options... mp3 is an option, and we've already been told mp3+cue is not an option... i think that's an appropriate choce... if dtools has to support every encoding, why not uuencode? that get's rediculous... rediculous to develop OR support.


all in all i think it's a little too lofty a goal for a utility... this is very generic stuff we're talking about... stuff that shouldn't even come into play in a utility that is really just simplifying the "now" of comuting (discs, copy protections, etc...)... why should it be trying to apply an "architecture"... it seems like the wrong place... an os with compressed files alla ntfs is the place for that... anywhere there is a platform there is a place for that... my question to the developers is this: is dtools a platform?

my opinion is that dtools is presicely where it ought to be... making virtual cd emulation fun... i think the benefit of it comes from the specific nature of it... support only for images to mount...

that said, i feel justified in suggesting in a previous post that dtools might consider supporting flac as an "image to mount"... it may not serve the data side, but it has the [growing] potention to serve to audio side....

fantc
12.02.2004, 16:32
Has anyone yet considered the linux compressed iso file image system that KNOPPIX uses?

http://www.knoppix.net/docs/index.php/cloop
http://developer.linuxtag.net/knoppix/sources/cloop_2.01-1.tar.gz

The file format consists of a header, an index table for block translation and of n blocks compressed with zlib at a given original block size.
That seems very simple, and it's easy to create compressed iso's from non compressed iso's.

Where can I get information, how these DLLs in the [image] directory of the daemon tools work? What interfaces must they provide?
I do not have many experiences in c/c++ programming (I mostly deal with java). Any help is appreciated.

Development
12.02.2004, 19:22
Mentioned DLLs currently handle only images without comression. their task is handle information specific to individual formats.
Compression handling is planned to do in other modules (Plugins\Files)
This design is under development.

fantc
13.02.2004, 10:36
Hello,

thanks for the information. That's what I thought, but I would like to know more about the interfaces of those DLLs, to try a bit with other proprietary iso images. I also would like to know more about how to write a plugin. Can you provide such information?

fantc
13.02.2004, 11:56
I mean a plugin that can be placed in Plugins\Files, or is that not possible at the moment?

LocutusofBorg
16.02.2004, 02:29
it is possible. You should write an email to me
locutus@daemon-tools.cc

(only experienced developers please)

desdinova
25.02.2004, 02:06
Talking about compressing audio tracks, and the impossibility to recognize mp3-linked cue files... Why not try to implement the ogg format? It is under the GPL licence, and better in quality than mp3...

As I use daemon tools to mount CD32 isos in UAE this would save a LOT of space as these disks typically consist of 10mB of data and audio tracks...

lord-storm
07.04.2004, 02:58
There is another compression method that you can use LZMA its not the fastest compression, but its is more flexible. Its also has quick decompression. http://www.7-zip.org/

FROM THE SDK SECTION (RIPED)

LZMA is default and general compression method of 7z format in 7-Zip program. LZMA provides high compression ratio and very fast decompression, so it is very suitable for embedded applications. For example, it can be used for ROM compressing.

LZMA SDK includes:

File to file LZMA compressing program (lzma.exe) with source code
ANSI-C compatible source code for LZMA decompressing
That LZMA decompression code was ported from original C++ sources to C. Also it was simplified and optimized for code size. But it is fully compatible with LZMA from 7-Zip.

LZMA Decompression features:

Decompressing speed:
8-12 MB/s on 1000 MHz P3 or K7.
500-1000 KB/s on 100 MHz ARM, MIPS, PowerPC or other simple RISC CPU.
Small memory requirements for decompressing: 8-32 KB
Small code size for decompressing: 2-8 KB (depending from speed optimizations)
LZMA decoder uses only integer operations and can be implemented in any modern 32-bit CPU (or on 16-bit CPU with some conditions).

LZMA SDK is released under the terms of the GNU LGPL. LZMA SDK also can be available under a proprietary license for those who cannot use the GNU LGPL in their code. To request such proprietary license or any additional consultations, write to support@7-zip.org.

If you use or plan to use LZMA SDK, please write about it to support@7-zip.org.

darkedgex
15.05.2004, 19:20
Talking about compressing audio tracks, and the impossibility to recognize mp3-linked cue files... Why not try to implement the ogg format? It is under the GPL licence, and better in quality than mp3...
Yeah, this is kind of what I thought this subject was about, heh. I'd like to see a way for DT to deal with CUE files that link to non-WAV audio files (APE, FLAC, etc). I burn a lot of my audio CD's to APE/CUE sets and save them on my HD and it'd be convenient to be able to mount them with DT whenever I want to play them (etc). =)

djwice
01.06.2004, 13:49
What I was thinking of:

Why doesn't Daemon Tools support the windows Compressed Folder feature.
I mean it's build in the XP OS and even my mom uses it to send a bunch of files to her friends.

It does solve the problem of direct block access, because (if I'm correct) the OS will take care of that.

So wouldn't this be the easy first step for supporting compression after a year of discussions about this subject?

Epsylon3
31.08.2004, 01:14
Don't make what is already made ;p)

http://www.kernel.org/pub/linux/utils/fs/zisofs/

The zisofs filesystem is an extension to the ISO9660 filesystem that allows files, on a file-by-file basis, to be stored compressed and decompressed in real time. The zisofs filesystem is supported by recent versions of Linux (2.4.14 or later). Legacy systems can still read uncompressed files. zisofs-tools contains the tools necessary to create such a compressed ISO9660 filesystem and to read compressed files on a legacy system.

http://freshmeat.net/projects/zisofs-tools/

"mkzftree will not compress files that end up larger when compressed"

We can also imagine to create a better compression FS, imagine a system where each file is extracted in memory with a different plugin... the one where the compression was the best... i think its what 7-zip actually does...

There are also fs used in Firmwares, but it's made for linux file system only i think : CramFS and SquashFS (better compression) but i dunno exactly differences, maybe zlib / bzip2

GhostWolf1942
14.10.2004, 20:34
Another alredy made cd compression tool/format is those two that cdrmooby uses http://mooby.psxfanatics.com/. It's a plugin used for PS1 emulation software so it is already tested. It's opensource under GPL.

rgreat
29.11.2004, 16:32
How about just mount a ZIP/RAR/7z/etc. archive?

bavander
06.04.2005, 18:49
I've been reading and all this sounds interesting. Here is a crazy idea that probably wouldn't work.

Would it be possible to implement a stackable plugin system. The first layer would be a file system plugin that handles the actual reading of the needed file. A normal plugin would read real files, but a zip,rar,etc plugin would read files from inside that 'file system'. Next the format plugin would decode the data accordingly, whether it is a ccd or a cue image.

For the compressed file, certain information could help speed up access time. For each block of original data, the byte and bit position in the compressed file and the offset of the decompressed data needs to be known. The reason for the bit position is that the compressed codes may be 12 bits or something of that nature, so knowing that a code begins at byte 5 bit 4 is needed. Also, since a code may represent multiple bytes, knowing the offset of the current code to the next block is important. For example, if a code decompresses to three bytes, the first being byte 2046, then the 2048 position would be two bytes away in the decompressed data.

What could happen is, when a compressed image is first mounted, a temporary buffer would be used to decompress the selected files on the run. During this process, the above information could be extracted and the code tables could be rebuilt. A cache could be created on the disk containing this information.

Harekiet
17.04.2005, 07:31
So how is it looking with this, will the next daemon-tools support some form of compressed images or can we get a development kit to add our own plugins for it?

Krazy Hawaiian
24.04.2005, 17:23
This is a little off the topic of what you guys are going for but today I noticed a feature in Power Producer 3 that surprised me. They have a Defragmenter for use on CD RW's They claim that by more efficient packing of data on the disk you can get a big gain in storage capacity! This is in the "Burn" portion of the video editor.

I haven't tried it yet to see if it actually does what it claims because I misplaced my only RW CD :roll: :D

I don't know if you guys have seen this or not, however it's something new to me. Defragmenting a RW CD to store more video on it!

NetSoerfer
24.04.2005, 20:44
If it's simply defragmenting as on a hard drive, it won't give you more than 700MB (on a 700MB medium, of course).

However, if you've been using the disc a lot, writing small files, deleting some of them, then creating new ones, the CD-RW could in a way become fragmented, and you could free up the overhead memory by defragmenting. That wouldn't be anything else than defragmenting a hard drive.

Just an assumption on my part, however

RainyShadow
15.06.2005, 08:55
what about adding an application to create index-table file for premade RAR, ZIP, etc. compressed ISO files, and implement in DT reading those archives using the index table for block-like access ?

P.S. sorry for my bad english, hope you got the idea ;)

NetSoerfer
15.06.2005, 10:08
PLEASE read through this thread first, you'll see why compressing images is a waste of CPU time in almost every case.

RainyShadow
18.06.2005, 18:34
PLEASE read through this thread first, you'll see why compressing images is a waste of CPU time in almost every case.

I did! And i don't agree with you. There are a lot of times when compressing images is very usefull. Please, don't put your thoughts in other peoples minds ;)

OneRing
18.06.2005, 19:16
PLEASE read through this thread first, you'll see why compressing images is a waste of CPU time in almost every case.

I did! And i don't agree with you. There are a lot of times when compressing images is very usefull. Please, don't put your thoughts in other peoples minds ;)

I agree...

I understand when ppl start out doing sth for a particular purpose,
the investment sometimes become somewhat emotional

actually, if dt is going far, it shouldn't limit itself to gamers

today ppl store large amount of data in various formats for reasons far beyond anybody's dreams
I work in the financial software industry, clients store gigs of text (or at least, compressible in other sense) files,
which apparently could use some compression

take for example a 20M text file that contains a lota digits,tabs, comma... (price quotes)
this could comfortably compressed to 5% of the original

CPU is a hell lot faster than hard drive in this sense.

chp
08.08.2005, 09:45
I've got many CD disks that got only 100mb of data and yet are full 700mb ISO images (can't be edited for a reason). So I cound have 6 images on single CD instead of 6 CDs :^/

The new DT version is announced, with plugin system.. So "a compression" plugin that people were talking of here is possible. But is it there already?

Please give a hint / PM! I have 10 such disks to backup, so I can wait for new version if it's there :)

Underheaven
08.08.2005, 18:36
Compressed/encrypted image support is not available until DAEMON Tools version 4.0, but try running your 700MB images through zip,rar,ace, or 7z and you might find that you cannot compress them very much. If it did work to squeeze them to 100MB that would be really cool.

chp
10.08.2005, 10:30
Yep, such ISO files are compressible at least to size of data they got. That's why I'm asking.
And yes, I was talking about 4.0 version with plugins system. I did wonder if a compression plugin already exist (there were talks and devs vs ppl contacts I guess). Did you mean it will be available in DT4? :)

Andareed
10.08.2005, 13:28
I find that using NTFS compression helps quite a bit (around 10% compression or so).

,jACkdA\W
11.08.2005, 00:49
Disks that CAN be compressed for serious yield in my experience are ALWAYS of the sort that can get even MORE compressed by just compressing files/tracks/data instead of raw image data. That's the point i'd say. (and 10% space saving ain't serious yield enough for my tastes - not worth the effort.)
edit: :P i've found a couple of SafeDisk protected disks that use a fake disk structure - that's for completeness - less data on disk than the structure tells - sure, compression should be a big one there, but i personally never found need to care for those exceptions...

chp
11.08.2005, 13:01
You nailed it ;) SafeDisk 700mb images with 100mb data on it which better be backup-ed on DVD (hense no NTFS).
In good old days there were VCD tools with an image compression which was useful. Sure, nowdays soft and games comes in CABs and stuff. But yet there are titles which read some "highly uncompressed" stuff from the media.
Compressed images could have some "recovery data" (as in RAR) to serve as additional "error correction".
Btw, is there any error detection / correction for ISO files themselves?

Underheaven
12.08.2005, 08:13
AFAIK ISO's of CD's/DVD's only contain cooked sectors of 2048(4*512) bytes. So that means no extra data.

scottcopus
15.08.2005, 18:03
Hi,

I'm looking for a way to compress some bootable DVD disc images (ISOs)... without having to resort to a third-party decompression utility to dump the original ISO image file to a temp directory.

If anyone is aware of any 'already-compressed' disc image FORMATS already out there that any free CD/DVD burning software supports?

It would be great to burn already-compressed disk images on-the-fly without resorting to unzipping.

thanks,
Scott.

Underheaven
24.08.2005, 05:27
scottcopus (http://www.daemon-tools.cc/dtcc/portal/profile.php?mode=viewprofile&u=32101), if you scroll up on this same page (page 4) of the thread you'll see I said "Compressed/encrypted image support is not available until DAEMON Tools version 4.0." According toLocutusofBorg (http://www.daemon-tools.cc/dtcc/portal/profile.php?mode=viewprofile&u=2), such plugins will not be available right away but are planned.

Link whereLocutusofBorg (http://www.daemon-tools.cc/dtcc/portal/profile.php?mode=viewprofile&u=2)originally talked about this.
http://www.daemon-tools.cc/dtcc/portal/viewtopic.php?t=5685

So, in terms of what 'FORMAT' it would be. I see it being implemented just as a compression wrapper around any other format. So the way the compressed data is saved, in whatever format won't matter to you because you'll end up mounting and using the format stored inside the compressed file(s). That's my idea about it...

scottcopus
24.08.2005, 05:42
Yeh, thanks... but I was actually looking for a burning program that could somehow burn these types of already-compressed images... directly.

I guess I could load up Daemon Tools and mount these compressed images onto a virtual drive letter... and then copy that way. But that seems lame.

thanks for reply though,
Scott.

yacbos
14.11.2005, 16:01
well can someone explain what is 2048 and 2352 cuz am newbie in this iso stuff
i would appreciate it

evan_davis5225
21.11.2005, 15:49
well can someone explain what is 2048 and 2352 cuz am newbie in this iso stuff
i would appreciate it

That names how many bits per sector are in the image (I think
:wink: )

Underheaven
21.11.2005, 16:40
bytes :wink:

evan_davis5225
24.11.2005, 00:54
bytes :wink:
Meh, as long as someone gets it right. What I am wondering is if anyone at DT is currently working on a plugin like this?

yacbos
28.11.2005, 22:20
That names how many bits per sector are in the image (I think
:wink: )
well if 2048 or 2352
what the differnce i mean at the end the cd will hold the 700 mb or there is somekind of trick cuz i really dont get it

Underheaven
29.11.2005, 03:30
What I am wondering is if anyone at DT is currently working on a plugin like this?No news on a compression plugin yet. However, you can see NetSoerfer's post concerning an encryption plugin here (http://www.daemon-tools.cc/dtcc/showthread.php?p=33032#post33032).

puntloos
29.11.2005, 03:33
(strange, it didnt post last time.. hope Im not double-posting..)

http://rzip.samba.org/

Rzip is specifically designed for compressing with very long block sizes. It is also open source (and you can choose to just open-source the plugin).

From what I read, I seriously expect rzip to shave off 10-20% of a CD image that only contains .cab files and a setup.exe.

Not to mention low-entropy files like text, clip art etc etc e

Underheaven
29.11.2005, 04:05
DAEMON Tools needs something written in C with no external library dependencies (you can't access user-mode .DLL's) and that can run in kernel mode.

Edit: seems I'm wrong, VeNoM386 mentioned allowing normal user-mode programs in this post (http://www.daemon-tools.cc/dtcc/showthread.php?p=6044#post6044) (also made in this thread). But still keep in mind that if someone wants to make a plugin now they don't have to wait for the user-mode changes to be added to DAEMON Tools.

HAANDI
20.12.2005, 15:12
That feature would be very useful because the most recent games which have starforce protection have lots (~1-2GB) 0bytes. And 0bytes are really well compressable.

BobbyJoe
14.01.2006, 16:43
If I may add my humble 2 cents, I have tried compressing a PS1 game ISO (Threads of Fate) with several different formats. 7zip was head and shoulders above the rest. In addition, it's open source.

Original - 340 MB
GZip - 255 MB
BZip - 244 MB
BZip2 - 235 MB
WinRAR 2.0 - 232 MB
WinRAR 2.9 - 183 MB
WinRAR 3.5 - 116 MB
7Zip - 50 MB !!!!!

I've read elsewhere that 7zip really excells at compressing ISOs and my own testing seemed to back that up. It would really be nice to compress all my playstation ISOs to this small of a file size then simply mount the one I want to play with DT. The compression included with Mooby's plugin for ePSXe doesn't really compress them a lot (the GZip & BZip sizes above).

Just a thought.

Jito463
15.01.2006, 04:33
The problem with open source is that you're expected to release any project using open source code as open source. That's simply not going to work with a project like Daemon Tools. If they release the source code, that's like an open invitation to the copy protection companies to blacklist them. Would you really want that?

Underheaven
15.01.2006, 04:36
The idea is that compression plugins (or any plugin) for DAEMON Tools 4 will be able to be made by external authors. What this means for licensing or legal issues, I can't claim to fully understand (I stopped trying to understand the differences between the licenses on opensource.org a while ago) but I think it means that someone external to DT Soft can make a compression addon and that DAEMON Tools will not have to become open source as a result of that addon.

Andareed
15.01.2006, 05:06
Most plugin-type opensource software is released under LGPL, which means we could link to them and use them in their unmodified [binary] form.

GPL itself is somewhat loose. The Free Software Foundation (FSF) is of the opinion that if you use GPL in any software, that new software becomes a derivitive product and is subject to the GPL (means source-code must be distributed with binaries). However, many closed-source vendors (e.g., NVIDIA and VMware) use GPL'd stuff, and simply state in their help/about that they use said software. These vendors believe that merely including GPL'd stuff does not create a derivitive product (this interpretation of the GPL seems more reasonable, imo).

Underheaven
15.01.2006, 16:03
Thanks for the explanation

BobbyJoe
16.01.2006, 04:22
So . . . . any word on when/if this is going to happen? It seems to be a very wanted feature.

Underheaven
16.01.2006, 05:18
In post #47 of this thread I said it will be available for DAEMON Tools version 4.0. No release dates though.

duloque
21.01.2006, 17:23
Another example for a good use of CD compression are Audio CDs. Like putting a CD as ONE piece on the HD, which makes mp3 impractical.

.. or wanting to play Quake1 with CD music without CD in drive. The single image is about 650MB, even a simple compression could save much spac because pure data only takes 35MB. =)

Can't wait to get news on this!

HAANDI
07.04.2006, 21:20
Hey guys, on the net I found an app called PowerISO (hxxp://www.poweriso.com). It has its own compressed image format which you can mount in PowerIso. So there is already a imageformat and only the plugin for it is missing.

puntloos
30.04.2006, 18:56
Any progress on this? Is anyone actually working on it?

(yea yea 'do it yourself'.. but Im sadly not a programmer :()

roysubs
23.06.2006, 09:58
Hi,

I have a 7.9 GB archive of html document files on my hard disk. This archive contains over 75,000 files, and of course will not fit on a singly-layer DVD with conventional ISO / NRG etc image formats. Then I found the PowerISO DAA format, and discovered it was a full DVD imaging format (including support for bootable discs etc) but with compression. With compression, my 7.9 GB archive of 75,000 files compressed to a single image file of exactly 4.36 GB and fits on a DVD. I can mount this with the PowerISO virtual mount tool and go through these html documents with ease (note, with RAR or ZIP I would have to decompress the whole thing first, with the DAA I have a mountable drive which means all internal html links work perfectly without having to decompress to temporary locations). The only thing is having to install the PowerISO image software, as I would like to be able to mount this via DaemonTools.

Every issue on this pinned thread would be solved I think by supporting the PowerISO DAA format, it's a good format and works well, and I hope that you can give serious consideration for including support for this in the next DaemonTools release ?

Thanks,

Roy.

Underheaven
23.06.2006, 16:26
Did you see post #61 of this thread?

BobbyJoe
26.06.2006, 11:50
Yeah, the Power ISO thing is somewhat helpful, but the compression ratio pales in comparison to things like 7zip. My biggest interest is in playing PlayStation ISOs without having to decompress them first and nothing compresses a PlayStation ISO like 7zip.

Top Qat
27.06.2006, 20:24
UltraISO now supports a compressed ISO format that has the ISZ extention.

Any one know much about this?

maciozo
11.07.2006, 10:04
Hello all, just wanted to report that a new image format is available. It can be useful for games/apps using dummy files or uncompressed data.
Here's a description from EZB forum:

One of the most advanced archive formats like RAR and ZIP, it is:
- a secure ISO format, as AES256 encryption is supported, you can use a password with up to 32 characters length
- a small size ISO format, you can compress an ISO image to smaller size. What is 'Heavy Compress' feature? you can give it a try.
- spanned CD/DVD format. If your ISO image is a large file, you can split it to segmented ISZ files(I01, I02, ...). So you can burn a DVD ISO to multiple CD-R discs, as well as burn a 200GB large file to a couple of DVD-R/+R discs. In addition, it is possible to store DVD images on FAT16/FAT32 volume under Windows 98 systems now.


http://forum.ezbsystems.net/cgi-bin/ikonboard.cgi?act=ST;f=2;t=1412

Underheaven
11.07.2006, 10:41
fyi: Image spanning has been available for years in Alcohol 120%

maciozo
12.07.2006, 21:58
Spanning is nothing exciting to me, what I meant exactly was that no image format (except Norton Ghost) offers compression. I think that everyone would agree that it would be great if DT would support such standard... (too many 'woulds' lol)
Greetz

forkart
15.07.2006, 19:22
MagicISO also supports compressed iso format. the new compressed iso format can be mounted by MagicDisc.

Universal Image Format(UIF) is a powerful compression image file format for backuping CD/DVD. It is fast, reliable, and has rich set of features which include password-protected, data encryption, MD5 checksum support and much more. UIF can not only contain the complete data of CD/DVD just like ISO image, But UIF also supports backuping multi-session CD/DVD, Audio-CD, VCD, SVCD and DVD-Video.

http://www.magiciso.com/tutorials/miso-whatuif.htm

Underheaven
16.07.2006, 07:22
Universal Image Format(UIF)
This format does not seem capable of Data Position Measurement. It is important to keep in mind how many games require this nowadays.

maciozo
16.07.2006, 09:55
MagicISO has a very bad virtual drive; i.e. StarForce protected games don't even detect mounted ISO as a disc :D

cRzcCs
22.08.2006, 16:02
Hi, I just tested some ISO formats to compare filesizes...

I used a CD from ABBYY FineReader Pro 8.0 from work for these tests, and here are the results:

standard .iso file: 278 MB (291.602.432 Bytes)
NTFS compression: 206 MB (216.100.864 Bytes)
PowerISO .daa file: 150 MB (158.073.385 Bytes)
UltraISO .isz file: 150 MB (157.738.395 Bytes)
(all files were "optimized" to remove double files)

P.S.: NTFS-compressed, the .daa went down 200kb, the .isz lost another 100kb.

Side note 1: PowerISO Computing (makers of PowerISO) have a built-in virtual drive to mount .daa-files directly, perhaps they can be convinced to open the specifications of the .daa-file to Daemon Tools.

Side note 2: EZBsystems (makers of UltraISO) look like they are creating a ".ISZ CD/DVD emulator" to support their .isz-format, and even daemon tools is mentioned in their forum (http://forum.ezbsystems.net/cgi-bin/ikonboard.cgi?act=ST;f=2;t=1414) to be supported eventually. This format looks most promising for me, as the forum post says Daemon Tools and Alcohol will be supported later.

Just my 2 cents...
cRzcCs

edit by Admin: Please do not post your messages multiple times. The forums are moderated which is why your posts don't show up immediately.

Cuddles
27.08.2006, 12:07
.daa and .isz image formats are useless because they don't have information required to emulate CD protections. What we need is a support for compressed .mdf files.

cRzcCs
03.09.2006, 18:25
.daa and .isz image formats are useless because they don't have information required to emulate CD protections. What we need is a support for compressed .mdf files.

Well, just because you think they are useless means not that they are :)

For CDs/DVDs with a lot of html-files and stuff, they are absolutely sufficient, and those are compressible as well. I vote for compressible image-files in general, not just for mdf/mds files.
And I vote for support of .daa and .isz-files as well, because these are already established formats which would be good enough to use for those CD/DVD images I just mentioned. Indeed it would be useless to make a mdf-file of some documentation cd, because there is no copy protection on it. Nevertheless, of course it would be wonderful to be able to use compressed image files with protection, and I strongly vote for that, too.

So long,
cRzcCs

Archeron
11.09.2006, 15:04
I think ISO images are like a RAR file... But if you setup WinRAR to just "Store" the files, then the RAR and the ISO have the same properties in size matters. I think it would be better if we create ISO and MDF/MDS based on 7-Zip compactation mode... (7-Zip is a tool like WinRAR, and we can setup everything for the best compactation, not just "Store" or "Compact", and, trust me, 7z makes miracles). Maybe we use 7ISO, 7MDF, and other image types. So, what we could have here is: DT Support for compressed images, and a Image Compression Tool based on 7z.

Elandril
11.09.2006, 17:43
@Archeron:
The problem with 7-zip is that it takes insanely much memory to decompress as well as a good bunch of processor power. Okay, with Dual processors getting the standard nowadays, the lags can be brought down, but the transparent decompression engine needs to utilize that.

The main problem with compressing images is that they require random read acces, meaning that the CD/DVD image is not being decompressed from start to end (like WinRAR), but needs to be separated into small chunks that can be decompressed swiftly and independeptly from each other. Usual chunk sizes are between 16 and 64 physical clusters or between 64 and 256 kBytes for any compression algorithms that offer fast und lightweight (called "transparent") decompression.

Unfortunately this also means that the compression rate is somewhat limited and less than optimal. The error correction parts of the CD/DVD data segments for example is highly entropic (i.e. random) by design, so that compressing those parts yields nearly no size reduction and in general only costs cpu power and memory. We might consider a image format where the error correction zones are exempt from the compression so that only the data parts get clustered together and compressed.

Archeron
14.09.2006, 01:28
Well, WinRAR, 7-Zip, WinISO or everything else, anyway is OK for me. What really matter for me is I will can then wait less time to Download, Upload, and more things related with Images...

Jito463
15.09.2006, 18:53
Where exactly are you downloading and uploading these images?

cRzcCs
22.09.2006, 00:17
Why do you ask such a question? Do you want to download his personal backups? That would be highly illegal, I guess... At least if there are images with commercial software on it... On the other hand, if there was _no_ commercial software on it, you wouldn't have asked, right? So don't drift off on those paths. It really begins to annoy me if people do that. He did not _ever_ mention anything illegal, so don't put words like these into other peoples' mouths.
Let's stay on topic and hope in the next version there is support for compressed images of *ANY* kind.

Just my 2 bucks.

Jito463
22.09.2006, 16:39
No, I don't want to download his files. I'm a member of the support team at Alcohol Soft and also provide unnofficial support occassionally here at DTools site. I was asking to ensure it wasn't leading to talk of illegal downloads. Stop putting words into my mouth.

nand
02.11.2006, 01:04
I make feature request for support of UIF image format. Reason for this is that UIF supports compression like RLE algorith, allowing for many time smaller images sometimes...

Daemon tools does not support any format that allows compression!

maXmo
19.11.2006, 13:44
isz format specification (http://forum.ezbsystems.net/cgi-bin/ikonboard.cgi?act=ST&f=2&t=1540&st=#entry6172)

bloodbob
25.11.2006, 23:54
While daemon tools doesn't support compression it will run fine if the file system transparently compresses files. ( I.E. compressed NTFS files ) So you can always try that.

Development
07.12.2006, 05:02
Based on many user inputs we actually started work on adding compression to MDS format, so stay tuned.
After lot of analysis and also based on investigations (eg. xrmb made also great analysis 3 years ago, see start of this thread) we will try ZLIB based method used in GZIP for 16-sector chunks.

Elandril
07.12.2006, 09:18
Based on many user inputs we actually started work on adding compression to MDS format, so stay tuned.
After lot of analysis and also based on investigations (eg. xrmb made also great analysis 3 years ago, see start of this thread) we will try ZLIB based method used in GZIP for 16-sector chunks.
That's awesome news!!!

Development
05.01.2007, 08:52
Direct support for ISZ images planned in next release too.

ender-01
06.01.2007, 18:06
That's great news! I'm actually pretty fond of the UltraISO compressed isz format, as it works nicely (infact, on the highest setting, it actually beats 7-zip Ultra sometimes).

Do you happen to know if the planned support for .isz will also include recognizing .isz split segments feature (.isz, .i01, .i02, etc)? UltraISO's virtual tool does this, but unfortanutely, the majority of my programs don't recognize UltraISO's virtual drive.

Thanks!

Development
08.01.2007, 13:44
Full support will be added according to published specification, including split files.

djbobo
08.01.2007, 16:37
All,

which tools/appl. will be able to generate compressed images (expect UltraIso with .isz format) ??

Mesterial
04.04.2007, 12:08
So, any news about integrating compressed image in DA ??:confused:

Copytrooper
08.04.2007, 10:12
Next Daemon Tools version will support compressed and encrypted images, so stay tuned. It will be released when it's done. ;)

aldo vargas
14.04.2007, 14:44
THANKS for the new .isz feature, it is great! I have been waiting years for compressed ISO support.

Have you considered in adding CSO support in a near future? CSO have been proven to be a good compressed format in PSP world and it is not commercial. However it doesn't compress as much as .isz

foxyshadis
21.04.2007, 08:38
I love what you're doing with compressed images, it warms my heart. <3 Will the mds compression be able to handle the elimination of difficult-to-compress checksum data, similar to the ECM tool? Unfortunately, isz doesn't work for me when most of my files have at least some sectors without checksums. And I know this is a long shot, but will it support any form of dedicated audio compression, either more intelligent lossless like flac or even mp3? (Doubtful, I guess, and I'll probably still have to manually deconstruct audio/video in archived game backups, and reconvert when I want to play again.)

kapoue3
24.05.2007, 14:55
Dear DT team,
It seems that some people need compressed ISO, I've asked to write a plugin but 'you' said that only companies/firms can write this.
I've a good experience in a specific Compressed format, that can be used by the Playstation Portable, called CSO
You can have a look on http://cisoplus.ifrance.com
I can easily simulate functions such as fopen, fread, fseek, ftell, etc.
The software still convert ISO->CSO CSO->ISO and even CSO->CSO (with different parameters of compression)
I don't really understand why it cannot be possible to have documentation or only some help to write simply a plugin like nrgmount.dll, bw5mount.dll, ....
Perhaps the code to read ISO is inside the main program?
Can you just give me some information to understand how is hard to develop such a plugin
Thank you
Best regards

Development
31.05.2007, 13:52
It is not possible to make plugin like bw5mount which simply
"simulates" fopen, fread etc for virtual drive because it works in kernel: you need make some driver. Current plugin architecture can work only with uncompressed images or only with some compressed formats which are supported directly in kernel by virtual drive itself: these are currently only ZLIB and BZIP2.

kapoue3
31.05.2007, 20:07
Current plugin architecture can work only with uncompressed images or only with some compressed formats which are supported directly in kernel by virtual drive itself: these are currently only ZLIB and BZIP2.
The CSO format uses (and I used) the zlib. There are only inflateInit2 inflate and inflateEnd. The CSO format is very very simple to understand and implement. It's clear that it will produce larger files than other compression schema but I think it will be very interesting to have a look on it.

Thank you for your explications

Development
01.06.2007, 18:49
In such case making plugin for it should be straightforward -
for any further info please mail locutus@daemon-tools.cc

merlin
03.06.2007, 12:55
I love Daemon Tools and would put it above all other virtual cd applications. However I think you guys should look at the possibility of supporting file types that are not traditionally used as cd image files (e.g. .zip, .rar, vhd, etc.)
There's an application called WinMount that is moving in this direction. It's no where near as nice as Daemon Tools but I think the developer has some interesting ideas. Take a look.
http://www.winmount.com/

kapoue3
05.06.2007, 16:06
In such case making plugin for it should be straightforward -
for any further info please mail locutus@daemon-tools.cc
It's done, I'm waiting your reply

TheBigGuy
16.02.2009, 02:03
A good compressed CD Image format is .CISO which you can use Pismo File Mount to create and convert your ISOs to CISO. It uses LZMA compression and is better than .UIF, .DAA and .ISZ in terms of compression.

It is completely free and open source and I hope to see it integrated into Daemon Tools!

Pismo File Mount (http://www.pismotechnic.com/)

-Neil

dave4mame
04.04.2009, 13:25
hi, are there any plans to add mp3 support?
i mean audio track stored as mp3
bin+mp3 is a format largely used to store old console games (saturn, psx, sega cd)... emulation community would be grateful forever!

cocomonk22
12.04.2009, 10:48
A good compressed CD Image format is .CISO which you can use Pismo File Mount to create and convert your ISOs to CISO. It uses LZMA compression and is better than .UIF, .DAA and .ISZ in terms of compression.

It is completely free and open source and I hope to see it integrated into Daemon Tools!

Pismo File Mount (http://www.pismotechnic.com/)

-Neil
I disagree. DAA is better compression if you compare DAA with best compression settings with CISO using LZMA settings. However, CISO using LZMA is the second-best compression for CD images, beating ISZ, UIF, and MDS/MDF, and due to it being free, it would be easier to implement into Daemon Tools.

Cleveland Rock
20.07.2009, 13:26
Any word on 7-Zip support? This is a much needed feature!

JoSch
29.07.2009, 01:15
My suggestion is:

Support transparent compression for all image formats
Support two compression.formats:
1. gzip, because it is wide used and very fast with still good compression ratio.
2. xz (the official format for LZMA2 on Linux, this means same compression as 7-zip) because it provides very good compression


The containers and compression methods are very well documented, and there is widely used public-domain code available.

Resources:
For gzip:
Description: RFC1952 (http://www.ietf.org/rfc/rfc1952.txt)
Library: zlib (http://www.zlib.net/)

For xz:
Description: XZ file format (http://tukaani.org/xz/xz-file-format.txt)
Library: LZMA SDK (http://7-zip.org/sdk.html) and XZ Utils (http://tukaani.org/xz/)

The image would then be stored as e.g. image.iso.gz or image.iso.xz
The same for other image formats.
So you would have to implement this as filter, which processes the file stream and then forwards it to the code handling the different image formats.
If you would create a plugin-api for this, it could be extended by other developers, but I think this two formats should be enough.

Kevin12345
29.11.2011, 05:56
such file does not support daemon tools images