views:

641

answers:

13

I release a single executable (.EXE) for a desktop program using Delphi 2009. I have no external DLLs or resources that I need for the program to run.

I use two components: LMD Innovative's ELPack and Sergey Tkachenko's TRichView that are compiled into my executable.

When I build my production version, using the "Release" build configuration, the executable file produced is 13,533 KB.

Prior to using Delphi 2009, I was using Delphi 4. The executable it produced was only 2,671 KB while incorporating the same two components and basically having the same code as my current version.

I do understand that Delphi 2009 is completely Unicode (which is the main reason why I upgraded), and being Unicode can cause up to a doubling of size. But this is about 5 times larger.

Is there a reason why my executable has to remain 5 times larger? Or are there some simple ways to cut down a significant chunk of the executable size?


Please note. Some people are answering with ways to compress the Delphi EXE. That is not what I am trying to do. I am trying to simply see why so much space is being used to remove what might not be necessary. If that is done, compression can still be done afterwards if so desired.

It really doesn't matter how big or small the executable is once it is installed. It is for downloading purposes and to minimize server load and download times that you want to compress it. I prefer to use Inno Setup and compress the program inside the install routine itself. Then when it is installed, it is expanded to full size. That both prevents possible detection as a virus and eliminates the extra startup time needed to uncompress the program in memory. Also I code sign both my executable and my install routine and some compression techniques are incompatible with that.

For more info about compressing, see the StackOverflow question: Delphi EXE compressor?


ldsandon asked me to provide exactly what options I'm using, so here they are:

Compiling Options

Linking Options

+4  A: 

Factor out the expected 2X increase from Unicode and you end up with a 2.5X increase unaccounted for. This makes sense considering how many versions you've skipped. A lot's been added to the VCL and RTL since Delphi 4, and not all of it is stuff that can be easily smartlinked out, even if you never use it. Depending on how many units you're using, you could be hauling in quite a bit of extra baggage.

Allen Bauer and the compiler team added a new feature into D2010 to help reduce this, but apparently they're treading cautiously and didn't use it in as many places as they could have. Hopefully we'll see more cruft reduction in 2011 and subsequent releases.

Mason Wheeler
2X for Unicode is quite excessive.
Nick Hodges
I know. It's a fair bit less than that, since not everything in the app is a string. But my main point is that a lot of it comes from the standard libraries getting bigger.
Mason Wheeler
@Mason: My next major upgrade will be for either 64 bit or Cross-Platform compilation, whichever comes first. I hope my executable doesn't grow to 30 MB then.
lkessler
64-bit really is bulkier than the same x86. But for code only, and the question is if this is all code. As Mason said, to answer that we would have to find what causes the (at least) 2.5X factor that is unaccounted for
Marco van de Voort
+7  A: 

Without seeing the actual settings that your "Release" build configuration uses explaining this increase in size requires a great deal of speculation.

Beyond some perhaps unlikely factors resulting in a vast increase in the amount of code being "dragged in" even though it isn't used, that magnitude of increase would most easily be explained by the inclusion of debug information.

I would check your compiler and linker settings for:

  • Debug Information (compiler setting)
  • TD32 info (linker)
  • Remote debug info (linker)

Compare these settings in your Delphi 2009 project with the equivalents in Delphi 4.

Deltics
Thanks @Deltics: I believe I am using all the default Delphi 2009 "Release" settings. In Delphi 2009, the TD32 setting has been replaced by Linking Debug Information (see: http://blogs.embarcadero.com/chrishesik/2009/09/15/34920/ ) which I have as "False". Remote debug symbols in the linker is False. But I do have Compiling Debug Information as True, Debugging Symbols as True and Local Symbols strangely in opposition to them as False. Then there's Linker output as Generate DCUs and Map File as Detailed. I can play with those, but I'll be surprised if they save me very much.
lkessler
You may be surprised at how much difference Debug Information can make. At the very least it would be worth turning it off and finding out. Also, are you using MadExcept or any similar utility which may be embedding the MAP file in your executable in a post-build step?
Deltics
@Deltics: I do use EurekaLog for tracing errors, but I have most of its options (including memory leaks) turned off. Turning off EurekaLog entirely only reduces the executable by 90 KB.
lkessler
@lkssler, EurekaLog has the odd habit of turning on Debug Info for your exe if enabled. Did you try disabling EurekaLog, then turning off all "debug" options in the build configuration and then building again? 90Kb is not enough decrease in size for removing debug information. I gave up on EurekaLog because it messed with my build configurations, never looked back.
Cosmin Prund
Thanks @Cosmin, I'll look into that.
lkessler
Looking at your compiler options, why are you linking debug dcus?? Those are larger, might prevent the linker from removing unused code, might be slower.
Cosmin Prund
@Cosmin: Not sure what you mean by saying I'm "linking debug dcus". In my linking configuration, Debug information is "False" and Linker output is "Generate DCUs". You can't turn off "Generate DCUs" unless you generate C++ objects instead, which I don't want to do.
lkessler
@Lkssler, on your "Delphi compiler/Compiling" image, look at the focused line, the one with the double black arrows in front of it, it's the 5th line under "Debugging". It reads: "Use debug .dcus" and it's True. You've also got "Debug Information" = True, this is the 2nd line under "Debugging", make it False. Build with those settings flipped and report back, I'm curious.
Cosmin Prund
@Cosmin Debug information is NOT included into executables. So, "debug information" and "Use Debug DCUs" options do not affect executable. These options only affects DCU files. Of course, enabling EurekaLog will mean including debug information, but it's a very tiny overload, as lkessler already pointed out. Turning off EurekaLog will turn off adding debug info - so no matter what your options are - debug info will not make it into executable.
Alexander
+5  A: 

When moving from Delphi 7 to Delphi 2010., our .exe's grew for example from 16 megs to 35 megs.

I asked a question similar to yours on the Embarcadero forum a few weeks ago. (link) In my OP, I listed a series of links on this subject that you might find helpful.

We tried using UPX to compress our .exe's. Letting it work for hours significantly reduced our .exe, but we probably won't use it in production for these reasons:

  1. We have quite a few .exe's and don't want to wait 1/2-day on each build. (It's possible that we could find a non-brute force set of parameters to UPX that would reduce this...)

  2. Although the size of the .exe is reduced, our shippable was not, because our installer (not surprisingly) is unable squeeze much more compression out of the already compressed file... whereas it was able to reduce the original 16 meg .exe down to 8 megs.

  3. I've read some reports that at some time (rarely, but not never), UPX exe's triggered various anti-virus programs to report the application contained a virus. (I don't recall the date, site, or details of where I saw this, so it's a bit unfair of me to report it here.) But, we are so adverse to taking a risk of that even possibility happening, that UPX is off the table...

The link on the Embarcadero forum also includes a link to another SO thread on this topic.

I continue to be surprised and disappointed at the code bloat we found when moving to Delphi 2010. As Nick notes, 2X for Unicode is quite excessive.

However, the bloat is a relatively minor trade-off when moving to D2010, because, IMO, D2010 is such a terrific upgrade in so many other ways. But, it does mean that we'll probably have to move to shipping 2 CDs rather than one. I'm not looking forward to seeing the reaction to this from our organization...

Tom1952
@Tom1952: You cannot compress something twice. So it is better to use the installer to do the compression to reduce download size. I use InnoSetup and it includes my 13.5 MB program into a Setup package that is only 4.5 MB. When the setup is run, it decompresses the program to its full size, so it will not have any possible virus detection problems.
lkessler
@Tom1952: Thank you for the link to your similar question on the Embarcadero Forums. That's a very interesting discussion (including some comments by Peter Below). One point you mentioned is about large icons. Well, I did add some large Vista icons to my program that could have added a MB to the size. Maybe the program you wrote might help me.
lkessler
@Tom1952: I hadn't seen that other SO question. That's a good one with good ideas and links to a few useful utilities.
lkessler
D2010 is a different matter due to its expanded RTTI possibiltiies, I can imagine that a wrong management of that (turning it on everywhere) can bloat an exe. OP was talking about D2009.
Marco van de Voort
UPX triggering false-positive is a risk, certainly. But you can also get the same with your setup, any library, or by using any particular development environment (Delphi, VS, etc..). So while you can't elmiinate the risk, it is reasonable to cut down on the number of risk factors by skipping UPX.
Chris Thornton
@Tom1952: Code Bloat: Well from 16 MB to 35 MB isn't as bad as the exponential growth of Microsoft's Operating Systems over the years.
lkessler
@lkessler how can I see if something grows exponentially if I have only two samples (16 and 35)? :)
mjustin
@Tom1952: You can add my 2.5 MB Delphi 4 to 13.5 MB Delphi 2009 and now you have four samples. :-)
lkessler
+3  A: 

Use "upx - compress or expand executable files" @ http://upx.sourceforge.net


If you go to tools/configure tools, and set it up like this, you can compress the executable that you're working on easily via a menu item in the IDE.

Configuration

Adam Craig Johnston
IMO, you're better off leaving the UPX for later in the deployment process. i.e. don't bother with it in the IDE, it just slows you down. Wait until you're ready to deploy, and do it in the same job (.bat file, Visual Build Pro, etc..) that you codesign, localize, build the setup, etc..
Chris Thornton
@Adam. I'm asking the question not to simply reduce the size of the executable, but to identify any useless excess size and find why it grew so much between Delphi versions. To reduce download time, I use InnoSetup to create a compressed setup file. See my comment to Tom1952's answer.
lkessler
+1  A: 

If you don't want to use an exe compressor then you should give StripReloc a try.

splash
But you can use StripReloc AND a compressor.
philnext
@splash: See my comment to Adam's answer.
lkessler
+2  A: 

Another way is to have a look to 'what unit increase the size ?'.

To do this, I use the JCL 'Project Analyser IDE', integrated in the IDE with the JCL/JVCL installation, it show you all the units with their respective size. You can export it in text file. If you do it with the 2 environnements (D4 & D2009) you will have a lot of pertinent informations.

philnext
Thans @philnext. Unfortunately, I didn't reinstall Delphi 4 when I went to a new machine. I need old versions of ElPack and TRichView to work with it and I remember they were a bugger to install back then, so it was never worth the bother, especially since my new code is Unicode and completely incompatible with Delphi 4 now.
lkessler
A: 

The standard units in you newer delphi may contain more strings and constants such as error strings, that is included even if you disable debug information. Check your uses.

Don't have much of a somution besides not using a specific unit, or removing unneeded data from it.

(My experiences are with Delphi 5)

Jens Björnhager
+2  A: 

I will add my few words. Linker can remove unused procedures and functions only if it can follow the code hierarchy. The nightmare list for linker listed below:

  • Message-driven code, the sad news is that this code can't be removed whatsoever, that's why Delphi blank project size continues growing from version to version. Every new windows message (WM_TOUCH for example as long as I know introduced recently) creates procedure call hierarchy that can't be removed (even if you don't have plan to use Touch API at all). This is because every *case WM_:* fragment is something linker can't decide whether it will be used or not.

  • Code and data structures accessed from the begin end, initialization, finalization secions of the units. Here you have some control, remove unnecessary calls or object creation. Even if you create objects on demand and only free them in finalization section, make it carefully

informin
+1  A: 

1) You are generating a detailed map file, and because you've set "used debug dcus" it will also contains symbols for the RTL/VCL units. If it is used by an exception handling systems to generate call stacks and the like, it could be added to the executable. And if not compressed somehow, it could make your .exe size pretty large.

2) Using debug dcus will also make your .exe somewhat larger because usually they are compiled without optimization and debug options set, and they will make also your code slower. They shouldn't be used in a release version.

3) Debug information should add debig info only to the unit and not to the executable, although it is required IIRC to generate the map file.

ldsandon
+2  A: 

I've done some tests to see the difference between D2007 and D2010, because we are upgrading to D2010. I've tested a medium sized management GUI application, with about 60 forms (grids with detail forms, frames, etc). We're using TMS components + Remobjects.

D2007:
"normal" compilation: 18.8mb
with debug dcu's: 18.8mb (same size!)

D2010
normal: 23.9
debug dcu's: 48.8mb (!)

So using debug dcu's doubles our exe size...

Test with our business service (no big dfm's):
D2007: 12.3mb
D2010: 17.1mb

So yes, D2010 increases the exe (a bit), but this is not a problem for my customer.

Edit: some information about compiled size:
D2007:
alt text
D2010:
alt text

So an increase of code size, but a more than doubling of the data!

André
A: 

Since D2010 adds extended RTTI, and RTTI is a notorious factor in increasing exe size, it would be interesting to see how big D2009 binaries are for that application.

If D2009 binaries are significantly smaller, it is not Unicode etc. For my own binaries, I only have a 30% increase or so going from D7 to D2009.

Marco van de Voort
+1  A: 

Check format of your dfm-s. They must be in binary format if you want to make your exe smaller.

Torbins
A: 

It has been stated earlier that using an executable compresser reduces the size of the exe but not of the install package. However, if you want a good compressor then try ASPack.

@Tom1952: ASPack is pretty fast, just a few seconds to compress a file

Joe Meyer