ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/App-Staticperl/staticperl.pod
(Generate patch)

Comparing App-Staticperl/staticperl.pod (file contents):
Revision 1.2 by root, Mon Dec 6 20:53:44 2010 UTC vs.
Revision 1.57 by root, Wed Dec 5 15:19:52 2012 UTC

1=head1 NAME 1=head1 NAME
2 2
3staticperl - perl, libc, 50 modules all in one 500kb file 3staticperl - perl, libc, 100 modules, all in one standalone 500kb file
4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 staticperl help # print the embedded documentation 7 staticperl help # print the embedded documentation
8 staticperl fetch # fetch and unpack perl sources 8 staticperl fetch # fetch and unpack perl sources
9 staticperl configure # fetch and then configure perl 9 staticperl configure # fetch and then configure perl
10 staticperl build # configure and then build perl 10 staticperl build # configure and then build perl
11 staticperl install # build and then install perl 11 staticperl install # build and then install perl
12 staticperl clean # clean most intermediate files (restart at configure) 12 staticperl clean # clean most intermediate files (restart at configure)
13 staticperl distclean # delete everything installed by this script 13 staticperl distclean # delete everything installed by this script
14 staticperl perl ... # invoke the perlinterpreter
14 staticperl cpan # invoke CPAN shell 15 staticperl cpan # invoke CPAN shell
15 staticperl instmod path... # install unpacked modules 16 staticperl instsrc path... # install unpacked modules
16 staticperl instcpan modulename... # install modules from CPAN 17 staticperl instcpan modulename... # install modules from CPAN
17 staticperl mkbundle <bundle-args...> # see documentation 18 staticperl mkbundle <bundle-args...> # see documentation
18 staticperl mkperl <bundle-args...> # see documentation 19 staticperl mkperl <bundle-args...> # see documentation
20 staticperl mkapp appname <bundle-args...> # see documentation
19 21
20Typical Examples: 22Typical Examples:
21 23
22 staticperl install # fetch, configure, build and install perl 24 staticperl install # fetch, configure, build and install perl
23 staticperl cpan # run interactive cpan shell 25 staticperl cpan # run interactive cpan shell
24 staticperl mkperl -M '"Config_heavy.pl"' # build a perl that supports -V 26 staticperl mkperl -MConfig_heavy.pl # build a perl that supports -V
25 staticperl mkperl -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI -MURI::http 27 staticperl mkperl -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI -MURI::http
26 # build a perl with the above modules linked in 28 # build a perl with the above modules linked in
29 staticperl mkapp myapp --boot mainprog mymodules
30 # build a binary "myapp" from mainprog and mymodules
27 31
28=head1 DESCRIPTION 32=head1 DESCRIPTION
29 33
30This script helps you creating single-file perl interpreters, or embedding 34This script helps you to create single-file perl interpreters
31a pelr interpreter in your apps. Single-file means that it is fully 35or applications, or embedding a perl interpreter in your
32self-contained - no separate shared objects, no autoload fragments, no .pm 36applications. Single-file means that it is fully self-contained - no
37separate shared objects, no autoload fragments, no .pm or .pl files are
33or .pl files are needed. And when linking statically, you can create (or 38needed. And when linking statically, you can create (or embed) a single
34embed) a single file that contains perl interpreter, libc, all the modules 39file that contains perl interpreter, libc, all the modules you need, all
35you need and all the libraries you need. 40the libraries you need and of course your actual program.
36 41
37With uclibc and upx on x86, you can create a single 500kb binary that 42With F<uClibc> and F<upx> on x86, you can create a single 500kb binary
38contains perl and 50 modules such as AnyEvent, EV, IO::AIO, Coro and so 43that contains perl and 100 modules such as POSIX, AnyEvent, EV, IO::AIO,
39on. Or any other choice of modules. 44Coro and so on. Or any other choice of modules (and some other size :).
40 45
46To see how this turns out, you can try out smallperl and bigperl, two
47pre-built static and compressed perl binaries with many and even more
48modules: just follow the links at L<http://staticperl.schmorp.de/>.
49
41The created files do not need write access to the filesystem (like PAR 50The created files do not need write access to the file system (like PAR
42does). In fact, since this script is in many ways similar to PAR::Packer, 51does). In fact, since this script is in many ways similar to PAR::Packer,
43here are the differences: 52here are the differences:
44 53
45=over 4 54=over 4
46 55
63=item * The generated executables don't need a writable filesystem. 72=item * The generated executables don't need a writable filesystem.
64 73
65F<staticperl> loads all required files directly from memory. There is no 74F<staticperl> loads all required files directly from memory. There is no
66need to unpack files into a temporary directory. 75need to unpack files into a temporary directory.
67 76
68=item * More control over included files. 77=item * More control over included files, more burden.
69 78
70PAR tries to be maintainance and hassle-free - it tries to include more files 79PAR tries to be maintenance and hassle-free - it tries to include more
71than necessary to make sure everything works out of the box. The extra files 80files than necessary to make sure everything works out of the box. It
81mostly succeeds at this, but he extra files (such as the unicode database)
72(such as the unicode database) can take substantial amounts of memory and filesize. 82can take substantial amounts of memory and file size.
73 83
74With F<staticperl>, the burden is mostly with the developer - only direct 84With F<staticperl>, the burden is mostly with the developer - only direct
75compile-time dependencies and L<AutoLoader> are handled automatically. 85compile-time dependencies and L<AutoLoader> are handled automatically.
76This means the modules to include often need to be tweaked manually. 86This means the modules to include often need to be tweaked manually.
87
88All this does not preclude more permissive modes to be implemented in
89the future, but right now, you have to resolve hidden dependencies
90manually.
77 91
78=item * PAR works out of the box, F<staticperl> does not. 92=item * PAR works out of the box, F<staticperl> does not.
79 93
80Maintaining your own custom perl build can be a pain in the ass, and while 94Maintaining your own custom perl build can be a pain in the ass, and while
81F<staticperl> tries to make this easy, it still requires a custom perl 95F<staticperl> tries to make this easy, it still requires a custom perl
82build and possibly fiddling with some modules. PAR is likely to produce 96build and possibly fiddling with some modules. PAR is likely to produce
83results faster. 97results faster.
84 98
99Ok, PAR never has worked for me out of the box, and for some people,
100F<staticperl> does work out of the box, as they don't count "fiddling with
101module use lists" against it, but nevertheless, F<staticperl> is certainly
102a bit more difficult to use.
103
85=back 104=back
86 105
87=head1 HOW DOES IT WORK? 106=head1 HOW DOES IT WORK?
88 107
89Simple: F<staticperl> downloads, compile and installs a perl version of 108Simple: F<staticperl> downloads, compile and installs a perl version of
90your choice in F<~/.staticperl>. You can add extra modules either by 109your choice in F<~/.staticperl>. You can add extra modules either by
91letting F<staticperl> install them for you automatically, or by using CPAN 110letting F<staticperl> install them for you automatically, or by using CPAN
92and doing it interactively. This usually takes 5-10 minutes, depending on 111and doing it interactively. This usually takes 5-10 minutes, depending on
93the speed of your computer and your internet conenction. 112the speed of your computer and your internet connection.
94 113
95It is possible to do program development at this stage, too. 114It is possible to do program development at this stage, too.
96 115
97Afterwards, you create a list of files and modules you want to include, 116Afterwards, you create a list of files and modules you want to include,
98and then either build a new perl binary (that acts just like a normla perl 117and then either build a new perl binary (that acts just like a normal perl
99except everything is compiled in), or you create bundle files (basically C 118except everything is compiled in), or you create bundle files (basically C
100sources you can use to embed all files into your project). 119sources you can use to embed all files into your project).
101 120
102This step is very fast (a few seconds if PPI is not used for stripping, 121This step is very fast (a few seconds if PPI is not used for stripping, or
103more seconds otherwise, as PPI is very slow), and can be tweaked and 122the stripped files are in the cache), and can be tweaked and repeated as
104repeated as often as necessary. 123often as necessary.
105 124
106=head1 THE F<STATICPERL> SCRIPT 125=head1 THE F<STATICPERL> SCRIPT
107 126
108This module installs a script called F<staticperl> into your perl 127This module installs a script called F<staticperl> into your perl
109binary directory. The script is fully self-contained, and can be used 128binary directory. The script is fully self-contained, and can be
110without perl (for example, in an uClibc chroot environment). In fact, 129used without perl (for example, in an uClibc chroot environment). In
111it can be extracted from the C<App::Staticperl> distribution tarball as 130fact, it can be extracted from the C<App::Staticperl> distribution
112F<bin/staticperl>, without any installation. 131tarball as F<bin/staticperl>, without any installation. The
132newest (possibly alpha) version can also be downloaded from
133L<http://staticperl.schmorp.de/staticperl>.
113 134
114F<staticperl> interprets the first argument as a command to execute, 135F<staticperl> interprets the first argument as a command to execute,
115optionally followed by any parameters. 136optionally followed by any parameters.
116 137
117There are two command categories: the "phase 1" commands which deal with 138There are two command categories: the "phase 1" commands which deal with
119with creating binaries and bundle files. 140with creating binaries and bundle files.
120 141
121=head2 PHASE 1 COMMANDS: INSTALLING PERL 142=head2 PHASE 1 COMMANDS: INSTALLING PERL
122 143
123The most important command is F<install>, which does basically 144The most important command is F<install>, which does basically
124everything. The default is to download and install perl 5.12.2 and a few 145everything. The default is to download and install perl 5.12.3 and a few
125modules required by F<staticperl> itself, but all this can (and should) be 146modules required by F<staticperl> itself, but all this can (and should) be
126changed - see L<CONFIGURATION>, below. 147changed - see L<CONFIGURATION>, below.
127 148
128The command 149The command
129 150
130 staticperl install 151 staticperl install
131 152
132Is normally all you need: It installs the perl interpreter in 153is normally all you need: It installs the perl interpreter in
133F<~/.staticperl/perl>. It downloads, configures, builds and installs the 154F<~/.staticperl/perl>. It downloads, configures, builds and installs the
134perl interpreter if required. 155perl interpreter if required.
135 156
136Most of the following commands simply run one or more steps of this 157Most of the following F<staticperl> subcommands simply run one or more
137sequence. 158steps of this sequence.
138 159
160If it fails, then most commonly because the compiler options I selected
161are not supported by your compiler - either edit the F<staticperl> script
162yourself or create F<~/.staticperl> shell script where your set working
163C<PERL_CCFLAGS> etc. variables.
164
139To force recompilation or reinstalaltion, you need to run F<staticperl 165To force recompilation or reinstallation, you need to run F<staticperl
140distclean> first. 166distclean> first.
141 167
142=over 4 168=over 4
169
170=item F<staticperl version>
171
172Prints some info about the version of the F<staticperl> script you are using.
143 173
144=item F<staticperl fetch> 174=item F<staticperl fetch>
145 175
146Runs only the download and unpack phase, unless this has already happened. 176Runs only the download and unpack phase, unless this has already happened.
147 177
154Builds the configured perl sources, potentially after automatically 184Builds the configured perl sources, potentially after automatically
155configuring them. 185configuring them.
156 186
157=item F<staticperl install> 187=item F<staticperl install>
158 188
159Wipes the perl installation directory (usually F<~/.staticperl/perl>) and installs 189Wipes the perl installation directory (usually F<~/.staticperl/perl>) and
160the perl distribution, potentially aftering building it first. 190installs the perl distribution, potentially after building it first.
191
192=item F<staticperl perl> [args...]
193
194Invokes the compiled perl interpreter with the given args. Basically the
195same as starting perl directly (usually via F<~/.staticperl/bin/perl>),
196but beats typing the path sometimes.
197
198Example: check that the Gtk2 module is installed and loadable.
199
200 staticperl perl -MGtk2 -e0
161 201
162=item F<staticperl cpan> [args...] 202=item F<staticperl cpan> [args...]
163 203
164Starts an interactive CPAN shell that you cna use to install further 204Starts an interactive CPAN shell that you can use to install further
165modules. Installs the perl first if neccessary, but apart from that, 205modules. Installs the perl first if necessary, but apart from that,
166no magic is involved: you could just as well run it manually via 206no magic is involved: you could just as well run it manually via
167F<~/.staticperl/perl/bin/cpan>. 207F<~/.staticperl/perl/bin/cpan>, except that F<staticperl> additionally
208sets the environment variable C<$PERL> to the path of the perl
209interpreter, which is handy in subshells.
168 210
169Any additional arguments are simply passed to the F<cpan> command. 211Any additional arguments are simply passed to the F<cpan> command.
170 212
171=item F<staticperl instcpan> module... 213=item F<staticperl instcpan> module...
172 214
177 staticperl instcpan EV AnyEvent::HTTPD Coro 219 staticperl instcpan EV AnyEvent::HTTPD Coro
178 220
179=item F<staticperl instsrc> directory... 221=item F<staticperl instsrc> directory...
180 222
181In the unlikely case that you have unpacked perl modules around and want 223In the unlikely case that you have unpacked perl modules around and want
182to install from these instead of from CPAN, you cna do this using this 224to install from these instead of from CPAN, you can do this using this
183command by specifying all the directories with modules in them that you 225command by specifying all the directories with modules in them that you
184want to have built. 226want to have built.
185 227
186=item F<staticperl clean> 228=item F<staticperl clean>
187 229
188Runs F<make distclean> in the perl source directory (and potentially 230Deletes the perl source directory (and potentially cleans up other
189cleans up other intermediate files). This can be used to clean up 231intermediate files). This can be used to clean up files only needed for
190intermediate files without removing the installed perl interpreter. 232building perl, without removing the installed perl interpreter.
233
234At the moment, it doesn't delete downloaded tarballs.
235
236The exact semantics of this command will probably change.
191 237
192=item F<staticperl distclean> 238=item F<staticperl distclean>
193 239
194This wipes your complete F<~/.staticperl> directory. Be careful with this, 240This wipes your complete F<~/.staticperl> directory. Be careful with this,
195it nukes your perl download, perl sources, perl distribution and any 241it nukes your perl download, perl sources, perl distribution and any
210In the oh so unlikely case of something not working here, you 256In the oh so unlikely case of something not working here, you
211can run the script manually as well (by default it is written to 257can run the script manually as well (by default it is written to
212F<~/.staticperl/mkbundle>). 258F<~/.staticperl/mkbundle>).
213 259
214F<mkbundle> is a more conventional command and expect the argument 260F<mkbundle> is a more conventional command and expect the argument
215syntax commonly used on unix clones. For example, this command builds 261syntax commonly used on UNIX clones. For example, this command builds
216a new F<perl> binary and includes F<Config.pm> (for F<perl -V>), 262a new F<perl> binary and includes F<Config.pm> (for F<perl -V>),
217F<AnyEvent::HTTPD>, F<URI> and a custom F<httpd> script (from F<eg/httpd> 263F<AnyEvent::HTTPD>, F<URI> and a custom F<httpd> script (from F<eg/httpd>
218in this distribution): 264in this distribution):
219 265
220 # first make sure we have perl and the required modules 266 # first make sure we have perl and the required modules
221 staticperl instcpan AnyEvent::HTTPD 267 staticperl instcpan AnyEvent::HTTPD
222 268
223 # now build the perl 269 # now build the perl
224 staticperl mkperl -M'"Config_heavy.pl"' -MAnyEvent::Impl::Perl \ 270 staticperl mkperl -MConfig_heavy.pl -MAnyEvent::Impl::Perl \
225 -MAnyEvent::HTTPD -MURI::http \ 271 -MAnyEvent::HTTPD -MURI::http \
226 --add 'eg/httpd httpd.pm' 272 --add 'eg/httpd httpd.pm'
227 273
228 # finally, invoke it 274 # finally, invoke it
229 ./perl -Mhttpd 275 ./perl -Mhttpd
230 276
231As you can see, things are not quite as trivial: the L<Config> module has 277As you can see, things are not quite as trivial: the L<Config> module has
232a hidden dependency which is not even a perl module (F<Config_heavy.pl>), 278a hidden dependency which is not even a perl module (F<Config_heavy.pl>),
233L<AnyEvent> needs at least one event loop backend that we have to 279L<AnyEvent> needs at least one event loop backend that we have to
234specifymanually (here L<AnyEvent::Impl::Perl>), and the F<URI> module 280specify manually (here L<AnyEvent::Impl::Perl>), and the F<URI> module
235(required by L<AnyEvent::HTTPD>) implements various URI schemes as extra 281(required by L<AnyEvent::HTTPD>) implements various URI schemes as extra
236modules - since L<AnyEvent::HTTPD> only needs C<http> URIs, we only need 282modules - since L<AnyEvent::HTTPD> only needs C<http> URIs, we only need
237to include that module. 283to include that module. I found out about these dependencies by carefully
284watching any error messages about missing modules...
285
286Instead of building a new perl binary, you can also build a standalone
287application:
288
289 # build the app
290 staticperl mkapp app --boot eg/httpd \
291 -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI::http
292
293 # run it
294 ./app
295
296Here are the three phase 2 commands:
297
298=over 4
299
300=item F<staticperl mkbundle> args...
301
302The "default" bundle command - it interprets the given bundle options and
303writes out F<bundle.h>, F<bundle.c>, F<bundle.ccopts> and F<bundle.ldopts>
304files, useful for embedding.
305
306=item F<staticperl mkperl> args...
307
308Creates a bundle just like F<staticperl mkbundle> (in fact, it's the same
309as invoking F<staticperl mkbundle --perl> args...), but then compiles and
310links a new perl interpreter that embeds the created bundle, then deletes
311all intermediate files.
312
313=item F<staticperl mkapp> filename args...
314
315Does the same as F<staticperl mkbundle> (in fact, it's the same as
316invoking F<staticperl mkbundle --app> filename args...), but then compiles
317and links a new standalone application that simply initialises the perl
318interpreter.
319
320The difference to F<staticperl mkperl> is that the standalone application
321does not act like a perl interpreter would - in fact, by default it would
322just do nothing and exit immediately, so you should specify some code to
323be executed via the F<--boot> option.
324
325=back
238 326
239=head3 OPTION PROCESSING 327=head3 OPTION PROCESSING
240 328
241All options can be given as arguments on the commandline (typically using 329All options can be given as arguments on the command line (typically
242long (e.g. C<--verbose>) or short option (e.g. C<-v>) style). Since 330using long (e.g. C<--verbose>) or short option (e.g. C<-v>) style). Since
243specifying a lot of modules can make the commandlien very cumbersome, 331specifying a lot of options can make the command line very long and
244you can put all long options into a "bundle specification file" (with or 332unwieldy, you can put all long options into a "bundle specification file"
245without C<--> prefix) and specify this bundle file instead. 333(one option per line, with or without C<--> prefix) and specify this
334bundle file instead.
246 335
247For example, the command given earlier could also look like this: 336For example, the command given earlier to link a new F<perl> could also
337look like this:
248 338
249 staticperl mkperl httpd.bundle 339 staticperl mkperl httpd.bundle
250 340
251And all options could be in F<httpd.bundle>: 341With all options stored in the F<httpd.bundle> file (one option per line,
252 342everything after the option is an argument):
343
253 use "Config_heavy.pl" 344 use "Config_heavy.pl"
254 use AnyEvent::Impl::Perl 345 use AnyEvent::Impl::Perl
255 use AnyEvent::HTTPD 346 use AnyEvent::HTTPD
256 use URI::http 347 use URI::http
257 add eg/httpd httpd.pm 348 add eg/httpd httpd.pm
258 349
259All options that specify modules or files to be added are processed in the 350All options that specify modules or files to be added are processed in the
260order given on the commandline (that affects the C<--use> and C<--eval> 351order given on the command line.
261options at the moment).
262 352
263=head3 MKBUNDLE OPTIONS 353=head3 BUNDLE CREATION WORKFLOW / STATICPERL MKBUNDLE OPTIONS
264 354
265=over 4 355F<staticperl mkbundle> works by first assembling a list of candidate
356files and modules to include, then filtering them by include/exclude
357patterns. The remaining modules (together with their direct dependencies,
358such as link libraries and L<AutoLoader> files) are then converted into
359bundle files suitable for embedding. F<staticperl mkbundle> can then
360optionally build a new perl interpreter or a standalone application.
266 361
362=over 4
363
364=item Step 0: Generic argument processing.
365
366The following options influence F<staticperl mkbundle> itself.
367
368=over 4
369
267=item --verbose | -v 370=item C<--verbose> | C<-v>
268 371
269Increases the verbosity level by one (the default is C<1>). 372Increases the verbosity level by one (the default is C<1>).
270 373
271=item --quiet | -q 374=item C<--quiet> | C<-q>
272 375
273Decreases the verbosity level by one. 376Decreases the verbosity level by one.
274 377
378=item any other argument
379
380Any other argument is interpreted as a bundle specification file, which
381supports all options (without extra quoting), one option per line, in the
382format C<option> or C<option argument>. They will effectively be expanded
383and processed as if they were directly written on the command line, in
384place of the file name.
385
386=back
387
388=item Step 1: gather candidate files and modules
389
390In this step, modules, perl libraries (F<.pl> files) and other files are
391selected for inclusion in the bundle. The relevant options are executed
392in order (this makes a difference mostly for C<--eval>, which can rely on
393earlier C<--use> options to have been executed).
394
395=over 4
396
397=item C<--use> F<module> | C<-M>F<module>
398
399Include the named module or perl library and trace direct
400dependencies. This is done by loading the module in a subprocess and
401tracing which other modules and files it actually loads.
402
403Example: include AnyEvent and AnyEvent::Impl::Perl.
404
405 staticperl mkbundle --use AnyEvent --use AnyEvent::Impl::Perl
406
407Sometimes you want to load old-style "perl libraries" (F<.pl> files), or
408maybe other weirdly named files. To support this, the C<--use> option
409actually tries to do what you mean, depending on the string you specify:
410
411=over 4
412
413=item a possibly valid module name, e.g. F<common::sense>, F<Carp>,
414F<Coro::Mysql>.
415
416If the string contains no quotes, no F</> and no F<.>, then C<--use>
417assumes that it is a normal module name. It will create a new package and
418evaluate a C<use module> in it, i.e. it will load the package and do a
419default import.
420
421The import step is done because many modules trigger more dependencies
422when something is imported than without.
423
424=item anything that contains F</> or F<.> characters,
425e.g. F<utf8_heavy.pl>, F<Module/private/data.pl>.
426
427The string will be quoted and passed to require, as if you used C<require
428$module>. Nothing will be imported.
429
430=item "path" or 'path', e.g. C<"utf8_heavy.pl">.
431
432If you enclose the name into single or double quotes, then the quotes will
433be removed and the resulting string will be passed to require. This syntax
434is form compatibility with older versions of staticperl and should not be
435used anymore.
436
437=back
438
439Example: C<use> AnyEvent::Socket, once using C<use> (importing the
440symbols), and once via C<require>, not importing any symbols. The first
441form is preferred as many modules load some extra dependencies when asked
442to export symbols.
443
444 staticperl mkbundle -MAnyEvent::Socket # use + import
445 staticperl mkbundle -MAnyEvent/Socket.pm # require only
446
447Example: include the required files for F<perl -V> to work in all its
448glory (F<Config.pm> is included automatically by the dependency tracker).
449
450 # shell command
451 staticperl mkbundle -MConfig_heavy.pl
452
453 # bundle specification file
454 use Config_heavy.pl
455
456The C<-M>module syntax is included as a convenience that might be easier
457to remember than C<--use> - it's the same switch as perl itself uses
458to load modules. Or maybe it confuses people. Time will tell. Or maybe
459not. Sigh.
460
461=item C<--eval> "perl code" | C<-e> "perl code"
462
463Sometimes it is easier (or necessary) to specify dependencies using perl
464code, or maybe one of the modules you use need a special use statement. In
465that case, you can use C<--eval> to execute some perl snippet or set some
466variables or whatever you need. All files C<require>'d or C<use>'d while
467executing the snippet are included in the final bundle.
468
469Keep in mind that F<mkbundle> will not import any symbols from the modules
470named by the C<--use> option, so do not expect the symbols from modules
471you C<--use>'d earlier on the command line to be available.
472
473Example: force L<AnyEvent> to detect a backend and therefore include it
474in the final bundle.
475
476 staticperl mkbundle --eval 'use AnyEvent; AnyEvent::detect'
477
478 # or like this
479 staticperl mkbundle -MAnyEvent --eval 'AnyEvent::detect'
480
481Example: use a separate "bootstrap" script that C<use>'s lots of modules
482and also include this in the final bundle, to be executed automatically
483when the interpreter is initialised.
484
485 staticperl mkbundle --eval 'do "bootstrap"' --boot bootstrap
486
487=item C<--boot> F<filename>
488
489Include the given file in the bundle and arrange for it to be
490executed (using C<require>) before the main program when the new perl
491is initialised. This can be used to modify C<@INC> or do similar
492modifications before the perl interpreter executes scripts given on the
493command line (or via C<-e>). This works even in an embedded interpreter -
494the file will be executed during interpreter initialisation in that case.
495
496=item C<--incglob> pattern
497
498This goes through all standard library directories and tries to match any
499F<.pm> and F<.pl> files against the extended glob pattern (see below). If
500a file matches, it is added. The pattern is matched against the full path
501of the file (sans the library directory prefix), e.g. F<Sys/Syslog.pm>.
502
503This is very useful to include "everything":
504
505 --incglob '*'
506
507It is also useful for including perl libraries, or trees of those, such as
508the unicode database files needed by some perl built-ins, the regex engine
509and other modules.
510
511 --incglob '/unicore/**.pl'
512
513=item C<--add> F<file> | C<--add> "F<file> alias"
514
515Adds the given (perl) file into the bundle (and optionally call it
516"alias"). The F<file> is either an absolute path or a path relative to the
517current directory. If an alias is specified, then this is the name it will
518use for C<@INC> searches, otherwise the path F<file> will be used as the
519internal name.
520
521This switch is used to include extra files into the bundle.
522
523Example: embed the file F<httpd> in the current directory as F<httpd.pm>
524when creating the bundle.
525
526 staticperl mkperl --add "httpd httpd.pm"
527
528 # can be accessed via "use httpd"
529
530Example: add a file F<initcode> from the current directory.
531
532 staticperl mkperl --add 'initcode &initcode'
533
534 # can be accessed via "do '&initcode'"
535
536Example: add local files as extra modules in the bundle.
537
538 # specification file
539 add file1 myfiles/file1.pm
540 add file2 myfiles/file2.pm
541 add file3 myfiles/file3.pl
542
543 # then later, in perl, use
544 use myfiles::file1;
545 require myfiles::file2;
546 my $res = do "myfiles/file3.pl";
547
548=item C<--binadd> F<file> | C<--binadd> "F<file> alias"
549
550Just like C<--add>, except that it treats the file as binary and adds it
551without any postprocessing (perl files might get stripped to reduce their
552size).
553
554If you specify an alias you should probably add a C</> prefix to avoid
555clashing with embedded perl files (whose paths never start with C</>),
556and/or use a special directory prefix, such as C</res/name>.
557
558You can later get a copy of these files by calling C<static::find
559"alias">.
560
561An alternative way to embed binary files is to convert them to perl and
562use C<do> to get the contents - this method is a bit cumbersome, but works
563both inside and outside of a staticperl bundle, without extra ado:
564
565 # a "binary" file, call it "bindata.pl"
566 <<'SOME_MARKER'
567 binary data NOT containing SOME_MARKER
568 SOME_MARKER
569
570 # load the binary
571 chomp (my $data = do "bindata.pl");
572
573=item C<--allow-dynamic>
574
575By default, when F<mkbundle> hits a dynamic perl extension (e.g. a F<.so>
576or F<.dll> file), it will stop with a fatal error.
577
578When this option is enabled, F<mkbundle> packages the shared
579object into the bundle instead, with a prefix of F<!>
580(e.g. F<!auto/List/Util/Util.so>). What you do with that is currently up
581to you, F<staticperl> has no special support for this at the moment, apart
582from working around the lack of availability of F<PerlIO::scalar> while
583bootstrapping, at a speed cost.
584
585One way to deal with this is to write all files starting with F<!> into
586some directory and then C<unshift> that path onto C<@INC>.
587
588#TODO: example
589
590=back
591
592=item Step 2: filter all files using C<--include> and C<--exclude> options.
593
594After all candidate files and modules are added, they are I<filtered>
595by a combination of C<--include> and C<--exclude> patterns (there is an
596implicit C<--include *> at the end, so if no filters are specified, all
597files are included).
598
599All that this step does is potentially reduce the number of files that are
600to be included - no new files are added during this step.
601
602=over 4
603
604=item C<--include> pattern | C<-i> pattern | C<--exclude> pattern | C<-x> pattern
605
606These specify an include or exclude pattern to be applied to the candidate
607file list. An include makes sure that the given files will be part of the
608resulting file set, an exclude will exclude remaining files. The patterns
609are "extended glob patterns" (see below).
610
611The patterns are applied "in order" - files included via earlier
612C<--include> specifications cannot be removed by any following
613C<--exclude>, and likewise, and file excluded by an earlier C<--exclude>
614cannot be added by any following C<--include>.
615
616For example, to include everything except C<Devel> modules, but still
617include F<Devel::PPPort>, you could use this:
618
619 --incglob '*' -i '/Devel/PPPort.pm' -x '/Devel/**'
620
621=back
622
623=item Step 3: add any extra or "hidden" dependencies.
624
625F<staticperl> currently knows about three extra types of depdendencies
626that are added automatically. Only one (F<.packlist> files) is currently
627optional and can be influenced, the others are always included:
628
629=over 4
630
631=item C<--usepacklists>
632
633Read F<.packlist> files for each distribution that happens to match a
634module name you specified. Sounds weird, and it is, so expect semantics to
635change somehow in the future.
636
637The idea is that most CPAN distributions have a F<.pm> file that matches
638the name of the distribution (which is rather reasonable after all).
639
640If this switch is enabled, then if any of the F<.pm> files that have been
641selected match an install distribution, then all F<.pm>, F<.pl>, F<.al>
642and F<.ix> files installed by this distribution are also included.
643
644For example, using this switch, when the L<URI> module is specified, then
645all L<URI> submodules that have been installed via the CPAN distribution
646are included as well, so you don't have to manually specify them.
647
648=item L<AutoLoader> splitfiles
649
650Some modules use L<AutoLoader> - less commonly (hopefully) used functions
651are split into separate F<.al> files, and an index (F<.ix>) file contains
652the prototypes.
653
654Both F<.ix> and F<.al> files will be detected automatically and added to
655the bundle.
656
657=item link libraries (F<.a> files)
658
659Modules using XS (or any other non-perl language extension compiled at
660installation time) will have a static archive (typically F<.a>). These
661will automatically be added to the linker options in F<bundle.ldopts>.
662
663Should F<staticperl> find a dynamic link library (typically F<.so>) it
664will warn about it - obviously this shouldn't happen unless you use
665F<staticperl> on the wrong perl, or one (probably wrongly) configured to
666use dynamic loading.
667
668=item extra libraries (F<extralibs.ld>)
669
670Some modules need linking against external libraries - these are found in
671F<extralibs.ld> and added to F<bundle.ldopts>.
672
673=back
674
675=item Step 4: write bundle files and optionally link a program
676
677At this point, the select files will be read, processed (stripped) and
678finally the bundle files get written to disk, and F<staticperl mkbundle>
679is normally finished. Optionally, it can go a step further and either link
680a new F<perl> binary with all selected modules and files inside, or build
681a standalone application.
682
683Both the contents of the bundle files and any extra linking is controlled
684by these options:
685
686=over 4
687
275=item --strip none|pod|ppi 688=item C<--strip> C<none>|C<pod>|C<ppi>
276 689
277Specify the stripping method applied to reduce the file of the perl 690Specify the stripping method applied to reduce the file of the perl
278sources included. 691sources included.
279 692
280The default is C<pod>, which uses the L<Pod::Strip> module to remove all 693The default is C<pod>, which uses the L<Pod::Strip> module to remove all
281pod documenatiton, which is very fast and reduces filesize a lot. 694pod documentation, which is very fast and reduces file size a lot.
282 695
283The C<ppi> method uses L<PPI> to parse and condense the perl sources. This 696The C<ppi> method uses L<PPI> to parse and condense the perl sources. This
284saves a lot more than just L<Pod::Strip>, and is generally safer, but is 697saves a lot more than just L<Pod::Strip>, and is generally safer,
285also a lot slower, so is best used for production builds. 698but is also a lot slower (some files take almost a minute to strip -
699F<staticperl> maintains a cache of stripped files to speed up subsequent
700runs for this reason). Note that this method doesn't optimise for raw file
701size, but for best compression (that means that the uncompressed file size
702is a bit larger, but the files compress better, e.g. with F<upx>).
286 703
704Last not least, if you need accurate line numbers in error messages,
287Last not least, in the unlikely case where C<pod> is too slow, or some 705or in the unlikely case where C<pod> is too slow, or some module gets
288module gets mistreated, you can specify C<none> to not mangle included 706mistreated, you can specify C<none> to not mangle included perl sources in
289perl sources in any way. 707any way.
290 708
291=item --perl 709=item C<--perl>
292 710
293After writing out the bundle files, try to link a new perl interpreter. It 711After writing out the bundle files, try to link a new perl interpreter. It
294will be called F<perl> and will be left in the current working 712will be called F<perl> and will be left in the current working
295directory. The bundle files will be removed. 713directory. The bundle files will be removed.
296 714
297This switch is automatically ued when F<staticperl> is invoked with the 715This switch is automatically used when F<staticperl> is invoked with the
298C<mkperl> command (instead of C<mkbundle>): 716C<mkperl> command instead of C<mkbundle>.
299 717
300 # build a new ./perl with only common::sense in it - very small :) 718Example: build a new F<./perl> binary with only L<common::sense> inside -
719it will be even smaller than the standard perl interpreter as none of the
720modules of the base distribution (such as L<Fcntl>) will be included.
721
301 staticperl mkperl -Mcommon::sense 722 staticperl mkperl -Mcommon::sense
302 723
303=item --use module | -Mmodule 724=item C<--app> F<name>
304 725
305Include the named module and all direct dependencies. This is done by 726After writing out the bundle files, try to link a new standalone
306C<require>'ing the module in a subprocess and tracing which other modules 727program. It will be called C<name>, and the bundle files get removed after
307and files it actually loads. If the module uses L<AutoLoader>, then all 728linking it.
308splitfiles will be included as well.
309 729
310Example: include AnyEvent and AnyEvent::Impl::Perl. 730This switch is automatically used when F<staticperl> is invoked with the
731C<mkapp> command instead of C<mkbundle>.
311 732
312 staticperl mkbundle --use AnyEvent --use AnyEvent::Impl::Perl 733The difference to the (mutually exclusive) C<--perl> option is that the
734binary created by this option will not try to act as a perl interpreter -
735instead it will simply initialise the perl interpreter, clean it up and
736exit.
313 737
314Sometimes you want to load old-style "perl libraries" (F<.pl> files), or 738This means that, by default, it will do nothing but burn a few CPU cycles
315maybe other weirdly named files. To do that, you need to quote the name in 739- for it to do something useful you I<must> add some boot code, e.g. with
316single or double quoutes. When given on the commandline, you probably need 740the C<--boot> option.
317to quote once more to avoid your shell interpreting it. Common cases that
318need this are F<Config_heavy.pl> and F<utf8_heavy.pl>.
319 741
320Example: include the required files for F<perl -V> to work in all its 742Example: create a standalone perl binary called F<./myexe> that will
321glory (F<Config.pm> is included automatically by this). 743execute F<appfile> when it is started.
322 744
323 # bourne shell 745 staticperl mkbundle --app myexe --boot appfile
324 staticperl mkbundle --use '"Config_heavy.pl"'
325 746
326 # bundle specification file 747=item C<--ignore-env>
327 use "Config_heavy.pl"
328 748
329The C<-Mmodule> syntax is included as an alias that might be easier to 749Generates extra code to unset some environment variables before
330remember than C<use>. Or maybe it confuses people. Time will tell. Or 750initialising/running perl. Perl supports a lot of environment variables
331maybe not. Argh. 751that might alter execution in ways that might be undesirablre for
752standalone applications, and this option removes those known to cause
753trouble.
332 754
333=item --eval "perl code" | -e "perl code" 755Specifically, these are removed:
334 756
335Sometimes it is easier (or necessary) to specify dependencies using perl 757C<PERL_HASH_SEED_DEBUG> and C<PERL_DEBUG_MSTATS> can cause undesirable
336code, or maybe one of the modules you use need a special use statement. In 758output, C<PERL5OPT>, C<PERL_DESTRUCT_LEVEL>, C<PERL_HASH_SEED> and
337that case, you can use C<eval> to execute some perl snippet or set some 759C<PERL_SIGNALS> can alter execution significantly, and C<PERL_UNICODE>,
338variables or whatever you need. All files C<require>'d or C<use>'d in the 760C<PERLIO_DEBUG> and C<PERLIO> can affect input and output.
339script are included in the final bundle.
340 761
341Keep in mind that F<mkbundle> will only C<require> the modules named 762The variables C<PERL_LIB> and C<PERL5_LIB> are always ignored because the
342by the C<--use> option, so do not expect the symbols from modules you 763startup code used by F<staticperl> overrides C<@INC> in all cases.
343C<--use>'d earlier on the commandlien to be available.
344 764
345Example: force L<AnyEvent> to detect a backend and therefore include it 765This option will not make your program more secure (unless you are
346in the final bundle. 766running with elevated privileges), but it will reduce the surprise effect
767when a user has these environment variables set and doesn't expect your
768standalone program to act like a perl interpreter.
347 769
348 staticperl mkbundle --eval 'use AnyEvent; AnyEvent::detect'
349
350 # or like this
351 staticperl mkbundle -MAnyEvent --eval 'use AnyEvent; AnyEvent::detect'
352
353Example: use a separate "bootstrap" script that C<use>'s lots of modules
354and include this in the final bundle, to be executed automatically.
355
356 staticperl mkbundle --eval 'do "bootstrap"' --boot bootstrap
357
358=item --boot filename
359
360Include the given file in the bundle and arrange for it to be executed
361(using a C<require>) before anything else when the new perl is
362initialised. This can be used to modify C<@INC> or anything else before
363the perl interpreter executes scripts given on the commandline (or via
364C<-e>). This works even in an embedded interpreter.
365
366=item --add "file" | --add "file alias"
367
368Adds the given (perl) file into the bundle (and optionally call it
369"alias"). This is useful to include any custom files into the bundle.
370
371Example: embed the file F<httpd> as F<httpd.pm> when creating the bundle.
372
373 staticperl mkperl --add "httpd httpd.pm"
374
375It is also a great way to add any custom modules:
376
377 # specification file
378 add file1 myfiles/file1
379 add file2 myfiles/file2
380 add file3 myfiles/file3
381
382=item --static 770=item C<--static>
383 771
384When C<--perl> is also given, link statically instead of dynamically. The 772Add C<-static> to F<bundle.ldopts>, which means a fully static (if
773supported by the OS) executable will be created. This is not immensely
774useful when just creating the bundle files, but is most useful when
775linking a binary with the C<--perl> or C<--app> options.
776
385default is to link the new perl interpreter fully dynamic (that means all 777The default is to link the new binary dynamically (that means all perl
386perl modules are linked statically, but all external libraries are still 778modules are linked statically, but all external libraries are still
387referenced dynamically). 779referenced dynamically).
388 780
389Keep in mind that Solaris doesn't support static linking at all, and 781Keep in mind that Solaris doesn't support static linking at all, and
390systems based on GNU libc don't really support it in a usable fashion 782systems based on GNU libc don't really support it in a very usable
391either. Try uClibc if you want to create fully statically linked 783fashion either. Try uClibc if you want to create fully statically linked
392executables, or try the C<--staticlibs> option to link only some libraries 784executables, or try the C<--staticlib> option to link only some libraries
393statically. 785statically.
394 786
395=item any other argument 787=item C<--staticlib> libname
396 788
397Any other argument is interpreted as a bundle specification file, which 789When not linking fully statically, this option allows you to link specific
398supports most long options (without extra quoting), one option per line. 790libraries statically. What it does is simply replace all occurrences of
791C<-llibname> with the GCC-specific C<-Wl,-Bstatic -llibname -Wl,-Bdynamic>
792option.
399 793
400=back 794This will have no effect unless the library is actually linked against,
795specifically, C<--staticlib> will not link against the named library
796unless it would be linked against anyway.
401 797
798Example: link libcrypt statically into the final binary.
799
800 staticperl mkperl -MIO::AIO --staticlib crypt
801
802 # ldopts might now contain:
803 # -lm -Wl,-Bstatic -lcrypt -Wl,-Bdynamic -lpthread
804
805=back
806
807=back
808
809=head3 EXTENDED GLOB PATTERNS
810
811Some options of F<staticperl mkbundle> expect an I<extended glob
812pattern>. This is neither a normal shell glob nor a regex, but something
813in between. The idea has been copied from rsync, and there are the current
814matching rules:
815
816=over 4
817
818=item Patterns starting with F</> will be a anchored at the root of the library tree.
819
820That is, F</unicore> will match the F<unicore> directory in C<@INC>, but
821nothing inside, and neither any other file or directory called F<unicore>
822anywhere else in the hierarchy.
823
824=item Patterns not starting with F</> will be anchored at the end of the path.
825
826That is, F<idna.pl> will match any file called F<idna.pl> anywhere in the
827hierarchy, but not any directories of the same name.
828
829=item A F<*> matches anything within a single path component.
830
831That is, F</unicore/*.pl> would match all F<.pl> files directly inside
832C</unicore>, not any deeper level F<.pl> files. Or in other words, F<*>
833will not match slashes.
834
835=item A F<**> matches anything.
836
837That is, F</unicore/**.pl> would match all F<.pl> files under F</unicore>,
838no matter how deeply nested they are inside subdirectories.
839
840=item A F<?> matches a single character within a component.
841
842That is, F</Encode/??.pm> matches F</Encode/JP.pm>, but not the
843hypothetical F</Encode/J/.pm>, as F<?> does not match F</>.
844
845=back
846
402=head2 F<STATCPERL> CONFIGURATION AND HOOKS 847=head2 F<STATICPERL> CONFIGURATION AND HOOKS
403 848
404During (each) startup, F<staticperl> tries to source the following shell 849During (each) startup, F<staticperl> tries to source some shell files to
850allow you to fine-tune/override configuration settings.
851
852In them you can override shell variables, or define shell functions
853("hooks") to be called at specific phases during installation. For
854example, you could define a C<postinstall> hook to install additional
855modules from CPAN each time you start from scratch.
856
857If the env variable C<$STATICPERLRC> is set, then F<staticperl> will try
858to source the file named with it only. Otherwise, it tries the following
405files in order: 859shell files in order:
406 860
407 /etc/staticperlrc 861 /etc/staticperlrc
408 ~/.staticperlrc 862 ~/.staticperlrc
409 $STATICPERL/rc 863 $STATICPERL/rc
410 864
411They can be used to override shell variables, or define functions to be
412called at specific phases.
413
414Note that the last file is erased during F<staticperl distclean>, so 865Note that the last file is erased during F<staticperl distclean>, so
415generally should not be used. 866generally should not be used.
416 867
417=head3 CONFIGURATION VARIABLES 868=head3 CONFIGURATION VARIABLES
418 869
423=item C<EMAIL> 874=item C<EMAIL>
424 875
425The e-mail address of the person who built this binary. Has no good 876The e-mail address of the person who built this binary. Has no good
426default, so should be specified by you. 877default, so should be specified by you.
427 878
428=back
429
430=head4 Variables you I<might want> to override
431
432=over 4
433
434=item C<PERLVER>
435
436The perl version to install - default is currently C<5.12.2>, but C<5.8.9>
437is also a good choice (5.8.9 is much smaller than 5.12.2, while 5.10.1 is
438about as big as 5.12.2).
439
440=item C<CPAN> 879=item C<CPAN>
441 880
442The URL of the CPAN mirror to use (e.g. L<http://mirror.netcologne.de/cpan/>). 881The URL of the CPAN mirror to use (e.g. L<http://mirror.netcologne.de/cpan/>).
443 882
883=item C<EXTRA_MODULES>
884
885Additional modules installed during F<staticperl install>. Here you can
886set which modules you want have to installed from CPAN.
887
888Example: I really really need EV, AnyEvent, Coro and AnyEvent::AIO.
889
890 EXTRA_MODULES="EV AnyEvent Coro AnyEvent::AIO"
891
892Note that you can also use a C<postinstall> hook to achieve this, and
893more.
894
895=back
896
897=head4 Variables you might I<want> to override
898
899=over 4
900
901=item C<STATICPERL>
902
903The directory where staticperl stores all its files
904(default: F<~/.staticperl>).
905
906=item C<DLCACHE>
907
908The path to a directory (will be created if it doesn't exist) where
909downloaded perl sources are being cached, to avoid downloading them
910again. The default is empty, which means there is no cache.
911
912=item C<PERL_VERSION>
913
914The perl version to install - default is currently C<5.12.3>, but C<5.8.9>
915is also a good choice (5.8.9 is much smaller than 5.12.3, while 5.10.1 is
916about as big as 5.12.3).
917
918=item C<PERL_MM_USE_DEFAULT>, C<EV_EXTRA_DEFS>, ...
919
920Usually set to C<1> to make modules "less inquisitive" during their
921installation. You can set (and export!) any environment variable you want
922- some modules (such as L<Coro> or L<EV>) use environment variables for
923further tweaking.
924
925=item C<PERL_PREFIX>
926
927The directory where perl gets installed (default: F<$STATICPERL/perl>),
928i.e. where the F<bin> and F<lib> subdirectories will end up. Previous
929contents will be removed on installation.
930
931=item C<PERL_CONFIGURE>
932
933Additional Configure options - these are simply passed to the perl
934Configure script. For example, if you wanted to enable dynamic loading,
935you could pass C<-Dusedl>. To enable ithreads (Why would you want that
936insanity? Don't! Use L<forks> instead!) you would pass C<-Duseithreads>
937and so on.
938
939More commonly, you would either activate 64 bit integer support
940(C<-Duse64bitint>), or disable large files support (-Uuselargefiles), to
941reduce filesize further.
942
444=item C<PERL_CPPFLAGS>, C<PERL_OPTIMIZE>, C<PERL_LDFLAGS>, C<PERL_LIBS> 943=item C<PERL_CC>, C<PERL_CCFLAGS>, C<PERL_OPTIMIZE>, C<PERL_LDFLAGS>, C<PERL_LIBS>
445 944
446These flags are passed to perl's F<Configure> script, and are generally 945These flags are passed to perl's F<Configure> script, and are generally
447optimised for small size (at the cost of performance). Since they also 946optimised for small size (at the cost of performance). Since they also
448contain subtle workarounds around various build issues, changing these 947contain subtle workarounds around various build issues, changing these
449usually requires understanding their default values - best look at the top 948usually requires understanding their default values - best look at
450of the F<staticperl> script for more info on these. 949the top of the F<staticperl> script for more info on these, and use a
950F<~/.staticperlrc> to override them.
451 951
452=item C<STATICPERL> 952Most of the variables override (or modify) the corresponding F<Configure>
953variable, except C<PERL_CCFLAGS>, which gets appended.
453 954
454The directory where staticperl stores all its files 955The default for C<PERL_OPTIMIZE> is C<-Os> (assuming gcc), and for
455(default: F<~/.staticperl>). 956C<PERL_LIBS> is C<-lm -lcrypt>, which should be good for most (but not
957all) systems.
456 958
457=item C<PREFIX> 959For other compilers or more customised optimisation settings, you need to
960adjust these, e.g. in your F<~/.staticperlrc>.
458 961
459The prefix where perl get's installed (default: F<$STATICPERL/perl>), 962With gcc on x86 and amd64, you can get more space-savings by using:
460i.e. where the F<bin> and F<lib> subdirectories will end up.
461 963
462=item C<PERL_MM_USE_DEFAULT>, C<EV_EXTRA_DEFS>, others 964 -Os -ffunction-sections -fdata-sections -finline-limit=8 -mpush-args
965 -mno-inline-stringops-dynamically -mno-align-stringops
463 966
464Usually set to C<1> to make modules "less inquisitive" during their 967And on x86 and pentium3 and newer (basically everything you might ever
465installation, you can set any environment variable you want - some modules 968want to run on), adding these is even better for space-savings (use
466(such as L<Coro> or L<EV>) use environment variables for further tweaking. 969-mtune=core2 or something newer for much faster code, too):
467 970
468=item C<EXTRA_MODULES> 971 -fomit-frame-pointer -march=pentium3 -mtune=i386
469 972
470Additional modules installed during F<staticperl install>. Here you can
471set which modules you want have to installed from CPAN.
472
473Example: I really really need EV, AnyEvent, Coro and IO::AIO.
474
475 EXTRA_MODULES="EV AnyEvent Coro IO::AIO"
476
477Note that you cna also use a C<postinstall> hook to achieve this, and
478more.
479
480=back 973=back
481 974
482=head4 Variables you I<probably do not want> to override 975=head4 Variables you probably I<do not want> to override
483 976
484=over 4 977=over 4
978
979=item C<MAKE>
980
981The make command to use - default is C<make>.
485 982
486=item C<MKBUNDLE> 983=item C<MKBUNDLE>
487 984
488Where F<staticperl> writes the C<mkbundle> command to 985Where F<staticperl> writes the C<mkbundle> command to
489(default: F<$STATICPERL/mkbundle>). 986(default: F<$STATICPERL/mkbundle>).
497 994
498=head3 OVERRIDABLE HOOKS 995=head3 OVERRIDABLE HOOKS
499 996
500In addition to environment variables, it is possible to provide some 997In addition to environment variables, it is possible to provide some
501shell functions that are called at specific times. To provide your own 998shell functions that are called at specific times. To provide your own
502commands, justd efine the corresponding function. 999commands, just define the corresponding function.
1000
1001The actual order in which hooks are invoked during a full install
1002from scratch is C<preconfigure>, C<patchconfig>, C<postconfigure>,
1003C<postbuild>, C<postinstall>.
503 1004
504Example: install extra modules from CPAN and from some directories 1005Example: install extra modules from CPAN and from some directories
505at F<staticperl install> time. 1006at F<staticperl install> time.
506 1007
507 postinstall() { 1008 postinstall() {
508 rm -rf lib/threads.* # weg mit Schaden 1009 rm -rf lib/threads* # weg mit Schaden
509 instcpan IO::AIO EV 1010 instcpan IO::AIO EV
510 instsrc ~/src/AnyEvent 1011 instsrc ~/src/AnyEvent
511 instsrc ~/src/XML-Sablotron-1.0100001 1012 instsrc ~/src/XML-Sablotron-1.0100001
512 instcpan AnyEvent::HTTPD 1013 instcpan Anyevent::AIO AnyEvent::HTTPD
513 } 1014 }
514 1015
515=over 4 1016=over 4
1017
1018=item preconfigure
1019
1020Called just before running F<./Configure> in the perl source
1021directory. Current working directory is the perl source directory.
1022
1023This can be used to set any C<PERL_xxx> variables, which might be costly
1024to compute.
1025
1026=item patchconfig
1027
1028Called after running F<./Configure> in the perl source directory to create
1029F<./config.sh>, but before running F<./Configure -S> to actually apply the
1030config. Current working directory is the perl source directory.
1031
1032Can be used to tailor/patch F<config.sh> or do any other modifications.
516 1033
517=item postconfigure 1034=item postconfigure
518 1035
519Called after configuring, but before building perl. Current working 1036Called after configuring, but before building perl. Current working
520directory is the perl source directory. 1037directory is the perl source directory.
521 1038
522Could be used to tailor/patch config.sh (followed by F<./Configure -S>) or
523do any other modifications.
524
525=item postbuild 1039=item postbuild
526 1040
527Called after building, but before installing perl. Current working 1041Called after building, but before installing perl. Current working
528directory is the perl source directory. 1042directory is the perl source directory.
529 1043
543The script must return with a zero exit status, or the installation will 1057The script must return with a zero exit status, or the installation will
544fail. 1058fail.
545 1059
546=back 1060=back
547 1061
1062=head1 ANATOMY OF A BUNDLE
1063
1064When not building a new perl binary, C<mkbundle> will leave a number of
1065files in the current working directory, which can be used to embed a perl
1066interpreter in your program.
1067
1068Intimate knowledge of L<perlembed> and preferably some experience with
1069embedding perl is highly recommended.
1070
1071C<mkperl> (or the C<--perl> option) basically does this to link the new
1072interpreter (it also adds a main program to F<bundle.>):
1073
1074 $Config{cc} $(cat bundle.ccopts) -o perl bundle.c $(cat bundle.ldopts)
1075
1076=over 4
1077
1078=item bundle.h
1079
1080A header file that contains the prototypes of the few symbols "exported"
1081by bundle.c, and also exposes the perl headers to the application.
1082
1083=over 4
1084
1085=item staticperl_init (xs_init = 0)
1086
1087Initialises the perl interpreter. You can use the normal perl functions
1088after calling this function, for example, to define extra functions or
1089to load a .pm file that contains some initialisation code, or the main
1090program function:
1091
1092 XS (xsfunction)
1093 {
1094 dXSARGS;
1095
1096 // now we have items, ST(i) etc.
1097 }
1098
1099 static void
1100 run_myapp(void)
1101 {
1102 staticperl_init (0);
1103 newXSproto ("myapp::xsfunction", xsfunction, __FILE__, "$$;$");
1104 eval_pv ("require myapp::main", 1); // executes "myapp/main.pm"
1105 }
1106
1107When your bootcode already wants to access some XS functions at
1108compiletime, then you need to supply an C<xs_init> function pointer that
1109is called as soon as perl is initialised enough to define XS functions,
1110but before the preamble code is executed:
1111
1112 static void
1113 xs_init (pTHX)
1114 {
1115 newXSproto ("myapp::xsfunction", xsfunction, __FILE__, "$$;$");
1116 }
1117
1118 static void
1119 run_myapp(void)
1120 {
1121 staticperl_init (xs_init);
1122 }
1123
1124=item staticperl_cleanup ()
1125
1126In the unlikely case that you want to destroy the perl interpreter, here
1127is the corresponding function.
1128
1129=item staticperl_xs_init (pTHX)
1130
1131Sometimes you need direct control over C<perl_parse> and C<perl_run>, in
1132which case you do not want to use C<staticperl_init> but call them on your
1133own.
1134
1135Then you need this function - either pass it directly as the C<xs_init>
1136function to C<perl_parse>, or call it as one of the first things from your
1137own C<xs_init> function.
1138
1139=item PerlInterpreter *staticperl
1140
1141The perl interpreter pointer used by staticperl. Not normally so useful,
1142but there it is.
1143
1144=back
1145
1146=item bundle.ccopts
1147
1148Contains the compiler options required to compile at least F<bundle.c> and
1149any file that includes F<bundle.h> - you should probably use it in your
1150C<CFLAGS>.
1151
1152=item bundle.ldopts
1153
1154The linker options needed to link the final program.
1155
1156=back
1157
1158=head1 RUNTIME FUNCTIONALITY
1159
1160Binaries created with C<mkbundle>/C<mkperl> contain extra functionality,
1161mostly related to the extra files bundled in the binary (the virtual
1162filesystem). All of this data is statically compiled into the binary, and
1163accessing means copying it from a read-only section of your binary. Data
1164pages in this way is usually freed by the operating system, as it isn't
1165use more the onace.
1166
1167=head2 VIRTUAL FILESYSTEM
1168
1169Every bundle has a virtual filesystem. The only information stored in it
1170is the path and contents of each file that was bundled.
1171
1172=head3 LAYOUT
1173
1174Any path starting with an ampersand (F<&>) or exclamation mark (F<!>) are
1175reserved by F<staticperl>. They must only be used as described in this
1176section.
1177
1178=over 4
1179
1180=item !
1181
1182All files that typically cannot be loaded from memory (such as dynamic
1183objects or shared libraries), but have to reside in the filesystem, are
1184prefixed with F<!>. Typically these files get written out to some
1185(semi-)temporary directory shortly after program startup, or before being
1186used.
1187
1188=item !boot
1189
1190The bootstrap file, if specified during bundling.
1191
1192=item !auto/
1193
1194Shared objects or dlls corresponding to dynamically-linked perl extensions
1195are stored with an F<!auto/> prefix.
1196
1197=item !lib/
1198
1199External shared libraries are stored in this directory.
1200
1201=item any letter
1202
1203Any path starting with a letter is a perl library file. For example,
1204F<Coro/AIO.pm> corresponds to the file loaded by C<use Coro::AIO>, and
1205F<Coro/jit.pl> corresponds to C<require "Coro/jit.pl">.
1206
1207Obviously, module names shouldn't start with any other characters than
1208letters :)
1209
1210=back
1211
1212=head3 FUNCTIONS
1213
1214=over 4
1215
1216=item $file = static::find $path
1217
1218Returns the data associated with the given C<$path>
1219(e.g. C<Digest/MD5.pm>, C<auto/POSIX/autosplit.ix>).
1220
1221Returns C<undef> if the file isn't embedded.
1222
1223=item @paths = static::list
1224
1225Returns the list of all paths embedded in this binary.
1226
1227=back
1228
1229=head2 EXTRA FEATURES
1230
1231In addition, for the embedded loading of perl files to work, F<staticperl>
1232overrides the C<@INC> array.
1233
1234=head1 FULLY STATIC BINARIES - UCLIBC AND BUILDROOT
1235
1236To make truly static (Linux-) libraries, you might want to have a look at
1237buildroot (L<http://buildroot.uclibc.org/>).
1238
1239Buildroot is primarily meant to set up a cross-compile environment (which
1240is not so useful as perl doesn't quite like cross compiles), but it can also compile
1241a chroot environment where you can use F<staticperl>.
1242
1243To do so, download buildroot, and enable "Build options => development
1244files in target filesystem" and optionally "Build options => gcc
1245optimization level (optimize for size)". At the time of writing, I had
1246good experiences with GCC 4.4.x but not GCC 4.5.
1247
1248To minimise code size, I used C<-pipe -ffunction-sections -fdata-sections
1249-finline-limit=8 -fno-builtin-strlen -mtune=i386>. The C<-mtune=i386>
1250doesn't decrease codesize much, but it makes the file much more
1251compressible (and the execution a lot slower...).
1252
1253If you don't need Coro or threads, you can go with "linuxthreads.old" (or
1254no thread support). For Coro, it is highly recommended to switch to a
1255uClibc newer than 0.9.31 (at the time of this writing, I used the 20101201
1256snapshot) and enable NPTL, otherwise Coro needs to be configured with the
1257ultra-slow pthreads backend to work around linuxthreads bugs (it also uses
1258twice the address space needed for stacks).
1259
1260If you use C<linuxthreads.old>, then you should also be aware that
1261uClibc shares C<errno> between all threads when statically linking. See
1262L<http://lists.uclibc.org/pipermail/uclibc/2010-June/044157.html> for a
1263workaround (and L<https://bugs.uclibc.org/2089> for discussion).
1264
1265C<ccache> support is also recommended, especially if you want
1266to play around with buildroot options. Enabling the C<miniperl>
1267package will probably enable all options required for a successful
1268perl build. F<staticperl> itself additionally needs either C<wget>
1269(recommended, for CPAN) or C<curl>.
1270
1271As for shells, busybox should provide all that is needed, but the default
1272busybox configuration doesn't include F<comm> which is needed by perl -
1273either make a custom busybox config, or compile coreutils.
1274
1275For the latter route, you might find that bash has some bugs that keep
1276it from working properly in a chroot - either use dash (and link it to
1277F</bin/sh> inside the chroot) or link busybox to F</bin/sh>, using it's
1278built-in ash shell.
1279
1280Finally, you need F</dev/null> inside the chroot for many scripts to work
1281- either F<cp /dev/null output/target/dev> or bind-mounting your F</dev>
1282will provide this.
1283
1284After you have compiled and set up your buildroot target, you can copy
1285F<staticperl> from the C<App::Staticperl> distribution or from your
1286perl F<bin> directory (if you installed it) into the F<output/target>
1287filesystem, chroot inside and run it.
1288
1289=head1 RECIPES / SPECIFIC MODULES
1290
1291This section contains some common(?) recipes and information about
1292problems with some common modules or perl constructs that require extra
1293files to be included.
1294
1295=head2 MODULES
1296
1297=over 4
1298
1299=item utf8
1300
1301Some functionality in the utf8 module, such as swash handling (used
1302for unicode character ranges in regexes) is implemented in the
1303C<"utf8_heavy.pl"> library:
1304
1305 -Mutf8_heavy.pl
1306
1307Many Unicode properties in turn are defined in separate modules,
1308such as C<"unicore/Heavy.pl"> and more specific data tables such as
1309C<"unicore/To/Digit.pl"> or C<"unicore/lib/Perl/Word.pl">. These tables
1310are big (7MB uncompressed, although F<staticperl> contains special
1311handling for those files), so including them on demand by your application
1312only might pay off.
1313
1314To simply include the whole unicode database, use:
1315
1316 --incglob '/unicore/**.pl'
1317
1318=item AnyEvent
1319
1320AnyEvent needs a backend implementation that it will load in a delayed
1321fashion. The L<AnyEvent::Impl::Perl> backend is the default choice
1322for AnyEvent if it can't find anything else, and is usually a safe
1323fallback. If you plan to use e.g. L<EV> (L<POE>...), then you need to
1324include the L<AnyEvent::Impl::EV> (L<AnyEvent::Impl::POE>...) backend as
1325well.
1326
1327If you want to handle IRIs or IDNs (L<AnyEvent::Util> punycode and idn
1328functions), you also need to include C<"AnyEvent/Util/idna.pl"> and
1329C<"AnyEvent/Util/uts46data.pl">.
1330
1331Or you can use C<--usepacklists> and specify C<-MAnyEvent> to include
1332everything.
1333
1334=item Cairo
1335
1336See Glib, same problem, same solution.
1337
1338=item Carp
1339
1340Carp had (in older versions of perl) a dependency on L<Carp::Heavy>. As of
1341perl 5.12.2 (maybe earlier), this dependency no longer exists.
1342
1343=item Config
1344
1345The F<perl -V> switch (as well as many modules) needs L<Config>, which in
1346turn might need L<"Config_heavy.pl">. Including the latter gives you
1347both.
1348
1349=item Glib
1350
1351Glib literally requires Glib to be installed already to build - it tries
1352to fake this by running Glib out of the build directory before being
1353built. F<staticperl> tries to work around this by forcing C<MAN1PODS> and
1354C<MAN3PODS> to be empty via the C<PERL_MM_OPT> environment variable.
1355
1356=item Gtk2
1357
1358See Pango, same problems, same solution.
1359
1360=item Net::SSLeay
1361
1362This module hasn't been significantly updated since OpenSSL is called
1363OpenSSL, and fails to properly link against dependent libraries, most
1364commonly, it forgets to specify -ldl when linking.
1365
1366On GNU/Linux systems this usually goes undetected, as perl usually links
1367against -ldl itself and OpenSSL just happens to pick it up that way, by
1368chance.
1369
1370For static builds, you either have to configure -ldl manually, or you
1371cna use the following snippet in your C<postinstall> hook which patches
1372Net::SSLeay after installation, which happens to work most of the time:
1373
1374 postinstall() {
1375 # first install it
1376 instcpan Net::SSLeay
1377 # then add -ldl for future linking
1378 chmod u+w "$PERL_PREFIX"/lib/auto/Net/SSLeay/extralibs.ld
1379 echo " -ldl" >>"$PERL_PREFIX"/lib/auto/Net/SSLeay/extralibs.ld
1380 }
1381
1382=item Pango
1383
1384In addition to the C<MAN3PODS> problem in Glib, Pango also routes around
1385L<ExtUtils::MakeMaker> by compiling its files on its own. F<staticperl>
1386tries to patch L<ExtUtils::MM_Unix> to route around Pango.
1387
1388=item Term::ReadLine::Perl
1389
1390Also needs L<Term::ReadLine::readline>, or C<--usepacklists>.
1391
1392=item URI
1393
1394URI implements schemes as separate modules - the generic URL scheme is
1395implemented in L<URI::_generic>, HTTP is implemented in L<URI::http>. If
1396you need to use any of these schemes, you should include these manually,
1397or use C<--usepacklists>.
1398
1399=back
1400
1401=head2 RECIPES
1402
1403=over 4
1404
1405=item Just link everything in
1406
1407To link just about everything installed in the perl library into a new
1408perl, try this (the first time this runs it will take a long time, as a
1409lot of files need to be parsed):
1410
1411 staticperl mkperl -v --strip ppi --incglob '*'
1412
1413If you don't mind the extra megabytes, this can be a very effective way of
1414creating bundles without having to worry about forgetting any modules.
1415
1416You get even more useful variants of this method by first selecting
1417everything, and then excluding stuff you are reasonable sure not to need -
1418L<bigperl|http://staticperl.schmorp.de/bigperl.html> uses this approach.
1419
1420=item Getting rid of netdb functions
1421
1422The perl core has lots of netdb functions (C<getnetbyname>, C<getgrent>
1423and so on) that few applications use. You can avoid compiling them in by
1424putting the following fragment into a C<preconfigure> hook:
1425
1426 preconfigure() {
1427 for sym in \
1428 d_getgrnam_r d_endgrent d_endgrent_r d_endhent \
1429 d_endhostent_r d_endnent d_endnetent_r d_endpent \
1430 d_endprotoent_r d_endpwent d_endpwent_r d_endsent \
1431 d_endservent_r d_getgrent d_getgrent_r d_getgrgid_r \
1432 d_getgrnam_r d_gethbyaddr d_gethent d_getsbyport \
1433 d_gethostbyaddr_r d_gethostbyname_r d_gethostent_r \
1434 d_getlogin_r d_getnbyaddr d_getnbyname d_getnent \
1435 d_getnetbyaddr_r d_getnetbyname_r d_getnetent_r \
1436 d_getpent d_getpbyname d_getpbynumber d_getprotobyname_r \
1437 d_getprotobynumber_r d_getprotoent_r d_getpwent \
1438 d_getpwent_r d_getpwnam_r d_getpwuid_r d_getsent \
1439 d_getservbyname_r d_getservbyport_r d_getservent_r \
1440 d_getspnam_r d_getsbyname
1441 # d_gethbyname
1442 do
1443 PERL_CONFIGURE="$PERL_CONFIGURE -U$sym"
1444 done
1445 }
1446
1447This mostly gains space when linking statically, as the functions will
1448likely not be linked in. The gain for dynamically-linked binaries is
1449smaller.
1450
1451Also, this leaves C<gethostbyname> in - not only is it actually used
1452often, the L<Socket> module also exposes it, so leaving it out usually
1453gains little. Why Socket exposes a C function that is in the core already
1454is anybody's guess.
1455
1456=back
1457
548=head1 AUTHOR 1458=head1 AUTHOR
549 1459
550 Marc Lehmann <schmorp@schmorp.de> 1460 Marc Lehmann <schmorp@schmorp.de>
551 http://software.schmorp.de/pkg/staticperl.html 1461 http://software.schmorp.de/pkg/staticperl.html

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines