ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/App-Staticperl/staticperl.pod
(Generate patch)

Comparing App-Staticperl/staticperl.pod (file contents):
Revision 1.19 by root, Fri Dec 10 15:25:24 2010 UTC vs.
Revision 1.66 by root, Fri Aug 4 03:14:33 2023 UTC

1=head1 NAME 1=head1 NAME
2 2
3staticperl - perl, libc, 100 modules, all in one 500kb file 3staticperl - perl, libc, 100 modules, all in one standalone 500kb file
4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 staticperl help # print the embedded documentation 7 staticperl help # print the embedded documentation
8 staticperl fetch # fetch and unpack perl sources 8 staticperl fetch # fetch and unpack perl sources
9 staticperl configure # fetch and then configure perl 9 staticperl configure # fetch and then configure perl
10 staticperl build # configure and then build perl 10 staticperl build # configure and then build perl
11 staticperl install # build and then install perl 11 staticperl install # build and then install perl
12 staticperl clean # clean most intermediate files (restart at configure) 12 staticperl clean # clean most intermediate files (restart at configure)
13 staticperl distclean # delete everything installed by this script 13 staticperl distclean # delete everything installed by this script
14 staticperl perl ... # invoke the perlinterpreter
14 staticperl cpan # invoke CPAN shell 15 staticperl cpan # invoke CPAN shell
15 staticperl instmod path... # install unpacked modules 16 staticperl instsrc path... # install unpacked modules
16 staticperl instcpan modulename... # install modules from CPAN 17 staticperl instcpan modulename... # install modules from CPAN
17 staticperl mkbundle <bundle-args...> # see documentation 18 staticperl mkbundle <bundle-args...> # see documentation
18 staticperl mkperl <bundle-args...> # see documentation 19 staticperl mkperl <bundle-args...> # see documentation
19 staticperl mkapp appname <bundle-args...> # see documentation 20 staticperl mkapp appname <bundle-args...> # see documentation
20 21
21Typical Examples: 22Typical Examples:
22 23
23 staticperl install # fetch, configure, build and install perl 24 staticperl install # fetch, configure, build and install perl
24 staticperl cpan # run interactive cpan shell 25 staticperl cpan # run interactive cpan shell
25 staticperl mkperl -M '"Config_heavy.pl"' # build a perl that supports -V 26 staticperl mkperl -MConfig_heavy.pl # build a perl that supports -V
26 staticperl mkperl -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI -MURI::http 27 staticperl mkperl -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI -MURI::http
27 # build a perl with the above modules linked in 28 # build a perl with the above modules linked in
28 staticperl mkapp myapp --boot mainprog mymodules 29 staticperl mkapp myapp --boot mainprog mymodules
29 # build a binary "myapp" from mainprog and mymodules 30 # build a binary "myapp" from mainprog and mymodules
30 31
38file that contains perl interpreter, libc, all the modules you need, all 39file that contains perl interpreter, libc, all the modules you need, all
39the libraries you need and of course your actual program. 40the libraries you need and of course your actual program.
40 41
41With F<uClibc> and F<upx> on x86, you can create a single 500kb binary 42With F<uClibc> and F<upx> on x86, you can create a single 500kb binary
42that contains perl and 100 modules such as POSIX, AnyEvent, EV, IO::AIO, 43that contains perl and 100 modules such as POSIX, AnyEvent, EV, IO::AIO,
43Coro and so on. Or any other choice of modules. 44Coro and so on. Or any other choice of modules (and some other size :).
45
46To see how this turns out, you can try out smallperl and bigperl, two
47pre-built static and compressed perl binaries with many and even more
48modules: just follow the links at L<http://staticperl.schmorp.de/>.
44 49
45The created files do not need write access to the file system (like PAR 50The created files do not need write access to the file system (like PAR
46does). In fact, since this script is in many ways similar to PAR::Packer, 51does). In fact, since this script is in many ways similar to PAR::Packer,
47here are the differences: 52here are the differences:
48 53
79With F<staticperl>, the burden is mostly with the developer - only direct 84With F<staticperl>, the burden is mostly with the developer - only direct
80compile-time dependencies and L<AutoLoader> are handled automatically. 85compile-time dependencies and L<AutoLoader> are handled automatically.
81This means the modules to include often need to be tweaked manually. 86This means the modules to include often need to be tweaked manually.
82 87
83All this does not preclude more permissive modes to be implemented in 88All this does not preclude more permissive modes to be implemented in
84the future, but right now, you have to resolve state hidden dependencies 89the future, but right now, you have to resolve hidden dependencies
85manually. 90manually.
86 91
87=item * PAR works out of the box, F<staticperl> does not. 92=item * PAR works out of the box, F<staticperl> does not.
88 93
89Maintaining your own custom perl build can be a pain in the ass, and while 94Maintaining your own custom perl build can be a pain in the ass, and while
118often as necessary. 123often as necessary.
119 124
120=head1 THE F<STATICPERL> SCRIPT 125=head1 THE F<STATICPERL> SCRIPT
121 126
122This module installs a script called F<staticperl> into your perl 127This module installs a script called F<staticperl> into your perl
123binary directory. The script is fully self-contained, and can be used 128binary directory. The script is fully self-contained, and can be
124without perl (for example, in an uClibc chroot environment). In fact, 129used without perl (for example, in an uClibc chroot environment). In
125it can be extracted from the C<App::Staticperl> distribution tarball as 130fact, it can be extracted from the C<App::Staticperl> distribution
126F<bin/staticperl>, without any installation. 131tarball as F<bin/staticperl>, without any installation. The
132newest (possibly alpha) version can also be downloaded from
133L<http://staticperl.schmorp.de/staticperl>.
127 134
128F<staticperl> interprets the first argument as a command to execute, 135F<staticperl> interprets the first argument as a command to execute,
129optionally followed by any parameters. 136optionally followed by any parameters.
130 137
131There are two command categories: the "phase 1" commands which deal with 138There are two command categories: the "phase 1" commands which deal with
133with creating binaries and bundle files. 140with creating binaries and bundle files.
134 141
135=head2 PHASE 1 COMMANDS: INSTALLING PERL 142=head2 PHASE 1 COMMANDS: INSTALLING PERL
136 143
137The most important command is F<install>, which does basically 144The most important command is F<install>, which does basically
138everything. The default is to download and install perl 5.12.2 and a few 145everything. The default is to download and install perl 5.12.3 and a few
139modules required by F<staticperl> itself, but all this can (and should) be 146modules required by F<staticperl> itself, but all this can (and should) be
140changed - see L<CONFIGURATION>, below. 147changed - see L<CONFIGURATION>, below.
141 148
142The command 149The command
143 150
144 staticperl install 151 staticperl install
145 152
146Is normally all you need: It installs the perl interpreter in 153is normally all you need: It installs the perl interpreter in
147F<~/.staticperl/perl>. It downloads, configures, builds and installs the 154F<~/.staticperl/perl>. It downloads, configures, builds and installs the
148perl interpreter if required. 155perl interpreter if required.
149 156
150Most of the following commands simply run one or more steps of this 157Most of the following F<staticperl> subcommands simply run one or more
151sequence. 158steps of this sequence.
159
160If it fails, then most commonly because the compiler options I selected
161are not supported by your compiler - either edit the F<staticperl> script
162yourself or create F<~/.staticperl> shell script where your set working
163C<PERL_CCFLAGS> etc. variables.
152 164
153To force recompilation or reinstallation, you need to run F<staticperl 165To force recompilation or reinstallation, you need to run F<staticperl
154distclean> first. 166distclean> first.
155 167
156=over 4 168=over 4
157 169
170=item F<staticperl version>
171
172Prints some info about the version of the F<staticperl> script you are using.
173
158=item F<staticperl fetch> 174=item F<staticperl fetch>
159 175
160Runs only the download and unpack phase, unless this has already happened. 176Runs only the download and unpack phase, unless this has already happened.
161 177
162=item F<staticperl configure> 178=item F<staticperl configure>
170 186
171=item F<staticperl install> 187=item F<staticperl install>
172 188
173Wipes the perl installation directory (usually F<~/.staticperl/perl>) and 189Wipes the perl installation directory (usually F<~/.staticperl/perl>) and
174installs the perl distribution, potentially after building it first. 190installs the perl distribution, potentially after building it first.
191
192=item F<staticperl perl> [args...]
193
194Invokes the compiled perl interpreter with the given args. Basically the
195same as starting perl directly (usually via F<~/.staticperl/bin/perl>),
196but beats typing the path sometimes.
197
198Example: check that the Gtk2 module is installed and loadable.
199
200 staticperl perl -MGtk2 -e0
175 201
176=item F<staticperl cpan> [args...] 202=item F<staticperl cpan> [args...]
177 203
178Starts an interactive CPAN shell that you can use to install further 204Starts an interactive CPAN shell that you can use to install further
179modules. Installs the perl first if necessary, but apart from that, 205modules. Installs the perl first if necessary, but apart from that,
180no magic is involved: you could just as well run it manually via 206no magic is involved: you could just as well run it manually via
181F<~/.staticperl/perl/bin/cpan>. 207F<~/.staticperl/perl/bin/cpan>, except that F<staticperl> additionally
208sets the environment variable C<$PERL> to the path of the perl
209interpreter, which is handy in subshells.
182 210
183Any additional arguments are simply passed to the F<cpan> command. 211Any additional arguments are simply passed to the F<cpan> command.
184 212
185=item F<staticperl instcpan> module... 213=item F<staticperl instcpan> module...
186 214
199 227
200=item F<staticperl clean> 228=item F<staticperl clean>
201 229
202Deletes the perl source directory (and potentially cleans up other 230Deletes the perl source directory (and potentially cleans up other
203intermediate files). This can be used to clean up files only needed for 231intermediate files). This can be used to clean up files only needed for
204building perl, without removing the installed perl interpreter, or to 232building perl, without removing the installed perl interpreter.
205force a re-build from scratch.
206 233
207At the moment, it doesn't delete downloaded tarballs. 234At the moment, it doesn't delete downloaded tarballs.
235
236The exact semantics of this command will probably change.
208 237
209=item F<staticperl distclean> 238=item F<staticperl distclean>
210 239
211This wipes your complete F<~/.staticperl> directory. Be careful with this, 240This wipes your complete F<~/.staticperl> directory. Be careful with this,
212it nukes your perl download, perl sources, perl distribution and any 241it nukes your perl download, perl sources, perl distribution and any
236 265
237 # first make sure we have perl and the required modules 266 # first make sure we have perl and the required modules
238 staticperl instcpan AnyEvent::HTTPD 267 staticperl instcpan AnyEvent::HTTPD
239 268
240 # now build the perl 269 # now build the perl
241 staticperl mkperl -M'"Config_heavy.pl"' -MAnyEvent::Impl::Perl \ 270 staticperl mkperl -MConfig_heavy.pl -MAnyEvent::Impl::Perl \
242 -MAnyEvent::HTTPD -MURI::http \ 271 -MAnyEvent::HTTPD -MURI::http \
243 --add 'eg/httpd httpd.pm' 272 --add 'eg/httpd httpd.pm'
244 273
245 # finally, invoke it 274 # finally, invoke it
246 ./perl -Mhttpd 275 ./perl -Mhttpd
262 -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI::http 291 -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI::http
263 292
264 # run it 293 # run it
265 ./app 294 ./app
266 295
296Here are the three phase 2 commands:
297
298=over 4
299
300=item F<staticperl mkbundle> args...
301
302The "default" bundle command - it interprets the given bundle options and
303writes out F<bundle.h>, F<bundle.c>, F<bundle.ccopts> and F<bundle.ldopts>
304files, useful for embedding.
305
306=item F<staticperl mkperl> args...
307
308Creates a bundle just like F<staticperl mkbundle> (in fact, it's the same
309as invoking F<staticperl mkbundle --perl> args...), but then compiles and
310links a new perl interpreter that embeds the created bundle, then deletes
311all intermediate files.
312
313=item F<staticperl mkapp> filename args...
314
315Does the same as F<staticperl mkbundle> (in fact, it's the same as
316invoking F<staticperl mkbundle --app> filename args...), but then compiles
317and links a new standalone application that simply initialises the perl
318interpreter.
319
320The difference to F<staticperl mkperl> is that the standalone application
321does not act like a perl interpreter would - in fact, by default it would
322just do nothing and exit immediately, so you should specify some code to
323be executed via the F<--boot> option.
324
325=back
326
267=head3 OPTION PROCESSING 327=head3 OPTION PROCESSING
268 328
269All options can be given as arguments on the command line (typically 329All options can be given as arguments on the command line (typically
270using long (e.g. C<--verbose>) or short option (e.g. C<-v>) style). Since 330using long (e.g. C<--verbose>) or short option (e.g. C<-v>) style). Since
271specifying a lot of modules can make the command line very cumbersome, 331specifying a lot of options can make the command line very long and
272you can put all long options into a "bundle specification file" (with or 332unwieldy, you can put all long options into a "bundle specification file"
273without C<--> prefix) and specify this bundle file instead. 333(one option per line, with or without C<--> prefix) and specify this
334bundle file instead.
274 335
275For example, the command given earlier could also look like this: 336For example, the command given earlier to link a new F<perl> could also
337look like this:
276 338
277 staticperl mkperl httpd.bundle 339 staticperl mkperl httpd.bundle
278 340
279And all options could be in F<httpd.bundle>: 341With all options stored in the F<httpd.bundle> file (one option per line,
280 342everything after the option is an argument):
343
281 use "Config_heavy.pl" 344 use "Config_heavy.pl"
282 use AnyEvent::Impl::Perl 345 use AnyEvent::Impl::Perl
283 use AnyEvent::HTTPD 346 use AnyEvent::HTTPD
284 use URI::http 347 use URI::http
285 add eg/httpd httpd.pm 348 add eg/httpd httpd.pm
286 349
287All options that specify modules or files to be added are processed in the 350All options that specify modules or files to be added are processed in the
288order given on the command line (that affects the C<--use> and C<--eval> 351order given on the command line.
289options at the moment).
290 352
291=head3 PACKAGE SELECTION WORKFLOW 353=head3 BUNDLE CREATION WORKFLOW / STATICPERL MKBUNDLE OPTIONS
292 354
293F<staticperl mkbundle> has a number of options to control package 355F<staticperl mkbundle> works by first assembling a list of candidate
294selection. This section describes how they interact with each other. Also, 356files and modules to include, then filtering them by include/exclude
295since I am still a newbie w.r.t. these issues, maybe future versions of 357patterns. The remaining modules (together with their direct dependencies,
296F<staticperl> will change this, so watch out :) 358such as link libraries and L<AutoLoader> files) are then converted into
359bundle files suitable for embedding. F<staticperl mkbundle> can then
360optionally build a new perl interpreter or a standalone application.
297 361
298The idiom "in order" means "in order that they are specified on the
299commandline". If you use a bundle specification file, then the options
300will be processed as if they were given in place of the bundle file name.
301
302=over 4 362=over 4
303 363
304=item 1. apply all C<--use>, C<--eval>, C<--add>, C<--addbin> and 364=item Step 0: Generic argument processing.
305C<--incglob> options, in order.
306 365
307In addition, C<--use> and C<--eval> dependencies will be added when the 366The following options influence F<staticperl mkbundle> itself.
308options are processed.
309 367
310=item 2. apply all C<--include> and C<--exclude> options, in order.
311
312All this step does is potentially reduce the number of files already
313selected or found in phase 1.
314
315=item 3. find all modules (== F<.pm> files), gather their static archives
316(F<.a>) and AutoLoader splitfiles (F<.ix> and F<.al> files) and find any
317extra libraries they need for linking (F<extralibs.ld>).
318
319This step is required to link against XS extensions and also adds files
320required for L<AutoLoader> to do it's job.
321
322=back
323
324After this, all the files selected for bundling will be read and processed
325(stripped), the bundle files will be written, and optionally a new F<perl>
326or application binary will be linked.
327
328=head3 MKBUNDLE OPTIONS
329
330=over 4 368=over 4
331 369
332=item --verbose | -v 370=item C<--verbose> | C<-v>
333 371
334Increases the verbosity level by one (the default is C<1>). 372Increases the verbosity level by one (the default is C<1>).
335 373
336=item --quiet | -q 374=item C<--quiet> | C<-q>
337 375
338Decreases the verbosity level by one. 376Decreases the verbosity level by one.
339 377
378=item any other argument
379
380Any other argument is interpreted as a bundle specification file, which
381supports all options (without extra quoting), one option per line, in the
382format C<option> or C<option argument>. They will effectively be expanded
383and processed as if they were directly written on the command line, in
384place of the file name.
385
386=back
387
388=item Step 1: gather candidate files and modules
389
390In this step, modules, perl libraries (F<.pl> files) and other files are
391selected for inclusion in the bundle. The relevant options are executed
392in order (this makes a difference mostly for C<--eval>, which can rely on
393earlier C<--use> options to have been executed).
394
395=over 4
396
397=item C<--use> F<module> | C<-M>F<module>
398
399Include the named module or perl library and trace direct
400dependencies. This is done by loading the module in a subprocess and
401tracing which other modules and files it actually loads.
402
403Example: include AnyEvent and AnyEvent::Impl::Perl.
404
405 staticperl mkbundle --use AnyEvent --use AnyEvent::Impl::Perl
406
407Sometimes you want to load old-style "perl libraries" (F<.pl> files), or
408maybe other weirdly named files. To support this, the C<--use> option
409actually tries to do what you mean, depending on the string you specify:
410
411=over 4
412
413=item a possibly valid module name, e.g. F<common::sense>, F<Carp>,
414F<Coro::Mysql>.
415
416If the string contains no quotes, no F</> and no F<.>, then C<--use>
417assumes that it is a normal module name. It will create a new package and
418evaluate a C<use module> in it, i.e. it will load the package and do a
419default import.
420
421The import step is done because many modules trigger more dependencies
422when something is imported than without.
423
424=item anything that contains F</> or F<.> characters,
425e.g. F<utf8_heavy.pl>, F<Module/private/data.pl>.
426
427The string will be quoted and passed to require, as if you used C<require
428$module>. Nothing will be imported.
429
430=item "path" or 'path', e.g. C<"utf8_heavy.pl">.
431
432If you enclose the name into single or double quotes, then the quotes will
433be removed and the resulting string will be passed to require. This syntax
434is form compatibility with older versions of staticperl and should not be
435used anymore.
436
437=back
438
439Example: C<use> AnyEvent::Socket, once using C<use> (importing the
440symbols), and once via C<require>, not importing any symbols. The first
441form is preferred as many modules load some extra dependencies when asked
442to export symbols.
443
444 staticperl mkbundle -MAnyEvent::Socket # use + import
445 staticperl mkbundle -MAnyEvent/Socket.pm # require only
446
447Example: include the required files for F<perl -V> to work in all its
448glory (F<Config.pm> is included automatically by the dependency tracker).
449
450 # shell command
451 staticperl mkbundle -MConfig_heavy.pl
452
453 # bundle specification file
454 use Config_heavy.pl
455
456The C<-M>module syntax is included as a convenience that might be easier
457to remember than C<--use> - it's the same switch as perl itself uses
458to load modules. Or maybe it confuses people. Time will tell. Or maybe
459not. Sigh.
460
461=item C<--eval> "perl code" | C<-e> "perl code"
462
463Sometimes it is easier (or necessary) to specify dependencies using perl
464code, or maybe one of the modules you use need a special use statement. In
465that case, you can use C<--eval> to execute some perl snippet or set some
466variables or whatever you need. All files C<require>'d or C<use>'d while
467executing the snippet are included in the final bundle.
468
469Keep in mind that F<mkbundle> will not import any symbols from the modules
470named by the C<--use> option, so do not expect the symbols from modules
471you C<--use>'d earlier on the command line to be available.
472
473Example: force L<AnyEvent> to detect a backend and therefore include it
474in the final bundle.
475
476 staticperl mkbundle --eval 'use AnyEvent; AnyEvent::detect'
477
478 # or like this
479 staticperl mkbundle -MAnyEvent --eval 'AnyEvent::detect'
480
481Example: use a separate "bootstrap" script that C<use>'s lots of modules
482and also include this in the final bundle, to be executed automatically
483when the interpreter is initialised.
484
485 staticperl mkbundle --eval 'do "bootstrap"' --boot bootstrap
486
487=item C<--boot> F<filename>
488
489Include the given file in the bundle and arrange for it to be
490executed (using C<require>) before the main program when the new perl
491is initialised. This can be used to modify C<@INC> or do similar
492modifications before the perl interpreter executes scripts given on the
493command line (or via C<-e>). This works even in an embedded interpreter -
494the file will be executed during interpreter initialisation in that case.
495
496=item C<--incglob> pattern
497
498This goes through all standard library directories and tries to match any
499F<.pm> and F<.pl> files against the extended glob pattern (see below). If
500a file matches, it is added. The pattern is matched against the full path
501of the file (sans the library directory prefix), e.g. F<Sys/Syslog.pm>.
502
503This is very useful to include "everything":
504
505 --incglob '*'
506
507It is also useful for including perl libraries, or trees of those, such as
508the unicode database files needed by some perl built-ins, the regex engine
509and other modules.
510
511 --incglob '/unicore/**.pl'
512
513=item C<--add> F<file> | C<--add> "F<file> alias"
514
515Adds the given (perl) file into the bundle (and optionally call it
516"alias"). The F<file> is either an absolute path or a path relative to the
517current directory. If an alias is specified, then this is the name it will
518use for C<@INC> searches, otherwise the path F<file> will be used as the
519internal name.
520
521This switch is used to include extra files into the bundle.
522
523Example: embed the file F<httpd> in the current directory as F<httpd.pm>
524when creating the bundle.
525
526 staticperl mkperl --add "httpd httpd.pm"
527
528 # can be accessed via "use httpd"
529
530Example: add a file F<initcode> from the current directory.
531
532 staticperl mkperl --add 'initcode &initcode'
533
534 # can be accessed via "do '&initcode'"
535
536Example: add local files as extra modules in the bundle.
537
538 # specification file
539 add file1 myfiles/file1.pm
540 add file2 myfiles/file2.pm
541 add file3 myfiles/file3.pl
542
543 # then later, in perl, use
544 use myfiles::file1;
545 require myfiles::file2;
546 my $res = do "myfiles/file3.pl";
547
548=item C<--addbin> F<file> | C<--addbin> "F<file> alias"
549
550Just like C<--add>, except that it treats the file as binary and adds it
551without any postprocessing (perl files might get stripped to reduce their
552size).
553
554If you specify an alias you should probably add a C</> prefix to avoid
555clashing with embedded perl files (whose paths never start with C</>),
556and/or use a special directory prefix, such as C</res/name>.
557
558You can later get a copy of these files by calling C<static::find
559"alias">.
560
561An alternative way to embed binary files is to convert them to perl and
562use C<do> to get the contents - this method is a bit cumbersome, but works
563both inside and outside of a staticperl bundle, without extra ado:
564
565 # a "binary" file, call it "bindata.pl"
566 <<'SOME_MARKER'
567 binary data NOT containing SOME_MARKER
568 SOME_MARKER
569
570 # load the binary
571 chomp (my $data = do "bindata.pl");
572
573=item C<--allow-dynamic>
574
575By default, when F<mkbundle> hits a dynamic perl extension (e.g. a F<.so>
576or F<.dll> file), it will stop with a fatal error.
577
578When this option is enabled, F<mkbundle> packages the shared
579object into the bundle instead, with a prefix of F<!>
580(e.g. F<!auto/List/Util/Util.so>). What you do with that is currently up
581to you, F<staticperl> has no special support for this at the moment, apart
582from working around the lack of availability of F<PerlIO::scalar> while
583bootstrapping, at a speed cost.
584
585One way to deal with this is to write all files starting with F<!> into
586some directory and then C<unshift> that path onto C<@INC>.
587
588#TODO: example
589
590=back
591
592=item Step 2: filter all files using C<--include> and C<--exclude> options.
593
594After all candidate files and modules are added, they are I<filtered>
595by a combination of C<--include> and C<--exclude> patterns (there is an
596implicit C<--include *> at the end, so if no filters are specified, all
597files are included).
598
599All that this step does is potentially reduce the number of files that are
600to be included - no new files are added during this step.
601
602=over 4
603
604=item C<--include> pattern | C<-i> pattern | C<--exclude> pattern | C<-x> pattern
605
606These specify an include or exclude pattern to be applied to the candidate
607file list. An include makes sure that the given files will be part of the
608resulting file set, an exclude will exclude remaining files. The patterns
609are "extended glob patterns" (see below).
610
611The patterns are applied "in order" - files included via earlier
612C<--include> specifications cannot be removed by any following
613C<--exclude>, and likewise, and file excluded by an earlier C<--exclude>
614cannot be added by any following C<--include>.
615
616For example, to include everything except C<Devel> modules, but still
617include F<Devel::PPPort>, you could use this:
618
619 --incglob '*' -i '/Devel/PPPort.pm' -x '/Devel/**'
620
621=back
622
623=item Step 3: add any extra or "hidden" dependencies.
624
625F<staticperl> currently knows about three extra types of depdendencies
626that are added automatically. Only one (F<.packlist> files) is currently
627optional and can be influenced, the others are always included:
628
629=over 4
630
631=item C<--usepacklists>
632
633Read F<.packlist> files for each distribution that happens to match a
634module name you specified. Sounds weird, and it is, so expect semantics to
635change somehow in the future.
636
637The idea is that most CPAN distributions have a F<.pm> file that matches
638the name of the distribution (which is rather reasonable after all).
639
640If this switch is enabled, then if any of the F<.pm> files that have been
641selected match an install distribution, then all F<.pm>, F<.pl>, F<.al>
642and F<.ix> files installed by this distribution are also included.
643
644For example, using this switch, when the L<URI> module is specified, then
645all L<URI> submodules that have been installed via the CPAN distribution
646are included as well, so you don't have to manually specify them.
647
648=item L<AutoLoader> splitfiles
649
650Some modules use L<AutoLoader> - less commonly (hopefully) used functions
651are split into separate F<.al> files, and an index (F<.ix>) file contains
652the prototypes.
653
654Both F<.ix> and F<.al> files will be detected automatically and added to
655the bundle.
656
657=item link libraries (F<.a> files)
658
659Modules using XS (or any other non-perl language extension compiled at
660installation time) will have a static archive (typically F<.a>). These
661will automatically be added to the linker options in F<bundle.ldopts>.
662
663Should F<staticperl> find a dynamic link library (typically F<.so>) it
664will warn about it - obviously this shouldn't happen unless you use
665F<staticperl> on the wrong perl, or one (probably wrongly) configured to
666use dynamic loading.
667
668=item extra libraries (F<extralibs.ld>)
669
670Some modules need linking against external libraries - these are found in
671F<extralibs.ld> and added to F<bundle.ldopts>.
672
673=back
674
675=item Step 4: write bundle files and optionally link a program
676
677At this point, the select files will be read, processed (stripped) and
678finally the bundle files get written to disk, and F<staticperl mkbundle>
679is normally finished. Optionally, it can go a step further and either link
680a new F<perl> binary with all selected modules and files inside, or build
681a standalone application.
682
683Both the contents of the bundle files and any extra linking is controlled
684by these options:
685
686=over 4
687
340=item --strip none|pod|ppi 688=item C<--strip> C<none>|C<pod>|C<ppi>
341 689
342Specify the stripping method applied to reduce the file of the perl 690Specify the stripping method applied to reduce the file of the perl
343sources included. 691sources included.
344 692
345The default is C<pod>, which uses the L<Pod::Strip> module to remove all 693The default is C<pod>, which uses the L<Pod::Strip> module to remove all
356Last not least, if you need accurate line numbers in error messages, 704Last not least, if you need accurate line numbers in error messages,
357or in the unlikely case where C<pod> is too slow, or some module gets 705or in the unlikely case where C<pod> is too slow, or some module gets
358mistreated, you can specify C<none> to not mangle included perl sources in 706mistreated, you can specify C<none> to not mangle included perl sources in
359any way. 707any way.
360 708
709=item C<--compress> C<none>|C<lzf>
710
711Compress each included library file with C<lzf> (default), or do not
712compress (C<none>). LZF compression typically halves the size of the
713included library data at almost no overhead, but is counterproductive if
714you are using another compression solution such as C<UPX>, so it cna be
715disabled.
716
361=item --perl 717=item C<--perl>
362 718
363After writing out the bundle files, try to link a new perl interpreter. It 719After writing out the bundle files, try to link a new perl interpreter. It
364will be called F<perl> and will be left in the current working 720will be called F<perl> and will be left in the current working
365directory. The bundle files will be removed. 721directory. The bundle files will be removed.
366 722
367This switch is automatically used when F<staticperl> is invoked with the 723This switch is automatically used when F<staticperl> is invoked with the
368C<mkperl> command (instead of C<mkbundle>): 724C<mkperl> command instead of C<mkbundle>.
369 725
370 # build a new ./perl with only common::sense in it - very small :) 726Example: build a new F<./perl> binary with only L<common::sense> inside -
727it will be even smaller than the standard perl interpreter as none of the
728modules of the base distribution (such as L<Fcntl>) will be included.
729
371 staticperl mkperl -Mcommon::sense 730 staticperl mkperl -Mcommon::sense
372 731
373=item --app name 732=item C<--app> F<name>
374 733
375After writing out the bundle files, try to link a new standalone 734After writing out the bundle files, try to link a new standalone
376program. It will be called C<name>, and the bundle files get removed after 735program. It will be called C<name>, and the bundle files get removed after
377linking it. 736linking it.
737
738This switch is automatically used when F<staticperl> is invoked with the
739C<mkapp> command instead of C<mkbundle>.
378 740
379The difference to the (mutually exclusive) C<--perl> option is that the 741The difference to the (mutually exclusive) C<--perl> option is that the
380binary created by this option will not try to act as a perl interpreter - 742binary created by this option will not try to act as a perl interpreter -
381instead it will simply initialise the perl interpreter, clean it up and 743instead it will simply initialise the perl interpreter, clean it up and
382exit. 744exit.
383 745
384This switch is automatically used when F<staticperl> is invoked with the 746This means that, by default, it will do nothing but burn a few CPU cycles
385C<mkapp> command (instead of C<mkbundle>):
386
387To let it do something useful you I<must> add some boot code, e.g. with 747- for it to do something useful you I<must> add some boot code, e.g. with
388the C<--boot> option. 748the C<--boot> option.
389 749
390Example: create a standalone perl binary that will execute F<appfile> when 750Example: create a standalone perl binary called F<./myexe> that will
391it is started. 751execute F<appfile> when it is started.
392 752
393 staticperl mkbundle --app myexe --boot appfile 753 staticperl mkbundle --app myexe --boot appfile
394 754
395=item --use module | -Mmodule 755=item C<--ignore-env>
396 756
397Include the named module and all direct dependencies. This is done by 757Generates extra code to unset some environment variables before
398C<require>'ing the module in a subprocess and tracing which other modules 758initialising/running perl. Perl supports a lot of environment variables
399and files it actually loads. If the module uses L<AutoLoader>, then all 759that might alter execution in ways that might be undesirablre for
400splitfiles will be included as well. 760standalone applications, and this option removes those known to cause
761trouble.
401 762
402Example: include AnyEvent and AnyEvent::Impl::Perl. 763Specifically, these are removed:
403 764
404 staticperl mkbundle --use AnyEvent --use AnyEvent::Impl::Perl 765C<PERL_HASH_SEED_DEBUG> and C<PERL_DEBUG_MSTATS> can cause undesirable
766output, C<PERL5OPT>, C<PERL_DESTRUCT_LEVEL>, C<PERL_HASH_SEED> and
767C<PERL_SIGNALS> can alter execution significantly, and C<PERL_UNICODE>,
768C<PERLIO_DEBUG> and C<PERLIO> can affect input and output.
405 769
406Sometimes you want to load old-style "perl libraries" (F<.pl> files), or 770The variables C<PERL_LIB> and C<PERL5_LIB> are always ignored because the
407maybe other weirdly named files. To do that, you need to quote the name in 771startup code used by F<staticperl> overrides C<@INC> in all cases.
408single or double quotes. When given on the command line, you probably need
409to quote once more to avoid your shell interpreting it. Common cases that
410need this are F<Config_heavy.pl> and F<utf8_heavy.pl>.
411 772
412Example: include the required files for F<perl -V> to work in all its 773This option will not make your program more secure (unless you are
413glory (F<Config.pm> is included automatically by this). 774running with elevated privileges), but it will reduce the surprise effect
775when a user has these environment variables set and doesn't expect your
776standalone program to act like a perl interpreter.
414 777
415 # bourne shell
416 staticperl mkbundle --use '"Config_heavy.pl"'
417
418 # bundle specification file
419 use "Config_heavy.pl"
420
421The C<-Mmodule> syntax is included as an alias that might be easier to
422remember than C<use>. Or maybe it confuses people. Time will tell. Or
423maybe not. Argh.
424
425=item --eval "perl code" | -e "perl code"
426
427Sometimes it is easier (or necessary) to specify dependencies using perl
428code, or maybe one of the modules you use need a special use statement. In
429that case, you can use C<eval> to execute some perl snippet or set some
430variables or whatever you need. All files C<require>'d or C<use>'d in the
431script are included in the final bundle.
432
433Keep in mind that F<mkbundle> will only C<require> the modules named
434by the C<--use> option, so do not expect the symbols from modules you
435C<--use>'d earlier on the command line to be available.
436
437Example: force L<AnyEvent> to detect a backend and therefore include it
438in the final bundle.
439
440 staticperl mkbundle --eval 'use AnyEvent; AnyEvent::detect'
441
442 # or like this
443 staticperl mkbundle -MAnyEvent --eval 'use AnyEvent; AnyEvent::detect'
444
445Example: use a separate "bootstrap" script that C<use>'s lots of modules
446and include this in the final bundle, to be executed automatically.
447
448 staticperl mkbundle --eval 'do "bootstrap"' --boot bootstrap
449
450=item --boot filename
451
452Include the given file in the bundle and arrange for it to be executed
453(using a C<require>) before anything else when the new perl is
454initialised. This can be used to modify C<@INC> or anything else before
455the perl interpreter executes scripts given on the command line (or via
456C<-e>). This works even in an embedded interpreter.
457
458=item --incglob pattern
459
460This goes through all library directories and tries to match any F<.pm>
461and F<.pl> files against the extended glob pattern (see below). If a file
462matches, it is added. This switch will automatically detect L<AutoLoader>
463files and the required link libraries for XS modules, but it will I<not>
464scan the file for dependencies (at the moment).
465
466This is mainly useful to include "everything":
467
468 --incglob '*'
469
470Or to include perl libraries, or trees of those, such as the unicode
471database files needed by many other modules:
472
473 --incglob '/unicore/**.pl'
474
475=item --add file | --add "file alias"
476
477Adds the given (perl) file into the bundle (and optionally call it
478"alias"). This is useful to include any custom files into the bundle.
479
480Example: embed the file F<httpd> as F<httpd.pm> when creating the bundle.
481
482 staticperl mkperl --add "httpd httpd.pm"
483
484It is also a great way to add any custom modules:
485
486 # specification file
487 add file1 myfiles/file1
488 add file2 myfiles/file2
489 add file3 myfiles/file3
490
491=item --binadd file | --add "file alias"
492
493Just like C<--add>, except that it treats the file as binary and adds it
494without any processing.
495
496You should probably add a C</> prefix to avoid clashing with embedded
497perl files (whose paths do not start with C</>), and/or use a special
498directory, such as C</res/name>.
499
500You can later get a copy of these files by calling C<staticperl::find
501"alias">.
502
503=item --include pattern | -i pattern | --exclude pattern | -x pattern
504
505These two options define an include/exclude filter that is used after all
506files selected by the other options have been found. Each include/exclude
507is applied to all files found so far - an include makes sure that the
508given files will be part of the resulting file set, an exclude will
509exclude files. The patterns are "extended glob patterns" (see below).
510
511For example, to include everything, except C<Devel> modules, but still
512include F<Devel::PPPort>, you could use this:
513
514 --incglob '*' -i '/Devel/PPPort.pm' -x '/Devel/**'
515
516=item --static 778=item C<--static>
517 779
518When C<--perl> is also given, link statically instead of dynamically. The 780Add C<-static> to F<bundle.ldopts>, which means a fully static (if
781supported by the OS) executable will be created. This is not immensely
782useful when just creating the bundle files, but is most useful when
783linking a binary with the C<--perl> or C<--app> options.
784
519default is to link the new perl interpreter fully dynamic (that means all 785The default is to link the new binary dynamically (that means all perl
520perl modules are linked statically, but all external libraries are still 786modules are linked statically, but all external libraries are still
521referenced dynamically). 787referenced dynamically).
522 788
523Keep in mind that Solaris doesn't support static linking at all, and 789Keep in mind that Solaris doesn't support static linking at all, and
524systems based on GNU libc don't really support it in a usable fashion 790systems based on GNU libc don't really support it in a very usable
525either. Try uClibc if you want to create fully statically linked 791fashion either. Try uClibc if you want to create fully statically linked
526executables, or try the C<--staticlibs> option to link only some libraries 792executables, or try the C<--staticlib> option to link only some libraries
527statically. 793statically.
528 794
529=item --staticlib libname 795=item C<--staticlib> libname
530 796
531When not linking fully statically, this option allows you to link specific 797When not linking fully statically, this option allows you to link specific
532libraries statically. What it does is simply replace all occurances of 798libraries statically. What it does is simply replace all occurrences of
533C<-llibname> with the GCC-specific C<-Wl,-Bstatic -llibname -Wl,-Bdynamic> 799C<-llibname> with the GCC-specific C<-Wl,-Bstatic -llibname -Wl,-Bdynamic>
534option. 800option.
535 801
536This will have no effect unless the library is actually linked against, 802This will have no effect unless the library is actually linked against,
537specifically, C<--staticlib> will not link against the named library 803specifically, C<--staticlib> will not link against the named library
538unless it would be linked against anyway. 804unless it would be linked against anyway.
539 805
540Example: link libcrypt statically into the binary. 806Example: link libcrypt statically into the final binary.
541 807
542 staticperl mkperl -MIO::AIO --staticlib crypt 808 staticperl mkperl -MIO::AIO --staticlib crypt
543 809
544 # ldopts might nwo contain: 810 # ldopts might now contain:
545 # -lm -Wl,-Bstatic -lcrypt -Wl,-Bdynamic -lpthread 811 # -lm -Wl,-Bstatic -lcrypt -Wl,-Bdynamic -lpthread
546 812
547=item any other argument 813=item C<--extra-cflags> string
548 814
549Any other argument is interpreted as a bundle specification file, which 815Specifies extra compiler flags, used when compiling the bundle file. The
550supports most long options (without extra quoting), one option per line. 816flags are appended to all the existing flags, so can be sued to override
817settings.
818
819=item C<--extra-ldflags> string
820
821Specifies extra linker flags, used when linking the bundle.
822
823=item C<--extra-libs> string
824
825Extra linker flags, appended at the end when linking. The difference to
826C<--extra-ldflags> is that the ldflags are appended to the flags, before
827the objects and libraries, and the extra libs are added at the end.
828
829=back
551 830
552=back 831=back
553 832
554=head3 EXTENDED GLOB PATTERNS 833=head3 EXTENDED GLOB PATTERNS
555 834
569=item Patterns not starting with F</> will be anchored at the end of the path. 848=item Patterns not starting with F</> will be anchored at the end of the path.
570 849
571That is, F<idna.pl> will match any file called F<idna.pl> anywhere in the 850That is, F<idna.pl> will match any file called F<idna.pl> anywhere in the
572hierarchy, but not any directories of the same name. 851hierarchy, but not any directories of the same name.
573 852
574=item A F<*> matches any single component. 853=item A F<*> matches anything within a single path component.
575 854
576That is, F</unicore/*.pl> would match all F<.pl> files directly inside 855That is, F</unicore/*.pl> would match all F<.pl> files directly inside
577C</unicore>, not any deeper level F<.pl> files. Or in other words, F<*> 856C</unicore>, not any deeper level F<.pl> files. Or in other words, F<*>
578will not match slashes. 857will not match slashes.
579 858
589 868
590=back 869=back
591 870
592=head2 F<STATICPERL> CONFIGURATION AND HOOKS 871=head2 F<STATICPERL> CONFIGURATION AND HOOKS
593 872
594During (each) startup, F<staticperl> tries to source the following shell 873During (each) startup, F<staticperl> tries to source some shell files to
874allow you to fine-tune/override configuration settings.
875
876In them you can override shell variables, or define shell functions
877("hooks") to be called at specific phases during installation. For
878example, you could define a C<postinstall> hook to install additional
879modules from CPAN each time you start from scratch.
880
881If the env variable C<$STATICPERLRC> is set, then F<staticperl> will try
882to source the file named with it only. Otherwise, it tries the following
595files in order: 883shell files in order:
596 884
597 /etc/staticperlrc 885 /etc/staticperlrc
598 ~/.staticperlrc 886 ~/.staticperlrc
599 $STATICPERL/rc 887 $STATICPERL/rc
600 888
601They can be used to override shell variables, or define functions to be
602called at specific phases.
603
604Note that the last file is erased during F<staticperl distclean>, so 889Note that the last file is erased during F<staticperl distclean>, so
605generally should not be used. 890generally should not be used.
606 891
607=head3 CONFIGURATION VARIABLES 892=head3 CONFIGURATION VARIABLES
608 893
640=item C<STATICPERL> 925=item C<STATICPERL>
641 926
642The directory where staticperl stores all its files 927The directory where staticperl stores all its files
643(default: F<~/.staticperl>). 928(default: F<~/.staticperl>).
644 929
930=item C<DLCACHE>
931
932The path to a directory (will be created if it doesn't exist) where
933downloaded perl sources are being cached, to avoid downloading them
934again. The default is empty, which means there is no cache.
935
936=item C<PERL_VERSION>
937
938The perl version to install - C<5.12.5> is a good choice for small builds,
939but C<5.8.9> is also a good choice (5.8.9 is much smaller than 5.12.5), if
940it builds on your system.
941
942You can also set this variable to the absolute URL of a tarball (F<.tar>,
943F<.tar.gz>, F<.tar.bz2>, F<.tar.lzma> or F<.tar.xz>), or to the absolute
944path of an unpacked perl source tree, which will be copied.
945
946The default is currently
947F<http://stableperl.schmorp.de/dist/latest.tar.gz>, i.e. the latest
948stableperl release.
949
645=item C<PERL_MM_USE_DEFAULT>, C<EV_EXTRA_DEFS>, ... 950=item C<PERL_MM_USE_DEFAULT>, C<EV_EXTRA_DEFS>, ...
646 951
647Usually set to C<1> to make modules "less inquisitive" during their 952Usually set to C<1> to make modules "less inquisitive" during their
648installation, you can set any environment variable you want - some modules 953installation. You can set (and export!) any environment variable you want
649(such as L<Coro> or L<EV>) use environment variables for further tweaking. 954- some modules (such as L<Coro> or L<EV>) use environment variables for
650 955further tweaking.
651=item C<PERL_VERSION>
652
653The perl version to install - default is currently C<5.12.2>, but C<5.8.9>
654is also a good choice (5.8.9 is much smaller than 5.12.2, while 5.10.1 is
655about as big as 5.12.2).
656 956
657=item C<PERL_PREFIX> 957=item C<PERL_PREFIX>
658 958
659The prefix where perl gets installed (default: F<$STATICPERL/perl>), 959The directory where perl gets installed (default: F<$STATICPERL/perl>),
660i.e. where the F<bin> and F<lib> subdirectories will end up. 960i.e. where the F<bin> and F<lib> subdirectories will end up. Previous
961contents will be removed on installation.
661 962
662=item C<PERL_CONFIGURE> 963=item C<PERL_CONFIGURE>
663 964
664Additional Configure options - these are simply passed to the perl 965Additional Configure options - these are simply passed to the perl
665Configure script. For example, if you wanted to enable dynamic loading, 966Configure script. For example, if you wanted to enable dynamic loading,
669 970
670More commonly, you would either activate 64 bit integer support 971More commonly, you would either activate 64 bit integer support
671(C<-Duse64bitint>), or disable large files support (-Uuselargefiles), to 972(C<-Duse64bitint>), or disable large files support (-Uuselargefiles), to
672reduce filesize further. 973reduce filesize further.
673 974
674=item C<PERL_CPPFLAGS>, C<PERL_OPTIMIZE>, C<PERL_LDFLAGS>, C<PERL_LIBS> 975=item C<PERL_CC>, C<PERL_CCFLAGS>, C<PERL_OPTIMIZE>, C<PERL_LDFLAGS>, C<PERL_LIBS>
675 976
676These flags are passed to perl's F<Configure> script, and are generally 977These flags are passed to perl's F<Configure> script, and are generally
677optimised for small size (at the cost of performance). Since they also 978optimised for small size (at the cost of performance). Since they also
678contain subtle workarounds around various build issues, changing these 979contain subtle workarounds around various build issues, changing these
679usually requires understanding their default values - best look at the top 980usually requires understanding their default values - best look at
680of the F<staticperl> script for more info on these. 981the top of the F<staticperl> script for more info on these, and use a
982F<~/.staticperlrc> to override them.
983
984Most of the variables override (or modify) the corresponding F<Configure>
985variable, except C<PERL_CCFLAGS>, which gets appended.
986
987The default for C<PERL_OPTIMIZE> is C<-Os> (assuming gcc), and for
988C<PERL_LIBS> is C<-lm -lcrypt>, which should be good for most (but not
989all) systems.
990
991For other compilers or more customised optimisation settings, you need to
992adjust these, e.g. in your F<~/.staticperlrc>.
993
994With gcc on x86 and amd64, you can get more space-savings by using:
995
996 -Os -ffunction-sections -fdata-sections -finline-limit=8 -mpush-args
997 -mno-inline-stringops-dynamically -mno-align-stringops
998
999And on x86 and pentium3 and newer (basically everything you might ever
1000want to run on), adding these is even better for space-savings (use
1001-mtune=core2 or something newer for much faster code, too):
1002
1003 -fomit-frame-pointer -march=pentium3 -mtune=i386
681 1004
682=back 1005=back
683 1006
684=head4 Variables you probably I<do not want> to override 1007=head4 Variables you probably I<do not want> to override
685 1008
686=over 4 1009=over 4
1010
1011=item C<MAKE>
1012
1013The make command to use - default is C<make>.
687 1014
688=item C<MKBUNDLE> 1015=item C<MKBUNDLE>
689 1016
690Where F<staticperl> writes the C<mkbundle> command to 1017Where F<staticperl> writes the C<mkbundle> command to
691(default: F<$STATICPERL/mkbundle>). 1018(default: F<$STATICPERL/mkbundle>).
700=head3 OVERRIDABLE HOOKS 1027=head3 OVERRIDABLE HOOKS
701 1028
702In addition to environment variables, it is possible to provide some 1029In addition to environment variables, it is possible to provide some
703shell functions that are called at specific times. To provide your own 1030shell functions that are called at specific times. To provide your own
704commands, just define the corresponding function. 1031commands, just define the corresponding function.
1032
1033The actual order in which hooks are invoked during a full install
1034from scratch is C<preconfigure>, C<patchconfig>, C<postconfigure>,
1035C<postbuild>, C<postinstall>.
705 1036
706Example: install extra modules from CPAN and from some directories 1037Example: install extra modules from CPAN and from some directories
707at F<staticperl install> time. 1038at F<staticperl install> time.
708 1039
709 postinstall() { 1040 postinstall() {
716 1047
717=over 4 1048=over 4
718 1049
719=item preconfigure 1050=item preconfigure
720 1051
721Called just before running F<./Configur> in the perl source 1052Called just before running F<./Configure> in the perl source
722directory. Current working directory is the perl source directory. 1053directory. Current working directory is the perl source directory.
723 1054
724This can be used to set any C<PERL_xxx> variables, which might be costly 1055This can be used to set any C<PERL_xxx> variables, which might be costly
725to compute. 1056to compute.
726 1057
1058=item patchconfig
1059
1060Called after running F<./Configure> in the perl source directory to create
1061F<./config.sh>, but before running F<./Configure -S> to actually apply the
1062config. Current working directory is the perl source directory.
1063
1064Can be used to tailor/patch F<config.sh> or do any other modifications.
1065
727=item postconfigure 1066=item postconfigure
728 1067
729Called after configuring, but before building perl. Current working 1068Called after configuring, but before building perl. Current working
730directory is the perl source directory. 1069directory is the perl source directory.
731 1070
732Could be used to tailor/patch config.sh (followed by F<sh Configure -S>)
733or do any other modifications.
734
735=item postbuild 1071=item postbuild
736 1072
737Called after building, but before installing perl. Current working 1073Called after building, but before installing perl. Current working
738directory is the perl source directory. 1074directory is the perl source directory.
739 1075
740I have no clue what this could be used for - tell me. 1076I have no clue what this could be used for - tell me.
1077
1078=item postcpanconfig
1079
1080Called just after CPAN has been configured, but before it has been used to
1081install anything. You can further change the configuration like this:
1082
1083 "$PERL_PREFIX"/bin/perl -MCPAN::MyConfig -MCPAN -e '
1084 CPAN::Shell->o (conf => urllist => push => "'"$CPAN"'");
1085 ' || fatal "error while initialising CPAN in postcpanconfig"
741 1086
742=item postinstall 1087=item postinstall
743 1088
744Called after perl and any extra modules have been installed in C<$PREFIX>, 1089Called after perl and any extra modules have been installed in C<$PREFIX>,
745but before setting the "installation O.K." flag. 1090but before setting the "installation O.K." flag.
776A header file that contains the prototypes of the few symbols "exported" 1121A header file that contains the prototypes of the few symbols "exported"
777by bundle.c, and also exposes the perl headers to the application. 1122by bundle.c, and also exposes the perl headers to the application.
778 1123
779=over 4 1124=over 4
780 1125
781=item staticperl_init () 1126=item staticperl_init (xs_init = 0)
782 1127
783Initialises the perl interpreter. You can use the normal perl functions 1128Initialises the perl interpreter. You can use the normal perl functions
784after calling this function, for example, to define extra functions or 1129after calling this function, for example, to define extra functions or
785to load a .pm file that contains some initialisation code, or the main 1130to load a .pm file that contains some initialisation code, or the main
786program function: 1131program function:
793 } 1138 }
794 1139
795 static void 1140 static void
796 run_myapp(void) 1141 run_myapp(void)
797 { 1142 {
798 staticperl_init (); 1143 staticperl_init (0);
799 newXSproto ("myapp::xsfunction", xsfunction, __FILE__, "$$;$"); 1144 newXSproto ("myapp::xsfunction", xsfunction, __FILE__, "$$;$");
800 eval_pv ("require myapp::main", 1); // executes "myapp/main.pm" 1145 eval_pv ("require myapp::main", 1); // executes "myapp/main.pm"
801 } 1146 }
802 1147
1148When your bootcode already wants to access some XS functions at
1149compiletime, then you need to supply an C<xs_init> function pointer that
1150is called as soon as perl is initialised enough to define XS functions,
1151but before the preamble code is executed:
1152
1153 static void
1154 xs_init (pTHX)
1155 {
1156 newXSproto ("myapp::xsfunction", xsfunction, __FILE__, "$$;$");
1157 }
1158
1159 static void
1160 run_myapp(void)
1161 {
1162 staticperl_init (xs_init);
1163 }
1164
1165=item staticperl_cleanup ()
1166
1167In the unlikely case that you want to destroy the perl interpreter, here
1168is the corresponding function.
1169
803=item staticperl_xs_init (pTHX) 1170=item staticperl_xs_init (pTHX)
804 1171
805Sometimes you need direct control over C<perl_parse> and C<perl_run>, in 1172Sometimes you need direct control over C<perl_parse> and C<perl_run>, in
806which case you do not want to use C<staticperl_init> but call them on your 1173which case you do not want to use C<staticperl_init> but call them on your
807own. 1174own.
808 1175
809Then you need this function - either pass it directly as the C<xs_init> 1176Then you need this function - either pass it directly as the C<xs_init>
810function to C<perl_parse>, or call it from your own C<xs_init> function. 1177function to C<perl_parse>, or call it as one of the first things from your
811 1178own C<xs_init> function.
812=item staticperl_cleanup ()
813
814In the unlikely case that you want to destroy the perl interpreter, here
815is the corresponding function.
816 1179
817=item PerlInterpreter *staticperl 1180=item PerlInterpreter *staticperl
818 1181
819The perl interpreter pointer used by staticperl. Not normally so useful, 1182The perl interpreter pointer used by staticperl. Not normally so useful,
820but there it is. 1183but there it is.
833 1196
834=back 1197=back
835 1198
836=head1 RUNTIME FUNCTIONALITY 1199=head1 RUNTIME FUNCTIONALITY
837 1200
838Binaries created with C<mkbundle>/C<mkperl> contain extra functions, which 1201Binaries created with C<mkbundle>/C<mkperl> contain extra functionality,
839are required to access the bundled perl sources, but might be useful for 1202mostly related to the extra files bundled in the binary (the virtual
840other purposes. 1203filesystem). All of this data is statically compiled into the binary, and
1204accessing means copying it from a read-only section of your binary. Data
1205pages in this way are usually freed by the operating system, as they aren't
1206used more then once.
1207
1208=head2 VIRTUAL FILESYSTEM
1209
1210Every bundle has a virtual filesystem. The only information stored in it
1211is the path and contents of each file that was bundled.
1212
1213=head3 LAYOUT
1214
1215Any paths starting with an ampersand (F<&>) or exclamation mark (F<!>) are
1216reserved by F<staticperl>. They must only be used as described in this
1217section.
1218
1219=over 4
1220
1221=item !
1222
1223All files that typically cannot be loaded from memory (such as dynamic
1224objects or shared libraries), but have to reside in the filesystem, are
1225prefixed with F<!>. Typically these files get written out to some
1226(semi-)temporary directory shortly after program startup, or before being
1227used.
1228
1229=item !boot
1230
1231The bootstrap file, if specified during bundling.
1232
1233=item !auto/
1234
1235Shared objects or dlls corresponding to dynamically-linked perl extensions
1236are stored with an F<!auto/> prefix.
1237
1238=item !lib/
1239
1240External shared libraries are stored in this directory.
1241
1242=item any letter
1243
1244Any path starting with a letter is a perl library file. For example,
1245F<Coro/AIO.pm> corresponds to the file loaded by C<use Coro::AIO>, and
1246F<Coro/jit.pl> corresponds to C<require "Coro/jit.pl">.
1247
1248Obviously, module names shouldn't start with any other characters than
1249letters :)
1250
1251=back
1252
1253=head3 FUNCTIONS
1254
1255=over 4
1256
1257=item $file = static::find $path
1258
1259Returns the data associated with the given C<$path>
1260(e.g. C<Digest/MD5.pm>, C<auto/POSIX/autosplit.ix>).
1261
1262Returns C<undef> if the file isn't embedded.
1263
1264=item @paths = static::list
1265
1266Returns the list of all paths embedded in this binary.
1267
1268=back
1269
1270=head2 EXTRA FEATURES
841 1271
842In addition, for the embedded loading of perl files to work, F<staticperl> 1272In addition, for the embedded loading of perl files to work, F<staticperl>
843overrides the C<@INC> array. 1273overrides the C<@INC> array.
844 1274
845=over 4
846
847=item $file = staticperl::find $path
848
849Returns the data associated with the given C<$path>
850(e.g. C<Digest/MD5.pm>, C<auto/POSIX/autosplit.ix>), which is basically
851the UNIX path relative to the perl library directory.
852
853Returns C<undef> if the file isn't embedded.
854
855=item @paths = staticperl::list
856
857Returns the list of all paths embedded in this binary.
858
859=back
860
861=head1 FULLY STATIC BINARIES - BUILDROOT 1275=head1 FULLY STATIC BINARIES - ALPINE LINUX
862 1276
863To make truly static (Linux-) libraries, you might want to have a look at 1277This section once contained a way to build fully static (including
864buildroot (L<http://buildroot.uclibc.org/>). 1278uClibc) binaries with buildroot. Unfortunately, buildroot no longer
1279supports a compiler, so I recommend using alpine linux instead
1280(L<http://alpinelinux.org/>). Get yourself a VM (e.g. with qemu), run an
1281older alpine linux verison in it (e.g. 2.4), copy staticperl inside and
1282use it.
865 1283
866Buildroot is primarily meant to set up a cross-compile environment (which 1284The reason you might want an older alpine linux is that uClibc can be
867is not so useful as perl doesn't quite like cross compiles), but it can also compile 1285quite dependent on kernel versions, so the newest version of alpine linux
868a chroot environment where you can use F<staticperl>. 1286might need a newer kernel then you might want for, if you plan to run your
869 1287binaries on on other kernels.
870To do so, download buildroot, and enable "Build options => development
871files in target filesystem" and optionally "Build options => gcc
872optimization level (optimize for size)". At the time of writing, I had
873good experiences with GCC 4.4.x but not GCC 4.5.
874
875To minimise code size, I used C<-pipe -ffunction-sections -fdata-sections
876-finline-limit=8 -fno-builtin-strlen -mtune=i386>. The C<-mtune=i386>
877doesn't decrease codesize much, but it makes the file much more
878compressible.
879
880If you don't need Coro or threads, you can go with "linuxthreads.old" (or
881no thread support). For Coro, it is highly recommended to switch to a
882uClibc newer than 0.9.31 (at the time of this writing, I used the 20101201
883snapshot) and enable NPTL, otherwise Coro needs to be configured with the
884ultra-slow pthreads backend to work around linuxthreads bugs (it also uses
885twice the address space needed for stacks).
886
887If you use C<linuxthreads.old>, then you should also be aware that
888uClibc shares C<errno> between all threads when statically linking. See
889L<http://lists.uclibc.org/pipermail/uclibc/2010-June/044157.html> for a
890workaround (And L<https://bugs.uclibc.org/2089> for discussion).
891
892C<ccache> support is also recommended, especially if you want
893to play around with buildroot options. Enabling the C<miniperl>
894package will probably enable all options required for a successful
895perl build. F<staticperl> itself additionally needs either C<wget>
896(recommended, for CPAN) or C<curl>.
897
898As for shells, busybox should provide all that is needed, but the default
899busybox configuration doesn't include F<comm> which is needed by perl -
900either make a custom busybox config, or compile coreutils.
901
902For the latter route, you might find that bash has some bugs that keep
903it from working properly in a chroot - either use dash (and link it to
904F</bin/sh> inside the chroot) or link busybox to F</bin/sh>, using it's
905built-in ash shell.
906
907Finally, you need F</dev/null> inside the chroot for many scripts to work
908- F<cp /dev/null output/target/dev> or bind-mounting your F</dev> will
909both provide this.
910
911After you have compiled and set up your buildroot target, you can copy
912F<staticperl> from the C<App::Staticperl> distribution or from your
913perl f<bin> directory (if you installed it) into the F<output/target>
914filesystem, chroot inside and run it.
915 1288
916=head1 RECIPES / SPECIFIC MODULES 1289=head1 RECIPES / SPECIFIC MODULES
917 1290
918This section contains some common(?) recipes and information about 1291This section contains some common(?) recipes and information about
919problems with some common modules or perl constructs that require extra 1292problems with some common modules or perl constructs that require extra
927 1300
928Some functionality in the utf8 module, such as swash handling (used 1301Some functionality in the utf8 module, such as swash handling (used
929for unicode character ranges in regexes) is implemented in the 1302for unicode character ranges in regexes) is implemented in the
930C<"utf8_heavy.pl"> library: 1303C<"utf8_heavy.pl"> library:
931 1304
932 -M'"utf8_heavy.pl"' 1305 -Mutf8_heavy.pl
933 1306
934Many Unicode properties in turn are defined in separate modules, 1307Many Unicode properties in turn are defined in separate modules,
935such as C<"unicore/Heavy.pl"> and more specific data tables such as 1308such as C<"unicore/Heavy.pl"> and more specific data tables such as
936C<"unicore/To/Digit.pl"> or C<"unicore/lib/Perl/Word.pl">. These tables 1309C<"unicore/To/Digit.pl"> or C<"unicore/lib/Perl/Word.pl">. These tables
937are big (7MB uncompressed, although F<staticperl> contains special 1310are big (7MB uncompressed, although F<staticperl> contains special
938handling for those files), so including them on demand by your application 1311handling for those files), so including them only on demand in your
939only might pay off. 1312application might pay off.
940 1313
941To simply include the whole unicode database, use: 1314To simply include the whole unicode database, use:
942 1315
943 --incglob '/unicore/*.pl' 1316 --incglob '/unicore/**.pl'
944 1317
945=item AnyEvent 1318=item AnyEvent
946 1319
947AnyEvent needs a backend implementation that it will load in a delayed 1320AnyEvent needs a backend implementation that it will load in a delayed
948fashion. The L<AnyEvent::Impl::Perl> backend is the default choice 1321fashion. The L<AnyEvent::Impl::Perl> backend is the default choice
953 1326
954If you want to handle IRIs or IDNs (L<AnyEvent::Util> punycode and idn 1327If you want to handle IRIs or IDNs (L<AnyEvent::Util> punycode and idn
955functions), you also need to include C<"AnyEvent/Util/idna.pl"> and 1328functions), you also need to include C<"AnyEvent/Util/idna.pl"> and
956C<"AnyEvent/Util/uts46data.pl">. 1329C<"AnyEvent/Util/uts46data.pl">.
957 1330
1331Or you can use C<--usepacklists> and specify C<-MAnyEvent> to include
1332everything.
1333
1334=item Cairo
1335
1336See Glib, same problem, same solution.
1337
958=item Carp 1338=item Carp
959 1339
960Carp had (in older versions of perl) a dependency on L<Carp::Heavy>. As of 1340Carp had (in older versions of perl) a dependency on L<Carp::Heavy>. As of
961perl 5.12.2 (maybe earlier), this dependency no longer exists. 1341perl 5.12.2 (maybe earlier), this dependency no longer exists.
962 1342
964 1344
965The F<perl -V> switch (as well as many modules) needs L<Config>, which in 1345The F<perl -V> switch (as well as many modules) needs L<Config>, which in
966turn might need L<"Config_heavy.pl">. Including the latter gives you 1346turn might need L<"Config_heavy.pl">. Including the latter gives you
967both. 1347both.
968 1348
1349=item Glib
1350
1351Glib literally requires Glib to be installed already to build - it tries
1352to fake this by running Glib out of the build directory before being
1353built. F<staticperl> tries to work around this by forcing C<MAN1PODS> and
1354C<MAN3PODS> to be empty via the C<PERL_MM_OPT> environment variable.
1355
1356=item Gtk2
1357
1358See Pango, same problems, same solution.
1359
1360=item Net::SSLeay
1361
1362This module hasn't been significantly updated since OpenSSL is called
1363OpenSSL, and fails to properly link against dependent libraries, most
1364commonly, it forgets to specify -ldl when linking.
1365
1366On GNU/Linux systems this usually goes undetected, as perl usually links
1367against -ldl itself and OpenSSL just happens to pick it up that way, by
1368chance.
1369
1370For static builds, you either have to configure -ldl manually, or you
1371cna use the following snippet in your C<postinstall> hook which patches
1372Net::SSLeay after installation, which happens to work most of the time:
1373
1374 postinstall() {
1375 # first install it
1376 instcpan Net::SSLeay
1377 # then add -ldl for future linking
1378 chmod u+w "$PERL_PREFIX"/lib/auto/Net/SSLeay/extralibs.ld
1379 echo " -ldl" >>"$PERL_PREFIX"/lib/auto/Net/SSLeay/extralibs.ld
1380 }
1381
1382=item Pango
1383
1384In addition to the C<MAN3PODS> problem in Glib, Pango also routes around
1385L<ExtUtils::MakeMaker> by compiling its files on its own. F<staticperl>
1386tries to patch L<ExtUtils::MM_Unix> to route around Pango.
1387
969=item Term::ReadLine::Perl 1388=item Term::ReadLine::Perl
970 1389
971Also needs L<Term::ReadLine::readline>. 1390Also needs L<Term::ReadLine::readline>, or C<--usepacklists>.
972 1391
973=item URI 1392=item URI
974 1393
975URI implements schemes as separate modules - the generic URL scheme is 1394URI implements schemes as separate modules - the generic URL scheme is
976implemented in L<URI::_generic>, HTTP is implemented in L<URI::http>. If 1395implemented in L<URI::_generic>, HTTP is implemented in L<URI::http>. If
977you need to use any of these schemes, you should include these manually. 1396you need to use any of these schemes, you should include these manually,
1397or use C<--usepacklists>.
978 1398
979=back 1399=back
980 1400
981=head2 RECIPES 1401=head2 RECIPES
982 1402
983=over 4 1403=over 4
984 1404
985=item Linking everything in 1405=item Just link everything in
986 1406
987To link just about everything installed in the perl library into a new 1407To link just about everything installed in the perl library into a new
988perl, try this: 1408perl, try this (the first time this runs it will take a long time, as a
1409lot of files need to be parsed):
989 1410
990 staticperl mkperl --strip ppi --incglob '*' 1411 staticperl mkperl -v --strip ppi --incglob '*'
991 1412
1413If you don't mind the extra megabytes, this can be a very effective way of
1414creating bundles without having to worry about forgetting any modules.
1415
1416You get even more useful variants of this method by first selecting
1417everything, and then excluding stuff you are reasonable sure not to need -
1418L<bigperl|http://staticperl.schmorp.de/bigperl.html> uses this approach.
1419
992=item Getting rid of netdb function 1420=item Getting rid of netdb functions
993 1421
994The perl core has lots of netdb functions (C<getnetbyname>, C<getgrent> 1422The perl core has lots of netdb functions (C<getnetbyname>, C<getgrent>
995and so on) that few applications use. You can avoid compiling them in by 1423and so on) that few applications use. You can avoid compiling them in by
996putting the following fragment into a C<preconfigure> hook: 1424putting the following fragment into a C<preconfigure> hook:
997 1425
1014 do 1442 do
1015 PERL_CONFIGURE="$PERL_CONFIGURE -U$sym" 1443 PERL_CONFIGURE="$PERL_CONFIGURE -U$sym"
1016 done 1444 done
1017 } 1445 }
1018 1446
1019This mostly gains space when linking staticaly, as the functions will 1447This mostly gains space when linking statically, as the functions will
1020liekly not be linked in. The gain for dynamically-linked binaries is 1448likely not be linked in. The gain for dynamically-linked binaries is
1021smaller. 1449smaller.
1022 1450
1023Also, this leaves C<gethostbyname> in - not only is it actually used 1451Also, this leaves C<gethostbyname> in - not only is it actually used
1024often, the L<Socket> module also exposes it, so leaving it out usually 1452often, the L<Socket> module also exposes it, so leaving it out usually
1025gains little. Why Socket exposes a C function that is in the core already 1453gains little. Why Socket exposes a C function that is in the core already
1026is anybody's guess. 1454is anybody's guess.
1027 1455
1028=back 1456=back
1029 1457
1458=head1 ADDITIONAL RESOURCES
1459
1460Some guy has made a repository on github
1461(L<https://github.com/gh0stwizard/staticperl-modules>) with some modules
1462patched to build with staticperl.
1463
1030=head1 AUTHOR 1464=head1 AUTHOR
1031 1465
1032 Marc Lehmann <schmorp@schmorp.de> 1466 Marc Lehmann <schmorp@schmorp.de>
1033 http://software.schmorp.de/pkg/staticperl.html 1467 http://software.schmorp.de/pkg/staticperl.html
1468

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines