ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/App-Staticperl/staticperl.pod
(Generate patch)

Comparing App-Staticperl/staticperl.pod (file contents):
Revision 1.15 by root, Wed Dec 8 23:01:30 2010 UTC vs.
Revision 1.64 by root, Thu Mar 21 16:41:36 2019 UTC

1=head1 NAME 1=head1 NAME
2 2
3staticperl - perl, libc, 100 modules, all in one 500kb file 3staticperl - perl, libc, 100 modules, all in one standalone 500kb file
4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 staticperl help # print the embedded documentation 7 staticperl help # print the embedded documentation
8 staticperl fetch # fetch and unpack perl sources 8 staticperl fetch # fetch and unpack perl sources
9 staticperl configure # fetch and then configure perl 9 staticperl configure # fetch and then configure perl
10 staticperl build # configure and then build perl 10 staticperl build # configure and then build perl
11 staticperl install # build and then install perl 11 staticperl install # build and then install perl
12 staticperl clean # clean most intermediate files (restart at configure) 12 staticperl clean # clean most intermediate files (restart at configure)
13 staticperl distclean # delete everything installed by this script 13 staticperl distclean # delete everything installed by this script
14 staticperl perl ... # invoke the perlinterpreter
14 staticperl cpan # invoke CPAN shell 15 staticperl cpan # invoke CPAN shell
15 staticperl instmod path... # install unpacked modules 16 staticperl instsrc path... # install unpacked modules
16 staticperl instcpan modulename... # install modules from CPAN 17 staticperl instcpan modulename... # install modules from CPAN
17 staticperl mkbundle <bundle-args...> # see documentation 18 staticperl mkbundle <bundle-args...> # see documentation
18 staticperl mkperl <bundle-args...> # see documentation 19 staticperl mkperl <bundle-args...> # see documentation
19 staticperl mkapp appname <bundle-args...> # see documentation 20 staticperl mkapp appname <bundle-args...> # see documentation
20 21
21Typical Examples: 22Typical Examples:
22 23
23 staticperl install # fetch, configure, build and install perl 24 staticperl install # fetch, configure, build and install perl
24 staticperl cpan # run interactive cpan shell 25 staticperl cpan # run interactive cpan shell
25 staticperl mkperl -M '"Config_heavy.pl"' # build a perl that supports -V 26 staticperl mkperl -MConfig_heavy.pl # build a perl that supports -V
26 staticperl mkperl -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI -MURI::http 27 staticperl mkperl -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI -MURI::http
27 # build a perl with the above modules linked in 28 # build a perl with the above modules linked in
28 staticperl mkapp myapp --boot mainprog mymodules 29 staticperl mkapp myapp --boot mainprog mymodules
29 # build a binary "myapp" from mainprog and mymodules 30 # build a binary "myapp" from mainprog and mymodules
30 31
31=head1 DESCRIPTION 32=head1 DESCRIPTION
32 33
33This script helps you creating single-file perl interpreters, or embedding 34This script helps you to create single-file perl interpreters
34a perl interpreter in your applications. Single-file means that it is 35or applications, or embedding a perl interpreter in your
35fully self-contained - no separate shared objects, no autoload fragments, 36applications. Single-file means that it is fully self-contained - no
36no .pm or .pl files are needed. And when linking statically, you can 37separate shared objects, no autoload fragments, no .pm or .pl files are
37create (or embed) a single file that contains perl interpreter, libc, all 38needed. And when linking statically, you can create (or embed) a single
38the modules you need and all the libraries you need. 39file that contains perl interpreter, libc, all the modules you need, all
40the libraries you need and of course your actual program.
39 41
40With F<uClibc> and F<upx> on x86, you can create a single 500kb binary 42With F<uClibc> and F<upx> on x86, you can create a single 500kb binary
41that contains perl and 100 modules such as POSIX, AnyEvent, EV, IO::AIO, 43that contains perl and 100 modules such as POSIX, AnyEvent, EV, IO::AIO,
42Coro and so on. Or any other choice of modules. 44Coro and so on. Or any other choice of modules (and some other size :).
45
46To see how this turns out, you can try out smallperl and bigperl, two
47pre-built static and compressed perl binaries with many and even more
48modules: just follow the links at L<http://staticperl.schmorp.de/>.
43 49
44The created files do not need write access to the file system (like PAR 50The created files do not need write access to the file system (like PAR
45does). In fact, since this script is in many ways similar to PAR::Packer, 51does). In fact, since this script is in many ways similar to PAR::Packer,
46here are the differences: 52here are the differences:
47 53
66=item * The generated executables don't need a writable filesystem. 72=item * The generated executables don't need a writable filesystem.
67 73
68F<staticperl> loads all required files directly from memory. There is no 74F<staticperl> loads all required files directly from memory. There is no
69need to unpack files into a temporary directory. 75need to unpack files into a temporary directory.
70 76
71=item * More control over included files. 77=item * More control over included files, more burden.
72 78
73PAR tries to be maintenance and hassle-free - it tries to include more 79PAR tries to be maintenance and hassle-free - it tries to include more
74files than necessary to make sure everything works out of the box. The 80files than necessary to make sure everything works out of the box. It
75extra files (such as the unicode database) can take substantial amounts of 81mostly succeeds at this, but he extra files (such as the unicode database)
76memory and file size. 82can take substantial amounts of memory and file size.
77 83
78With F<staticperl>, the burden is mostly with the developer - only direct 84With F<staticperl>, the burden is mostly with the developer - only direct
79compile-time dependencies and L<AutoLoader> are handled automatically. 85compile-time dependencies and L<AutoLoader> are handled automatically.
80This means the modules to include often need to be tweaked manually. 86This means the modules to include often need to be tweaked manually.
87
88All this does not preclude more permissive modes to be implemented in
89the future, but right now, you have to resolve hidden dependencies
90manually.
81 91
82=item * PAR works out of the box, F<staticperl> does not. 92=item * PAR works out of the box, F<staticperl> does not.
83 93
84Maintaining your own custom perl build can be a pain in the ass, and while 94Maintaining your own custom perl build can be a pain in the ass, and while
85F<staticperl> tries to make this easy, it still requires a custom perl 95F<staticperl> tries to make this easy, it still requires a custom perl
106Afterwards, you create a list of files and modules you want to include, 116Afterwards, you create a list of files and modules you want to include,
107and then either build a new perl binary (that acts just like a normal perl 117and then either build a new perl binary (that acts just like a normal perl
108except everything is compiled in), or you create bundle files (basically C 118except everything is compiled in), or you create bundle files (basically C
109sources you can use to embed all files into your project). 119sources you can use to embed all files into your project).
110 120
111This step is very fast (a few seconds if PPI is not used for stripping, 121This step is very fast (a few seconds if PPI is not used for stripping, or
112more seconds otherwise, as PPI is very slow), and can be tweaked and 122the stripped files are in the cache), and can be tweaked and repeated as
113repeated as often as necessary. 123often as necessary.
114 124
115=head1 THE F<STATICPERL> SCRIPT 125=head1 THE F<STATICPERL> SCRIPT
116 126
117This module installs a script called F<staticperl> into your perl 127This module installs a script called F<staticperl> into your perl
118binary directory. The script is fully self-contained, and can be used 128binary directory. The script is fully self-contained, and can be
119without perl (for example, in an uClibc chroot environment). In fact, 129used without perl (for example, in an uClibc chroot environment). In
120it can be extracted from the C<App::Staticperl> distribution tarball as 130fact, it can be extracted from the C<App::Staticperl> distribution
121F<bin/staticperl>, without any installation. 131tarball as F<bin/staticperl>, without any installation. The
132newest (possibly alpha) version can also be downloaded from
133L<http://staticperl.schmorp.de/staticperl>.
122 134
123F<staticperl> interprets the first argument as a command to execute, 135F<staticperl> interprets the first argument as a command to execute,
124optionally followed by any parameters. 136optionally followed by any parameters.
125 137
126There are two command categories: the "phase 1" commands which deal with 138There are two command categories: the "phase 1" commands which deal with
128with creating binaries and bundle files. 140with creating binaries and bundle files.
129 141
130=head2 PHASE 1 COMMANDS: INSTALLING PERL 142=head2 PHASE 1 COMMANDS: INSTALLING PERL
131 143
132The most important command is F<install>, which does basically 144The most important command is F<install>, which does basically
133everything. The default is to download and install perl 5.12.2 and a few 145everything. The default is to download and install perl 5.12.3 and a few
134modules required by F<staticperl> itself, but all this can (and should) be 146modules required by F<staticperl> itself, but all this can (and should) be
135changed - see L<CONFIGURATION>, below. 147changed - see L<CONFIGURATION>, below.
136 148
137The command 149The command
138 150
139 staticperl install 151 staticperl install
140 152
141Is normally all you need: It installs the perl interpreter in 153is normally all you need: It installs the perl interpreter in
142F<~/.staticperl/perl>. It downloads, configures, builds and installs the 154F<~/.staticperl/perl>. It downloads, configures, builds and installs the
143perl interpreter if required. 155perl interpreter if required.
144 156
145Most of the following commands simply run one or more steps of this 157Most of the following F<staticperl> subcommands simply run one or more
146sequence. 158steps of this sequence.
159
160If it fails, then most commonly because the compiler options I selected
161are not supported by your compiler - either edit the F<staticperl> script
162yourself or create F<~/.staticperl> shell script where your set working
163C<PERL_CCFLAGS> etc. variables.
147 164
148To force recompilation or reinstallation, you need to run F<staticperl 165To force recompilation or reinstallation, you need to run F<staticperl
149distclean> first. 166distclean> first.
150 167
151=over 4 168=over 4
152 169
170=item F<staticperl version>
171
172Prints some info about the version of the F<staticperl> script you are using.
173
153=item F<staticperl fetch> 174=item F<staticperl fetch>
154 175
155Runs only the download and unpack phase, unless this has already happened. 176Runs only the download and unpack phase, unless this has already happened.
156 177
157=item F<staticperl configure> 178=item F<staticperl configure>
165 186
166=item F<staticperl install> 187=item F<staticperl install>
167 188
168Wipes the perl installation directory (usually F<~/.staticperl/perl>) and 189Wipes the perl installation directory (usually F<~/.staticperl/perl>) and
169installs the perl distribution, potentially after building it first. 190installs the perl distribution, potentially after building it first.
191
192=item F<staticperl perl> [args...]
193
194Invokes the compiled perl interpreter with the given args. Basically the
195same as starting perl directly (usually via F<~/.staticperl/bin/perl>),
196but beats typing the path sometimes.
197
198Example: check that the Gtk2 module is installed and loadable.
199
200 staticperl perl -MGtk2 -e0
170 201
171=item F<staticperl cpan> [args...] 202=item F<staticperl cpan> [args...]
172 203
173Starts an interactive CPAN shell that you can use to install further 204Starts an interactive CPAN shell that you can use to install further
174modules. Installs the perl first if necessary, but apart from that, 205modules. Installs the perl first if necessary, but apart from that,
175no magic is involved: you could just as well run it manually via 206no magic is involved: you could just as well run it manually via
176F<~/.staticperl/perl/bin/cpan>. 207F<~/.staticperl/perl/bin/cpan>, except that F<staticperl> additionally
208sets the environment variable C<$PERL> to the path of the perl
209interpreter, which is handy in subshells.
177 210
178Any additional arguments are simply passed to the F<cpan> command. 211Any additional arguments are simply passed to the F<cpan> command.
179 212
180=item F<staticperl instcpan> module... 213=item F<staticperl instcpan> module...
181 214
194 227
195=item F<staticperl clean> 228=item F<staticperl clean>
196 229
197Deletes the perl source directory (and potentially cleans up other 230Deletes the perl source directory (and potentially cleans up other
198intermediate files). This can be used to clean up files only needed for 231intermediate files). This can be used to clean up files only needed for
199building perl, without removing the installed perl interpreter, or to 232building perl, without removing the installed perl interpreter.
200force a re-build from scratch.
201 233
202At the moment, it doesn't delete downloaded tarballs. 234At the moment, it doesn't delete downloaded tarballs.
235
236The exact semantics of this command will probably change.
203 237
204=item F<staticperl distclean> 238=item F<staticperl distclean>
205 239
206This wipes your complete F<~/.staticperl> directory. Be careful with this, 240This wipes your complete F<~/.staticperl> directory. Be careful with this,
207it nukes your perl download, perl sources, perl distribution and any 241it nukes your perl download, perl sources, perl distribution and any
231 265
232 # first make sure we have perl and the required modules 266 # first make sure we have perl and the required modules
233 staticperl instcpan AnyEvent::HTTPD 267 staticperl instcpan AnyEvent::HTTPD
234 268
235 # now build the perl 269 # now build the perl
236 staticperl mkperl -M'"Config_heavy.pl"' -MAnyEvent::Impl::Perl \ 270 staticperl mkperl -MConfig_heavy.pl -MAnyEvent::Impl::Perl \
237 -MAnyEvent::HTTPD -MURI::http \ 271 -MAnyEvent::HTTPD -MURI::http \
238 --add 'eg/httpd httpd.pm' 272 --add 'eg/httpd httpd.pm'
239 273
240 # finally, invoke it 274 # finally, invoke it
241 ./perl -Mhttpd 275 ./perl -Mhttpd
257 -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI::http 291 -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI::http
258 292
259 # run it 293 # run it
260 ./app 294 ./app
261 295
296Here are the three phase 2 commands:
297
298=over 4
299
300=item F<staticperl mkbundle> args...
301
302The "default" bundle command - it interprets the given bundle options and
303writes out F<bundle.h>, F<bundle.c>, F<bundle.ccopts> and F<bundle.ldopts>
304files, useful for embedding.
305
306=item F<staticperl mkperl> args...
307
308Creates a bundle just like F<staticperl mkbundle> (in fact, it's the same
309as invoking F<staticperl mkbundle --perl> args...), but then compiles and
310links a new perl interpreter that embeds the created bundle, then deletes
311all intermediate files.
312
313=item F<staticperl mkapp> filename args...
314
315Does the same as F<staticperl mkbundle> (in fact, it's the same as
316invoking F<staticperl mkbundle --app> filename args...), but then compiles
317and links a new standalone application that simply initialises the perl
318interpreter.
319
320The difference to F<staticperl mkperl> is that the standalone application
321does not act like a perl interpreter would - in fact, by default it would
322just do nothing and exit immediately, so you should specify some code to
323be executed via the F<--boot> option.
324
325=back
326
262=head3 OPTION PROCESSING 327=head3 OPTION PROCESSING
263 328
264All options can be given as arguments on the command line (typically 329All options can be given as arguments on the command line (typically
265using long (e.g. C<--verbose>) or short option (e.g. C<-v>) style). Since 330using long (e.g. C<--verbose>) or short option (e.g. C<-v>) style). Since
266specifying a lot of modules can make the command line very cumbersome, 331specifying a lot of options can make the command line very long and
267you can put all long options into a "bundle specification file" (with or 332unwieldy, you can put all long options into a "bundle specification file"
268without C<--> prefix) and specify this bundle file instead. 333(one option per line, with or without C<--> prefix) and specify this
334bundle file instead.
269 335
270For example, the command given earlier could also look like this: 336For example, the command given earlier to link a new F<perl> could also
337look like this:
271 338
272 staticperl mkperl httpd.bundle 339 staticperl mkperl httpd.bundle
273 340
274And all options could be in F<httpd.bundle>: 341With all options stored in the F<httpd.bundle> file (one option per line,
275 342everything after the option is an argument):
343
276 use "Config_heavy.pl" 344 use "Config_heavy.pl"
277 use AnyEvent::Impl::Perl 345 use AnyEvent::Impl::Perl
278 use AnyEvent::HTTPD 346 use AnyEvent::HTTPD
279 use URI::http 347 use URI::http
280 add eg/httpd httpd.pm 348 add eg/httpd httpd.pm
281 349
282All options that specify modules or files to be added are processed in the 350All options that specify modules or files to be added are processed in the
283order given on the command line (that affects the C<--use> and C<--eval> 351order given on the command line.
284options at the moment).
285 352
286=head3 MKBUNDLE OPTIONS 353=head3 BUNDLE CREATION WORKFLOW / STATICPERL MKBUNDLE OPTIONS
287 354
288=over 4 355F<staticperl mkbundle> works by first assembling a list of candidate
356files and modules to include, then filtering them by include/exclude
357patterns. The remaining modules (together with their direct dependencies,
358such as link libraries and L<AutoLoader> files) are then converted into
359bundle files suitable for embedding. F<staticperl mkbundle> can then
360optionally build a new perl interpreter or a standalone application.
289 361
362=over 4
363
364=item Step 0: Generic argument processing.
365
366The following options influence F<staticperl mkbundle> itself.
367
368=over 4
369
290=item --verbose | -v 370=item C<--verbose> | C<-v>
291 371
292Increases the verbosity level by one (the default is C<1>). 372Increases the verbosity level by one (the default is C<1>).
293 373
294=item --quiet | -q 374=item C<--quiet> | C<-q>
295 375
296Decreases the verbosity level by one. 376Decreases the verbosity level by one.
297 377
378=item any other argument
379
380Any other argument is interpreted as a bundle specification file, which
381supports all options (without extra quoting), one option per line, in the
382format C<option> or C<option argument>. They will effectively be expanded
383and processed as if they were directly written on the command line, in
384place of the file name.
385
386=back
387
388=item Step 1: gather candidate files and modules
389
390In this step, modules, perl libraries (F<.pl> files) and other files are
391selected for inclusion in the bundle. The relevant options are executed
392in order (this makes a difference mostly for C<--eval>, which can rely on
393earlier C<--use> options to have been executed).
394
395=over 4
396
397=item C<--use> F<module> | C<-M>F<module>
398
399Include the named module or perl library and trace direct
400dependencies. This is done by loading the module in a subprocess and
401tracing which other modules and files it actually loads.
402
403Example: include AnyEvent and AnyEvent::Impl::Perl.
404
405 staticperl mkbundle --use AnyEvent --use AnyEvent::Impl::Perl
406
407Sometimes you want to load old-style "perl libraries" (F<.pl> files), or
408maybe other weirdly named files. To support this, the C<--use> option
409actually tries to do what you mean, depending on the string you specify:
410
411=over 4
412
413=item a possibly valid module name, e.g. F<common::sense>, F<Carp>,
414F<Coro::Mysql>.
415
416If the string contains no quotes, no F</> and no F<.>, then C<--use>
417assumes that it is a normal module name. It will create a new package and
418evaluate a C<use module> in it, i.e. it will load the package and do a
419default import.
420
421The import step is done because many modules trigger more dependencies
422when something is imported than without.
423
424=item anything that contains F</> or F<.> characters,
425e.g. F<utf8_heavy.pl>, F<Module/private/data.pl>.
426
427The string will be quoted and passed to require, as if you used C<require
428$module>. Nothing will be imported.
429
430=item "path" or 'path', e.g. C<"utf8_heavy.pl">.
431
432If you enclose the name into single or double quotes, then the quotes will
433be removed and the resulting string will be passed to require. This syntax
434is form compatibility with older versions of staticperl and should not be
435used anymore.
436
437=back
438
439Example: C<use> AnyEvent::Socket, once using C<use> (importing the
440symbols), and once via C<require>, not importing any symbols. The first
441form is preferred as many modules load some extra dependencies when asked
442to export symbols.
443
444 staticperl mkbundle -MAnyEvent::Socket # use + import
445 staticperl mkbundle -MAnyEvent/Socket.pm # require only
446
447Example: include the required files for F<perl -V> to work in all its
448glory (F<Config.pm> is included automatically by the dependency tracker).
449
450 # shell command
451 staticperl mkbundle -MConfig_heavy.pl
452
453 # bundle specification file
454 use Config_heavy.pl
455
456The C<-M>module syntax is included as a convenience that might be easier
457to remember than C<--use> - it's the same switch as perl itself uses
458to load modules. Or maybe it confuses people. Time will tell. Or maybe
459not. Sigh.
460
461=item C<--eval> "perl code" | C<-e> "perl code"
462
463Sometimes it is easier (or necessary) to specify dependencies using perl
464code, or maybe one of the modules you use need a special use statement. In
465that case, you can use C<--eval> to execute some perl snippet or set some
466variables or whatever you need. All files C<require>'d or C<use>'d while
467executing the snippet are included in the final bundle.
468
469Keep in mind that F<mkbundle> will not import any symbols from the modules
470named by the C<--use> option, so do not expect the symbols from modules
471you C<--use>'d earlier on the command line to be available.
472
473Example: force L<AnyEvent> to detect a backend and therefore include it
474in the final bundle.
475
476 staticperl mkbundle --eval 'use AnyEvent; AnyEvent::detect'
477
478 # or like this
479 staticperl mkbundle -MAnyEvent --eval 'AnyEvent::detect'
480
481Example: use a separate "bootstrap" script that C<use>'s lots of modules
482and also include this in the final bundle, to be executed automatically
483when the interpreter is initialised.
484
485 staticperl mkbundle --eval 'do "bootstrap"' --boot bootstrap
486
487=item C<--boot> F<filename>
488
489Include the given file in the bundle and arrange for it to be
490executed (using C<require>) before the main program when the new perl
491is initialised. This can be used to modify C<@INC> or do similar
492modifications before the perl interpreter executes scripts given on the
493command line (or via C<-e>). This works even in an embedded interpreter -
494the file will be executed during interpreter initialisation in that case.
495
496=item C<--incglob> pattern
497
498This goes through all standard library directories and tries to match any
499F<.pm> and F<.pl> files against the extended glob pattern (see below). If
500a file matches, it is added. The pattern is matched against the full path
501of the file (sans the library directory prefix), e.g. F<Sys/Syslog.pm>.
502
503This is very useful to include "everything":
504
505 --incglob '*'
506
507It is also useful for including perl libraries, or trees of those, such as
508the unicode database files needed by some perl built-ins, the regex engine
509and other modules.
510
511 --incglob '/unicore/**.pl'
512
513=item C<--add> F<file> | C<--add> "F<file> alias"
514
515Adds the given (perl) file into the bundle (and optionally call it
516"alias"). The F<file> is either an absolute path or a path relative to the
517current directory. If an alias is specified, then this is the name it will
518use for C<@INC> searches, otherwise the path F<file> will be used as the
519internal name.
520
521This switch is used to include extra files into the bundle.
522
523Example: embed the file F<httpd> in the current directory as F<httpd.pm>
524when creating the bundle.
525
526 staticperl mkperl --add "httpd httpd.pm"
527
528 # can be accessed via "use httpd"
529
530Example: add a file F<initcode> from the current directory.
531
532 staticperl mkperl --add 'initcode &initcode'
533
534 # can be accessed via "do '&initcode'"
535
536Example: add local files as extra modules in the bundle.
537
538 # specification file
539 add file1 myfiles/file1.pm
540 add file2 myfiles/file2.pm
541 add file3 myfiles/file3.pl
542
543 # then later, in perl, use
544 use myfiles::file1;
545 require myfiles::file2;
546 my $res = do "myfiles/file3.pl";
547
548=item C<--addbin> F<file> | C<--addbin> "F<file> alias"
549
550Just like C<--add>, except that it treats the file as binary and adds it
551without any postprocessing (perl files might get stripped to reduce their
552size).
553
554If you specify an alias you should probably add a C</> prefix to avoid
555clashing with embedded perl files (whose paths never start with C</>),
556and/or use a special directory prefix, such as C</res/name>.
557
558You can later get a copy of these files by calling C<static::find
559"alias">.
560
561An alternative way to embed binary files is to convert them to perl and
562use C<do> to get the contents - this method is a bit cumbersome, but works
563both inside and outside of a staticperl bundle, without extra ado:
564
565 # a "binary" file, call it "bindata.pl"
566 <<'SOME_MARKER'
567 binary data NOT containing SOME_MARKER
568 SOME_MARKER
569
570 # load the binary
571 chomp (my $data = do "bindata.pl");
572
573=item C<--allow-dynamic>
574
575By default, when F<mkbundle> hits a dynamic perl extension (e.g. a F<.so>
576or F<.dll> file), it will stop with a fatal error.
577
578When this option is enabled, F<mkbundle> packages the shared
579object into the bundle instead, with a prefix of F<!>
580(e.g. F<!auto/List/Util/Util.so>). What you do with that is currently up
581to you, F<staticperl> has no special support for this at the moment, apart
582from working around the lack of availability of F<PerlIO::scalar> while
583bootstrapping, at a speed cost.
584
585One way to deal with this is to write all files starting with F<!> into
586some directory and then C<unshift> that path onto C<@INC>.
587
588#TODO: example
589
590=back
591
592=item Step 2: filter all files using C<--include> and C<--exclude> options.
593
594After all candidate files and modules are added, they are I<filtered>
595by a combination of C<--include> and C<--exclude> patterns (there is an
596implicit C<--include *> at the end, so if no filters are specified, all
597files are included).
598
599All that this step does is potentially reduce the number of files that are
600to be included - no new files are added during this step.
601
602=over 4
603
604=item C<--include> pattern | C<-i> pattern | C<--exclude> pattern | C<-x> pattern
605
606These specify an include or exclude pattern to be applied to the candidate
607file list. An include makes sure that the given files will be part of the
608resulting file set, an exclude will exclude remaining files. The patterns
609are "extended glob patterns" (see below).
610
611The patterns are applied "in order" - files included via earlier
612C<--include> specifications cannot be removed by any following
613C<--exclude>, and likewise, and file excluded by an earlier C<--exclude>
614cannot be added by any following C<--include>.
615
616For example, to include everything except C<Devel> modules, but still
617include F<Devel::PPPort>, you could use this:
618
619 --incglob '*' -i '/Devel/PPPort.pm' -x '/Devel/**'
620
621=back
622
623=item Step 3: add any extra or "hidden" dependencies.
624
625F<staticperl> currently knows about three extra types of depdendencies
626that are added automatically. Only one (F<.packlist> files) is currently
627optional and can be influenced, the others are always included:
628
629=over 4
630
631=item C<--usepacklists>
632
633Read F<.packlist> files for each distribution that happens to match a
634module name you specified. Sounds weird, and it is, so expect semantics to
635change somehow in the future.
636
637The idea is that most CPAN distributions have a F<.pm> file that matches
638the name of the distribution (which is rather reasonable after all).
639
640If this switch is enabled, then if any of the F<.pm> files that have been
641selected match an install distribution, then all F<.pm>, F<.pl>, F<.al>
642and F<.ix> files installed by this distribution are also included.
643
644For example, using this switch, when the L<URI> module is specified, then
645all L<URI> submodules that have been installed via the CPAN distribution
646are included as well, so you don't have to manually specify them.
647
648=item L<AutoLoader> splitfiles
649
650Some modules use L<AutoLoader> - less commonly (hopefully) used functions
651are split into separate F<.al> files, and an index (F<.ix>) file contains
652the prototypes.
653
654Both F<.ix> and F<.al> files will be detected automatically and added to
655the bundle.
656
657=item link libraries (F<.a> files)
658
659Modules using XS (or any other non-perl language extension compiled at
660installation time) will have a static archive (typically F<.a>). These
661will automatically be added to the linker options in F<bundle.ldopts>.
662
663Should F<staticperl> find a dynamic link library (typically F<.so>) it
664will warn about it - obviously this shouldn't happen unless you use
665F<staticperl> on the wrong perl, or one (probably wrongly) configured to
666use dynamic loading.
667
668=item extra libraries (F<extralibs.ld>)
669
670Some modules need linking against external libraries - these are found in
671F<extralibs.ld> and added to F<bundle.ldopts>.
672
673=back
674
675=item Step 4: write bundle files and optionally link a program
676
677At this point, the select files will be read, processed (stripped) and
678finally the bundle files get written to disk, and F<staticperl mkbundle>
679is normally finished. Optionally, it can go a step further and either link
680a new F<perl> binary with all selected modules and files inside, or build
681a standalone application.
682
683Both the contents of the bundle files and any extra linking is controlled
684by these options:
685
686=over 4
687
298=item --strip none|pod|ppi 688=item C<--strip> C<none>|C<pod>|C<ppi>
299 689
300Specify the stripping method applied to reduce the file of the perl 690Specify the stripping method applied to reduce the file of the perl
301sources included. 691sources included.
302 692
303The default is C<pod>, which uses the L<Pod::Strip> module to remove all 693The default is C<pod>, which uses the L<Pod::Strip> module to remove all
304pod documentation, which is very fast and reduces file size a lot. 694pod documentation, which is very fast and reduces file size a lot.
305 695
306The C<ppi> method uses L<PPI> to parse and condense the perl sources. This 696The C<ppi> method uses L<PPI> to parse and condense the perl sources. This
307saves a lot more than just L<Pod::Strip>, and is generally safer, but 697saves a lot more than just L<Pod::Strip>, and is generally safer,
308is also a lot slower, so is best used for production builds. Note that 698but is also a lot slower (some files take almost a minute to strip -
309this method doesn't optimise for raw file size, but for best compression 699F<staticperl> maintains a cache of stripped files to speed up subsequent
310(that means that the uncompressed file size is a bit larger, but the files 700runs for this reason). Note that this method doesn't optimise for raw file
311compress better, e.g. with F<upx>). 701size, but for best compression (that means that the uncompressed file size
702is a bit larger, but the files compress better, e.g. with F<upx>).
312 703
313Last not least, if you need accurate line numbers in error messages, 704Last not least, if you need accurate line numbers in error messages,
314or in the unlikely case where C<pod> is too slow, or some module gets 705or in the unlikely case where C<pod> is too slow, or some module gets
315mistreated, you can specify C<none> to not mangle included perl sources in 706mistreated, you can specify C<none> to not mangle included perl sources in
316any way. 707any way.
317 708
318=item --perl 709=item C<--perl>
319 710
320After writing out the bundle files, try to link a new perl interpreter. It 711After writing out the bundle files, try to link a new perl interpreter. It
321will be called F<perl> and will be left in the current working 712will be called F<perl> and will be left in the current working
322directory. The bundle files will be removed. 713directory. The bundle files will be removed.
323 714
324This switch is automatically used when F<staticperl> is invoked with the 715This switch is automatically used when F<staticperl> is invoked with the
325C<mkperl> command (instead of C<mkbundle>): 716C<mkperl> command instead of C<mkbundle>.
326 717
327 # build a new ./perl with only common::sense in it - very small :) 718Example: build a new F<./perl> binary with only L<common::sense> inside -
719it will be even smaller than the standard perl interpreter as none of the
720modules of the base distribution (such as L<Fcntl>) will be included.
721
328 staticperl mkperl -Mcommon::sense 722 staticperl mkperl -Mcommon::sense
329 723
330=item --app name 724=item C<--app> F<name>
331 725
332After writing out the bundle files, try to link a new standalone 726After writing out the bundle files, try to link a new standalone
333program. It will be called C<name>, and the bundle files get removed after 727program. It will be called C<name>, and the bundle files get removed after
334linking it. 728linking it.
729
730This switch is automatically used when F<staticperl> is invoked with the
731C<mkapp> command instead of C<mkbundle>.
335 732
336The difference to the (mutually exclusive) C<--perl> option is that the 733The difference to the (mutually exclusive) C<--perl> option is that the
337binary created by this option will not try to act as a perl interpreter - 734binary created by this option will not try to act as a perl interpreter -
338instead it will simply initialise the perl interpreter, clean it up and 735instead it will simply initialise the perl interpreter, clean it up and
339exit. 736exit.
340 737
341This switch is automatically used when F<staticperl> is invoked with the 738This means that, by default, it will do nothing but burn a few CPU cycles
342C<mkapp> command (instead of C<mkbundle>):
343
344To let it do something useful you I<must> add some boot code, e.g. with 739- for it to do something useful you I<must> add some boot code, e.g. with
345the C<--boot> option. 740the C<--boot> option.
346 741
347Example: create a standalone perl binary that will execute F<appfile> when 742Example: create a standalone perl binary called F<./myexe> that will
348it is started. 743execute F<appfile> when it is started.
349 744
350 staticperl mkbundle --app myexe --boot appfile 745 staticperl mkbundle --app myexe --boot appfile
351 746
352=item --use module | -Mmodule 747=item C<--ignore-env>
353 748
354Include the named module and all direct dependencies. This is done by 749Generates extra code to unset some environment variables before
355C<require>'ing the module in a subprocess and tracing which other modules 750initialising/running perl. Perl supports a lot of environment variables
356and files it actually loads. If the module uses L<AutoLoader>, then all 751that might alter execution in ways that might be undesirablre for
357splitfiles will be included as well. 752standalone applications, and this option removes those known to cause
753trouble.
358 754
359Example: include AnyEvent and AnyEvent::Impl::Perl. 755Specifically, these are removed:
360 756
361 staticperl mkbundle --use AnyEvent --use AnyEvent::Impl::Perl 757C<PERL_HASH_SEED_DEBUG> and C<PERL_DEBUG_MSTATS> can cause undesirable
758output, C<PERL5OPT>, C<PERL_DESTRUCT_LEVEL>, C<PERL_HASH_SEED> and
759C<PERL_SIGNALS> can alter execution significantly, and C<PERL_UNICODE>,
760C<PERLIO_DEBUG> and C<PERLIO> can affect input and output.
362 761
363Sometimes you want to load old-style "perl libraries" (F<.pl> files), or 762The variables C<PERL_LIB> and C<PERL5_LIB> are always ignored because the
364maybe other weirdly named files. To do that, you need to quote the name in 763startup code used by F<staticperl> overrides C<@INC> in all cases.
365single or double quotes. When given on the command line, you probably need
366to quote once more to avoid your shell interpreting it. Common cases that
367need this are F<Config_heavy.pl> and F<utf8_heavy.pl>.
368 764
369Example: include the required files for F<perl -V> to work in all its 765This option will not make your program more secure (unless you are
370glory (F<Config.pm> is included automatically by this). 766running with elevated privileges), but it will reduce the surprise effect
767when a user has these environment variables set and doesn't expect your
768standalone program to act like a perl interpreter.
371 769
372 # bourne shell
373 staticperl mkbundle --use '"Config_heavy.pl"'
374
375 # bundle specification file
376 use "Config_heavy.pl"
377
378The C<-Mmodule> syntax is included as an alias that might be easier to
379remember than C<use>. Or maybe it confuses people. Time will tell. Or
380maybe not. Argh.
381
382=item --eval "perl code" | -e "perl code"
383
384Sometimes it is easier (or necessary) to specify dependencies using perl
385code, or maybe one of the modules you use need a special use statement. In
386that case, you can use C<eval> to execute some perl snippet or set some
387variables or whatever you need. All files C<require>'d or C<use>'d in the
388script are included in the final bundle.
389
390Keep in mind that F<mkbundle> will only C<require> the modules named
391by the C<--use> option, so do not expect the symbols from modules you
392C<--use>'d earlier on the command line to be available.
393
394Example: force L<AnyEvent> to detect a backend and therefore include it
395in the final bundle.
396
397 staticperl mkbundle --eval 'use AnyEvent; AnyEvent::detect'
398
399 # or like this
400 staticperl mkbundle -MAnyEvent --eval 'use AnyEvent; AnyEvent::detect'
401
402Example: use a separate "bootstrap" script that C<use>'s lots of modules
403and include this in the final bundle, to be executed automatically.
404
405 staticperl mkbundle --eval 'do "bootstrap"' --boot bootstrap
406
407=item --boot filename
408
409Include the given file in the bundle and arrange for it to be executed
410(using a C<require>) before anything else when the new perl is
411initialised. This can be used to modify C<@INC> or anything else before
412the perl interpreter executes scripts given on the command line (or via
413C<-e>). This works even in an embedded interpreter.
414
415=item --add "file" | --add "file alias"
416
417Adds the given (perl) file into the bundle (and optionally call it
418"alias"). This is useful to include any custom files into the bundle.
419
420Example: embed the file F<httpd> as F<httpd.pm> when creating the bundle.
421
422 staticperl mkperl --add "httpd httpd.pm"
423
424It is also a great way to add any custom modules:
425
426 # specification file
427 add file1 myfiles/file1
428 add file2 myfiles/file2
429 add file3 myfiles/file3
430
431=item --binadd "file" | --add "file alias"
432
433Just like C<--add>, except that it treats the file as binary and adds it
434without any processing.
435
436You should probably add a C</> prefix to avoid clashing with embedded
437perl files (whose paths do not start with C</>), and/or use a special
438directory, such as C</res/name>.
439
440You can later get a copy of these files by calling C<staticperl::find
441"alias">.
442
443=item --static 770=item C<--static>
444 771
445When C<--perl> is also given, link statically instead of dynamically. The 772Add C<-static> to F<bundle.ldopts>, which means a fully static (if
773supported by the OS) executable will be created. This is not immensely
774useful when just creating the bundle files, but is most useful when
775linking a binary with the C<--perl> or C<--app> options.
776
446default is to link the new perl interpreter fully dynamic (that means all 777The default is to link the new binary dynamically (that means all perl
447perl modules are linked statically, but all external libraries are still 778modules are linked statically, but all external libraries are still
448referenced dynamically). 779referenced dynamically).
449 780
450Keep in mind that Solaris doesn't support static linking at all, and 781Keep in mind that Solaris doesn't support static linking at all, and
451systems based on GNU libc don't really support it in a usable fashion 782systems based on GNU libc don't really support it in a very usable
452either. Try uClibc if you want to create fully statically linked 783fashion either. Try uClibc if you want to create fully statically linked
453executables, or try the C<--staticlibs> option to link only some libraries 784executables, or try the C<--staticlib> option to link only some libraries
454statically. 785statically.
455 786
456=item any other argument 787=item C<--staticlib> libname
457 788
458Any other argument is interpreted as a bundle specification file, which 789When not linking fully statically, this option allows you to link specific
459supports most long options (without extra quoting), one option per line. 790libraries statically. What it does is simply replace all occurrences of
791C<-llibname> with the GCC-specific C<-Wl,-Bstatic -llibname -Wl,-Bdynamic>
792option.
793
794This will have no effect unless the library is actually linked against,
795specifically, C<--staticlib> will not link against the named library
796unless it would be linked against anyway.
797
798Example: link libcrypt statically into the final binary.
799
800 staticperl mkperl -MIO::AIO --staticlib crypt
801
802 # ldopts might now contain:
803 # -lm -Wl,-Bstatic -lcrypt -Wl,-Bdynamic -lpthread
804
805=item C<--extra-cflags> string
806
807Specifies extra compiler flags, used when compiling the bundle file. The
808flags are appended to all the existing flags, so can be sued to override
809settings.
810
811=item C<--extra-ldflags> string
812
813Specifies extra linker flags, used when linking the bundle.
814
815=item C<--extra-libs> string
816
817Extra linker flags, appended at the end when linking. The difference to
818C<--extra-ldflags> is that the ldflags are appended to the flags, before
819the objects and libraries, and the extra libs are added at the end.
820
821=back
822
823=back
824
825=head3 EXTENDED GLOB PATTERNS
826
827Some options of F<staticperl mkbundle> expect an I<extended glob
828pattern>. This is neither a normal shell glob nor a regex, but something
829in between. The idea has been copied from rsync, and there are the current
830matching rules:
831
832=over 4
833
834=item Patterns starting with F</> will be a anchored at the root of the library tree.
835
836That is, F</unicore> will match the F<unicore> directory in C<@INC>, but
837nothing inside, and neither any other file or directory called F<unicore>
838anywhere else in the hierarchy.
839
840=item Patterns not starting with F</> will be anchored at the end of the path.
841
842That is, F<idna.pl> will match any file called F<idna.pl> anywhere in the
843hierarchy, but not any directories of the same name.
844
845=item A F<*> matches anything within a single path component.
846
847That is, F</unicore/*.pl> would match all F<.pl> files directly inside
848C</unicore>, not any deeper level F<.pl> files. Or in other words, F<*>
849will not match slashes.
850
851=item A F<**> matches anything.
852
853That is, F</unicore/**.pl> would match all F<.pl> files under F</unicore>,
854no matter how deeply nested they are inside subdirectories.
855
856=item A F<?> matches a single character within a component.
857
858That is, F</Encode/??.pm> matches F</Encode/JP.pm>, but not the
859hypothetical F</Encode/J/.pm>, as F<?> does not match F</>.
460 860
461=back 861=back
462 862
463=head2 F<STATICPERL> CONFIGURATION AND HOOKS 863=head2 F<STATICPERL> CONFIGURATION AND HOOKS
464 864
465During (each) startup, F<staticperl> tries to source the following shell 865During (each) startup, F<staticperl> tries to source some shell files to
866allow you to fine-tune/override configuration settings.
867
868In them you can override shell variables, or define shell functions
869("hooks") to be called at specific phases during installation. For
870example, you could define a C<postinstall> hook to install additional
871modules from CPAN each time you start from scratch.
872
873If the env variable C<$STATICPERLRC> is set, then F<staticperl> will try
874to source the file named with it only. Otherwise, it tries the following
466files in order: 875shell files in order:
467 876
468 /etc/staticperlrc 877 /etc/staticperlrc
469 ~/.staticperlrc 878 ~/.staticperlrc
470 $STATICPERL/rc 879 $STATICPERL/rc
471 880
472They can be used to override shell variables, or define functions to be
473called at specific phases.
474
475Note that the last file is erased during F<staticperl distclean>, so 881Note that the last file is erased during F<staticperl distclean>, so
476generally should not be used. 882generally should not be used.
477 883
478=head3 CONFIGURATION VARIABLES 884=head3 CONFIGURATION VARIABLES
479 885
511=item C<STATICPERL> 917=item C<STATICPERL>
512 918
513The directory where staticperl stores all its files 919The directory where staticperl stores all its files
514(default: F<~/.staticperl>). 920(default: F<~/.staticperl>).
515 921
922=item C<DLCACHE>
923
924The path to a directory (will be created if it doesn't exist) where
925downloaded perl sources are being cached, to avoid downloading them
926again. The default is empty, which means there is no cache.
927
928=item C<PERL_VERSION>
929
930The perl version to install - C<5.12.5> is a good choice for small builds,
931but C<5.8.9> is also a good choice (5.8.9 is much smaller than 5.12.5), if
932it builds on your system.
933
934You can also set this variable to the absolute URL of a tarball (F<.tar>,
935F<.tar.gz>, F<.tar.bz2>, F<.tar.lzma> or F<.tar.xz>), or to the absolute
936path of an unpacked perl source tree, which will be copied.
937
938The default is currently
939F<http://stableperl.schmorp.de/dist/latest.tar.gz>, i.e. the latest
940stableperl release.
941
516=item C<PERL_MM_USE_DEFAULT>, C<EV_EXTRA_DEFS>, ... 942=item C<PERL_MM_USE_DEFAULT>, C<EV_EXTRA_DEFS>, ...
517 943
518Usually set to C<1> to make modules "less inquisitive" during their 944Usually set to C<1> to make modules "less inquisitive" during their
519installation, you can set any environment variable you want - some modules 945installation. You can set (and export!) any environment variable you want
520(such as L<Coro> or L<EV>) use environment variables for further tweaking. 946- some modules (such as L<Coro> or L<EV>) use environment variables for
521 947further tweaking.
522=item C<PERL_VERSION>
523
524The perl version to install - default is currently C<5.12.2>, but C<5.8.9>
525is also a good choice (5.8.9 is much smaller than 5.12.2, while 5.10.1 is
526about as big as 5.12.2).
527 948
528=item C<PERL_PREFIX> 949=item C<PERL_PREFIX>
529 950
530The prefix where perl gets installed (default: F<$STATICPERL/perl>), 951The directory where perl gets installed (default: F<$STATICPERL/perl>),
531i.e. where the F<bin> and F<lib> subdirectories will end up. 952i.e. where the F<bin> and F<lib> subdirectories will end up. Previous
953contents will be removed on installation.
532 954
533=item C<PERL_CONFIGURE> 955=item C<PERL_CONFIGURE>
534 956
535Additional Configure options - these are simply passed to the perl 957Additional Configure options - these are simply passed to the perl
536Configure script. For example, if you wanted to enable dynamic loading, 958Configure script. For example, if you wanted to enable dynamic loading,
540 962
541More commonly, you would either activate 64 bit integer support 963More commonly, you would either activate 64 bit integer support
542(C<-Duse64bitint>), or disable large files support (-Uuselargefiles), to 964(C<-Duse64bitint>), or disable large files support (-Uuselargefiles), to
543reduce filesize further. 965reduce filesize further.
544 966
545=item C<PERL_CPPFLAGS>, C<PERL_OPTIMIZE>, C<PERL_LDFLAGS>, C<PERL_LIBS> 967=item C<PERL_CC>, C<PERL_CCFLAGS>, C<PERL_OPTIMIZE>, C<PERL_LDFLAGS>, C<PERL_LIBS>
546 968
547These flags are passed to perl's F<Configure> script, and are generally 969These flags are passed to perl's F<Configure> script, and are generally
548optimised for small size (at the cost of performance). Since they also 970optimised for small size (at the cost of performance). Since they also
549contain subtle workarounds around various build issues, changing these 971contain subtle workarounds around various build issues, changing these
550usually requires understanding their default values - best look at the top 972usually requires understanding their default values - best look at
551of the F<staticperl> script for more info on these. 973the top of the F<staticperl> script for more info on these, and use a
974F<~/.staticperlrc> to override them.
975
976Most of the variables override (or modify) the corresponding F<Configure>
977variable, except C<PERL_CCFLAGS>, which gets appended.
978
979The default for C<PERL_OPTIMIZE> is C<-Os> (assuming gcc), and for
980C<PERL_LIBS> is C<-lm -lcrypt>, which should be good for most (but not
981all) systems.
982
983For other compilers or more customised optimisation settings, you need to
984adjust these, e.g. in your F<~/.staticperlrc>.
985
986With gcc on x86 and amd64, you can get more space-savings by using:
987
988 -Os -ffunction-sections -fdata-sections -finline-limit=8 -mpush-args
989 -mno-inline-stringops-dynamically -mno-align-stringops
990
991And on x86 and pentium3 and newer (basically everything you might ever
992want to run on), adding these is even better for space-savings (use
993-mtune=core2 or something newer for much faster code, too):
994
995 -fomit-frame-pointer -march=pentium3 -mtune=i386
552 996
553=back 997=back
554 998
555=head4 Variables you probably I<do not want> to override 999=head4 Variables you probably I<do not want> to override
556 1000
557=over 4 1001=over 4
1002
1003=item C<MAKE>
1004
1005The make command to use - default is C<make>.
558 1006
559=item C<MKBUNDLE> 1007=item C<MKBUNDLE>
560 1008
561Where F<staticperl> writes the C<mkbundle> command to 1009Where F<staticperl> writes the C<mkbundle> command to
562(default: F<$STATICPERL/mkbundle>). 1010(default: F<$STATICPERL/mkbundle>).
571=head3 OVERRIDABLE HOOKS 1019=head3 OVERRIDABLE HOOKS
572 1020
573In addition to environment variables, it is possible to provide some 1021In addition to environment variables, it is possible to provide some
574shell functions that are called at specific times. To provide your own 1022shell functions that are called at specific times. To provide your own
575commands, just define the corresponding function. 1023commands, just define the corresponding function.
1024
1025The actual order in which hooks are invoked during a full install
1026from scratch is C<preconfigure>, C<patchconfig>, C<postconfigure>,
1027C<postbuild>, C<postinstall>.
576 1028
577Example: install extra modules from CPAN and from some directories 1029Example: install extra modules from CPAN and from some directories
578at F<staticperl install> time. 1030at F<staticperl install> time.
579 1031
580 postinstall() { 1032 postinstall() {
587 1039
588=over 4 1040=over 4
589 1041
590=item preconfigure 1042=item preconfigure
591 1043
592Called just before running F<./Configur> in the perl source 1044Called just before running F<./Configure> in the perl source
593directory. Current working directory is the perl source directory. 1045directory. Current working directory is the perl source directory.
594 1046
595This can be used to set any C<PERL_xxx> variables, which might be costly 1047This can be used to set any C<PERL_xxx> variables, which might be costly
596to compute. 1048to compute.
597 1049
1050=item patchconfig
1051
1052Called after running F<./Configure> in the perl source directory to create
1053F<./config.sh>, but before running F<./Configure -S> to actually apply the
1054config. Current working directory is the perl source directory.
1055
1056Can be used to tailor/patch F<config.sh> or do any other modifications.
1057
598=item postconfigure 1058=item postconfigure
599 1059
600Called after configuring, but before building perl. Current working 1060Called after configuring, but before building perl. Current working
601directory is the perl source directory. 1061directory is the perl source directory.
602
603Could be used to tailor/patch config.sh (followed by F<sh Configure -S>)
604or do any other modifications.
605 1062
606=item postbuild 1063=item postbuild
607 1064
608Called after building, but before installing perl. Current working 1065Called after building, but before installing perl. Current working
609directory is the perl source directory. 1066directory is the perl source directory.
647A header file that contains the prototypes of the few symbols "exported" 1104A header file that contains the prototypes of the few symbols "exported"
648by bundle.c, and also exposes the perl headers to the application. 1105by bundle.c, and also exposes the perl headers to the application.
649 1106
650=over 4 1107=over 4
651 1108
652=item staticperl_init () 1109=item staticperl_init (xs_init = 0)
653 1110
654Initialises the perl interpreter. You can use the normal perl functions 1111Initialises the perl interpreter. You can use the normal perl functions
655after calling this function, for example, to define extra functions or 1112after calling this function, for example, to define extra functions or
656to load a .pm file that contains some initialisation code, or the main 1113to load a .pm file that contains some initialisation code, or the main
657program function: 1114program function:
664 } 1121 }
665 1122
666 static void 1123 static void
667 run_myapp(void) 1124 run_myapp(void)
668 { 1125 {
669 staticperl_init (); 1126 staticperl_init (0);
670 newXSproto ("myapp::xsfunction", xsfunction, __FILE__, "$$;$"); 1127 newXSproto ("myapp::xsfunction", xsfunction, __FILE__, "$$;$");
671 eval_pv ("require myapp::main", 1); // executes "myapp/main.pm" 1128 eval_pv ("require myapp::main", 1); // executes "myapp/main.pm"
672 } 1129 }
673 1130
1131When your bootcode already wants to access some XS functions at
1132compiletime, then you need to supply an C<xs_init> function pointer that
1133is called as soon as perl is initialised enough to define XS functions,
1134but before the preamble code is executed:
1135
1136 static void
1137 xs_init (pTHX)
1138 {
1139 newXSproto ("myapp::xsfunction", xsfunction, __FILE__, "$$;$");
1140 }
1141
1142 static void
1143 run_myapp(void)
1144 {
1145 staticperl_init (xs_init);
1146 }
1147
1148=item staticperl_cleanup ()
1149
1150In the unlikely case that you want to destroy the perl interpreter, here
1151is the corresponding function.
1152
674=item staticperl_xs_init (pTHX) 1153=item staticperl_xs_init (pTHX)
675 1154
676Sometimes you need direct control over C<perl_parse> and C<perl_run>, in 1155Sometimes you need direct control over C<perl_parse> and C<perl_run>, in
677which case you do not want to use C<staticperl_init> but call them on your 1156which case you do not want to use C<staticperl_init> but call them on your
678own. 1157own.
679 1158
680Then you need this function - either pass it directly as the C<xs_init> 1159Then you need this function - either pass it directly as the C<xs_init>
681function to C<perl_parse>, or call it from your own C<xs_init> function. 1160function to C<perl_parse>, or call it as one of the first things from your
682 1161own C<xs_init> function.
683=item staticperl_cleanup ()
684
685In the unlikely case that you want to destroy the perl interpreter, here
686is the corresponding function.
687 1162
688=item PerlInterpreter *staticperl 1163=item PerlInterpreter *staticperl
689 1164
690The perl interpreter pointer used by staticperl. Not normally so useful, 1165The perl interpreter pointer used by staticperl. Not normally so useful,
691but there it is. 1166but there it is.
704 1179
705=back 1180=back
706 1181
707=head1 RUNTIME FUNCTIONALITY 1182=head1 RUNTIME FUNCTIONALITY
708 1183
709Binaries created with C<mkbundle>/C<mkperl> contain extra functions, which 1184Binaries created with C<mkbundle>/C<mkperl> contain extra functionality,
710are required to access the bundled perl sources, but might be useful for 1185mostly related to the extra files bundled in the binary (the virtual
711other purposes. 1186filesystem). All of this data is statically compiled into the binary, and
1187accessing means copying it from a read-only section of your binary. Data
1188pages in this way are usually freed by the operating system, as they aren't
1189used more then once.
1190
1191=head2 VIRTUAL FILESYSTEM
1192
1193Every bundle has a virtual filesystem. The only information stored in it
1194is the path and contents of each file that was bundled.
1195
1196=head3 LAYOUT
1197
1198Any paths starting with an ampersand (F<&>) or exclamation mark (F<!>) are
1199reserved by F<staticperl>. They must only be used as described in this
1200section.
1201
1202=over 4
1203
1204=item !
1205
1206All files that typically cannot be loaded from memory (such as dynamic
1207objects or shared libraries), but have to reside in the filesystem, are
1208prefixed with F<!>. Typically these files get written out to some
1209(semi-)temporary directory shortly after program startup, or before being
1210used.
1211
1212=item !boot
1213
1214The bootstrap file, if specified during bundling.
1215
1216=item !auto/
1217
1218Shared objects or dlls corresponding to dynamically-linked perl extensions
1219are stored with an F<!auto/> prefix.
1220
1221=item !lib/
1222
1223External shared libraries are stored in this directory.
1224
1225=item any letter
1226
1227Any path starting with a letter is a perl library file. For example,
1228F<Coro/AIO.pm> corresponds to the file loaded by C<use Coro::AIO>, and
1229F<Coro/jit.pl> corresponds to C<require "Coro/jit.pl">.
1230
1231Obviously, module names shouldn't start with any other characters than
1232letters :)
1233
1234=back
1235
1236=head3 FUNCTIONS
1237
1238=over 4
1239
1240=item $file = static::find $path
1241
1242Returns the data associated with the given C<$path>
1243(e.g. C<Digest/MD5.pm>, C<auto/POSIX/autosplit.ix>).
1244
1245Returns C<undef> if the file isn't embedded.
1246
1247=item @paths = static::list
1248
1249Returns the list of all paths embedded in this binary.
1250
1251=back
1252
1253=head2 EXTRA FEATURES
712 1254
713In addition, for the embedded loading of perl files to work, F<staticperl> 1255In addition, for the embedded loading of perl files to work, F<staticperl>
714overrides the C<@INC> array. 1256overrides the C<@INC> array.
715 1257
716=over 4
717
718=item $file = staticperl::find $path
719
720Returns the data associated with the given C<$path>
721(e.g. C<Digest/MD5.pm>, C<auto/POSIX/autosplit.ix>), which is basically
722the UNIX path relative to the perl library directory.
723
724Returns C<undef> if the file isn't embedded.
725
726=item @paths = staticperl::list
727
728Returns the list of all paths embedded in this binary.
729
730=back
731
732=head1 FULLY STATIC BINARIES - BUILDROOT 1258=head1 FULLY STATIC BINARIES - ALPINE LINUX
733 1259
734To make truly static (Linux-) libraries, you might want to have a look at 1260This section once contained a way to build fully static (including
735buildroot (L<http://buildroot.uclibc.org/>). 1261uClibc) binaries with buildroot. Unfortunately, buildroot no longer
1262supports a compiler, so I recommend using alpine linux instead
1263(L<http://alpinelinux.org/>). Get yourself a VM (e.g. with qemu), run an
1264older alpine linux verison in it (e.g. 2.4), copy staticperl inside and
1265use it.
736 1266
737Buildroot is primarily meant to set up a cross-compile environment (which 1267The reason you might want an older alpine linux is that uClibc can be
738is not so useful as perl doesn't quite like cross compiles), but it can also compile 1268quite dependent on kernel versions, so the newest version of alpine linux
739a chroot environment where you can use F<staticperl>. 1269might need a newer kernel then you might want for, if you plan to run your
1270binaries on on other kernels.
740 1271
741To do so, download buildroot, and enable "Build options => development 1272=head1 RECIPES / SPECIFIC MODULES
742files in target filesystem" and optionally "Build options => gcc
743optimization level (optimize for size)". At the time of writing, I had
744good experiences with GCC 4.4.x but not GCC 4.5.
745 1273
746To minimise code size, I used C<-pipe -ffunction-sections -fdata-sections 1274This section contains some common(?) recipes and information about
747-finline-limit=8 -fno-builtin-strlen -mtune=i386>. The C<-mtune=i386> 1275problems with some common modules or perl constructs that require extra
748doesn't decrease codesize much, but it makes the file much more 1276files to be included.
749compressible.
750 1277
751If you don't need Coro or threads, you can go with "linuxthreads.old" (or 1278=head2 MODULES
752no thread support). For Coro, it is highly recommended to switch to a
753uClibc newer than 0.9.31 (at the time of this writing, I used the 20101201
754snapshot) and enable NPTL, otherwise Coro needs to be configured with the
755ultra-slow pthreads backend to work around linuxthreads bugs (it also uses
756twice the address space needed for stacks).
757 1279
758If you use C<linuxthreads.old>, then you should also be aware that 1280=over 4
759uClibc shares C<errno> between all threads when statically linking. See
760L<http://lists.uclibc.org/pipermail/uclibc/2010-June/044157.html> for a
761workaround (And L<https://bugs.uclibc.org/2089> for discussion).
762 1281
763C<ccache> support is also recommended, especially if you want 1282=item utf8
764to play around with buildroot options. Enabling the C<miniperl>
765package will probably enable all options required for a successful
766perl build. F<staticperl> itself additionally needs either C<wget>
767(recommended, for CPAN) or C<curl>.
768 1283
769As for shells, busybox should provide all that is needed, but the default 1284Some functionality in the utf8 module, such as swash handling (used
770busybox configuration doesn't include F<comm> which is needed by perl - 1285for unicode character ranges in regexes) is implemented in the
771either make a custom busybox config, or compile coreutils. 1286C<"utf8_heavy.pl"> library:
772 1287
773For the latter route, you might find that bash has some bugs that keep 1288 -Mutf8_heavy.pl
774it from working properly in a chroot - either use dash (and link it to
775F</bin/sh> inside the chroot) or link busybox to F</bin/sh>, using it's
776built-in ash shell.
777 1289
778Finally, you need F</dev/null> inside the chroot for many scripts to work 1290Many Unicode properties in turn are defined in separate modules,
779- F<cp /dev/null output/target/dev> or bind-mounting your F</dev> will 1291such as C<"unicore/Heavy.pl"> and more specific data tables such as
780both provide this. 1292C<"unicore/To/Digit.pl"> or C<"unicore/lib/Perl/Word.pl">. These tables
1293are big (7MB uncompressed, although F<staticperl> contains special
1294handling for those files), so including them only on demand in your
1295application might pay off.
781 1296
782After you have compiled and set up your buildroot target, you can copy 1297To simply include the whole unicode database, use:
783F<staticperl> from the C<App::Staticperl> distribution or from your 1298
784perl f<bin> directory (if you installed it) into the F<output/target> 1299 --incglob '/unicore/**.pl'
785filesystem, chroot inside and run it. 1300
1301=item AnyEvent
1302
1303AnyEvent needs a backend implementation that it will load in a delayed
1304fashion. The L<AnyEvent::Impl::Perl> backend is the default choice
1305for AnyEvent if it can't find anything else, and is usually a safe
1306fallback. If you plan to use e.g. L<EV> (L<POE>...), then you need to
1307include the L<AnyEvent::Impl::EV> (L<AnyEvent::Impl::POE>...) backend as
1308well.
1309
1310If you want to handle IRIs or IDNs (L<AnyEvent::Util> punycode and idn
1311functions), you also need to include C<"AnyEvent/Util/idna.pl"> and
1312C<"AnyEvent/Util/uts46data.pl">.
1313
1314Or you can use C<--usepacklists> and specify C<-MAnyEvent> to include
1315everything.
1316
1317=item Cairo
1318
1319See Glib, same problem, same solution.
1320
1321=item Carp
1322
1323Carp had (in older versions of perl) a dependency on L<Carp::Heavy>. As of
1324perl 5.12.2 (maybe earlier), this dependency no longer exists.
1325
1326=item Config
1327
1328The F<perl -V> switch (as well as many modules) needs L<Config>, which in
1329turn might need L<"Config_heavy.pl">. Including the latter gives you
1330both.
1331
1332=item Glib
1333
1334Glib literally requires Glib to be installed already to build - it tries
1335to fake this by running Glib out of the build directory before being
1336built. F<staticperl> tries to work around this by forcing C<MAN1PODS> and
1337C<MAN3PODS> to be empty via the C<PERL_MM_OPT> environment variable.
1338
1339=item Gtk2
1340
1341See Pango, same problems, same solution.
1342
1343=item Net::SSLeay
1344
1345This module hasn't been significantly updated since OpenSSL is called
1346OpenSSL, and fails to properly link against dependent libraries, most
1347commonly, it forgets to specify -ldl when linking.
1348
1349On GNU/Linux systems this usually goes undetected, as perl usually links
1350against -ldl itself and OpenSSL just happens to pick it up that way, by
1351chance.
1352
1353For static builds, you either have to configure -ldl manually, or you
1354cna use the following snippet in your C<postinstall> hook which patches
1355Net::SSLeay after installation, which happens to work most of the time:
1356
1357 postinstall() {
1358 # first install it
1359 instcpan Net::SSLeay
1360 # then add -ldl for future linking
1361 chmod u+w "$PERL_PREFIX"/lib/auto/Net/SSLeay/extralibs.ld
1362 echo " -ldl" >>"$PERL_PREFIX"/lib/auto/Net/SSLeay/extralibs.ld
1363 }
1364
1365=item Pango
1366
1367In addition to the C<MAN3PODS> problem in Glib, Pango also routes around
1368L<ExtUtils::MakeMaker> by compiling its files on its own. F<staticperl>
1369tries to patch L<ExtUtils::MM_Unix> to route around Pango.
1370
1371=item Term::ReadLine::Perl
1372
1373Also needs L<Term::ReadLine::readline>, or C<--usepacklists>.
1374
1375=item URI
1376
1377URI implements schemes as separate modules - the generic URL scheme is
1378implemented in L<URI::_generic>, HTTP is implemented in L<URI::http>. If
1379you need to use any of these schemes, you should include these manually,
1380or use C<--usepacklists>.
1381
1382=back
1383
1384=head2 RECIPES
1385
1386=over 4
1387
1388=item Just link everything in
1389
1390To link just about everything installed in the perl library into a new
1391perl, try this (the first time this runs it will take a long time, as a
1392lot of files need to be parsed):
1393
1394 staticperl mkperl -v --strip ppi --incglob '*'
1395
1396If you don't mind the extra megabytes, this can be a very effective way of
1397creating bundles without having to worry about forgetting any modules.
1398
1399You get even more useful variants of this method by first selecting
1400everything, and then excluding stuff you are reasonable sure not to need -
1401L<bigperl|http://staticperl.schmorp.de/bigperl.html> uses this approach.
1402
1403=item Getting rid of netdb functions
1404
1405The perl core has lots of netdb functions (C<getnetbyname>, C<getgrent>
1406and so on) that few applications use. You can avoid compiling them in by
1407putting the following fragment into a C<preconfigure> hook:
1408
1409 preconfigure() {
1410 for sym in \
1411 d_getgrnam_r d_endgrent d_endgrent_r d_endhent \
1412 d_endhostent_r d_endnent d_endnetent_r d_endpent \
1413 d_endprotoent_r d_endpwent d_endpwent_r d_endsent \
1414 d_endservent_r d_getgrent d_getgrent_r d_getgrgid_r \
1415 d_getgrnam_r d_gethbyaddr d_gethent d_getsbyport \
1416 d_gethostbyaddr_r d_gethostbyname_r d_gethostent_r \
1417 d_getlogin_r d_getnbyaddr d_getnbyname d_getnent \
1418 d_getnetbyaddr_r d_getnetbyname_r d_getnetent_r \
1419 d_getpent d_getpbyname d_getpbynumber d_getprotobyname_r \
1420 d_getprotobynumber_r d_getprotoent_r d_getpwent \
1421 d_getpwent_r d_getpwnam_r d_getpwuid_r d_getsent \
1422 d_getservbyname_r d_getservbyport_r d_getservent_r \
1423 d_getspnam_r d_getsbyname
1424 # d_gethbyname
1425 do
1426 PERL_CONFIGURE="$PERL_CONFIGURE -U$sym"
1427 done
1428 }
1429
1430This mostly gains space when linking statically, as the functions will
1431likely not be linked in. The gain for dynamically-linked binaries is
1432smaller.
1433
1434Also, this leaves C<gethostbyname> in - not only is it actually used
1435often, the L<Socket> module also exposes it, so leaving it out usually
1436gains little. Why Socket exposes a C function that is in the core already
1437is anybody's guess.
1438
1439=back
1440
1441=head1 ADDITIONAL RESOURCES
1442
1443Some guy has made a repository on github
1444(L<https://github.com/gh0stwizard/staticperl-modules>) with some modules
1445patched to build with staticperl.
786 1446
787=head1 AUTHOR 1447=head1 AUTHOR
788 1448
789 Marc Lehmann <schmorp@schmorp.de> 1449 Marc Lehmann <schmorp@schmorp.de>
790 http://software.schmorp.de/pkg/staticperl.html 1450 http://software.schmorp.de/pkg/staticperl.html
1451

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines