ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/App-Staticperl/staticperl.pod
(Generate patch)

Comparing App-Staticperl/staticperl.pod (file contents):
Revision 1.7 by root, Mon Dec 6 21:21:44 2010 UTC vs.
Revision 1.16 by root, Wed Dec 8 23:03:21 2010 UTC

1=head1 NAME 1=head1 NAME
2 2
3staticperl - perl, libc, 50 modules, all in one 500kb file 3staticperl - perl, libc, 100 modules, all in one 500kb file
4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 staticperl help # print the embedded documentation 7 staticperl help # print the embedded documentation
8 staticperl fetch # fetch and unpack perl sources 8 staticperl fetch # fetch and unpack perl sources
14 staticperl cpan # invoke CPAN shell 14 staticperl cpan # invoke CPAN shell
15 staticperl instmod path... # install unpacked modules 15 staticperl instmod path... # install unpacked modules
16 staticperl instcpan modulename... # install modules from CPAN 16 staticperl instcpan modulename... # install modules from CPAN
17 staticperl mkbundle <bundle-args...> # see documentation 17 staticperl mkbundle <bundle-args...> # see documentation
18 staticperl mkperl <bundle-args...> # see documentation 18 staticperl mkperl <bundle-args...> # see documentation
19 staticperl mkapp appname <bundle-args...> # see documentation
19 20
20Typical Examples: 21Typical Examples:
21 22
22 staticperl install # fetch, configure, build and install perl 23 staticperl install # fetch, configure, build and install perl
23 staticperl cpan # run interactive cpan shell 24 staticperl cpan # run interactive cpan shell
24 staticperl mkperl -M '"Config_heavy.pl"' # build a perl that supports -V 25 staticperl mkperl -M '"Config_heavy.pl"' # build a perl that supports -V
25 staticperl mkperl -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI -MURI::http 26 staticperl mkperl -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI -MURI::http
26 # build a perl with the above modules linked in 27 # build a perl with the above modules linked in
28 staticperl mkapp myapp --boot mainprog mymodules
29 # build a binary "myapp" from mainprog and mymodules
27 30
28=head1 DESCRIPTION 31=head1 DESCRIPTION
29 32
30This script helps you creating single-file perl interpreters, or embedding 33This script helps you to create single-file perl interpreters
31a perl interpreter in your applications. Single-file means that it is 34or applications, or embedding a perl interpreter in your
32fully self-contained - no separate shared objects, no autoload fragments, 35applications. Single-file means that it is fully self-contained - no
33no .pm or .pl files are needed. And when linking statically, you can 36separate shared objects, no autoload fragments, no .pm or .pl files are
34create (or embed) a single file that contains perl interpreter, libc, all 37needed. And when linking statically, you can create (or embed) a single
35the modules you need and all the libraries you need. 38file that contains perl interpreter, libc, all the modules you need, all
39the libraries you need and of course your actual program.
36 40
37With F<uClibc> and F<upx> on x86, you can create a single 500kb binary that 41With F<uClibc> and F<upx> on x86, you can create a single 500kb binary
38contains perl and 50 modules such as AnyEvent, EV, IO::AIO, Coro and so 42that contains perl and 100 modules such as POSIX, AnyEvent, EV, IO::AIO,
39on. Or any other choice of modules. 43Coro and so on. Or any other choice of modules.
40 44
41The created files do not need write access to the file system (like PAR 45The created files do not need write access to the file system (like PAR
42does). In fact, since this script is in many ways similar to PAR::Packer, 46does). In fact, since this script is in many ways similar to PAR::Packer,
43here are the differences: 47here are the differences:
44 48
81Maintaining your own custom perl build can be a pain in the ass, and while 85Maintaining your own custom perl build can be a pain in the ass, and while
82F<staticperl> tries to make this easy, it still requires a custom perl 86F<staticperl> tries to make this easy, it still requires a custom perl
83build and possibly fiddling with some modules. PAR is likely to produce 87build and possibly fiddling with some modules. PAR is likely to produce
84results faster. 88results faster.
85 89
90Ok, PAR never has worked for me out of the box, and for some people,
91F<staticperl> does work out of the box, as they don't count "fiddling with
92module use lists" against it, but nevertheless, F<staticperl> is certainly
93a bit more difficult to use.
94
86=back 95=back
87 96
88=head1 HOW DOES IT WORK? 97=head1 HOW DOES IT WORK?
89 98
90Simple: F<staticperl> downloads, compile and installs a perl version of 99Simple: F<staticperl> downloads, compile and installs a perl version of
184command by specifying all the directories with modules in them that you 193command by specifying all the directories with modules in them that you
185want to have built. 194want to have built.
186 195
187=item F<staticperl clean> 196=item F<staticperl clean>
188 197
189Runs F<make distclean> in the perl source directory (and potentially 198Deletes the perl source directory (and potentially cleans up other
190cleans up other intermediate files). This can be used to clean up 199intermediate files). This can be used to clean up files only needed for
191intermediate files without removing the installed perl interpreter. 200building perl, without removing the installed perl interpreter, or to
201force a re-build from scratch.
202
203At the moment, it doesn't delete downloaded tarballs.
192 204
193=item F<staticperl distclean> 205=item F<staticperl distclean>
194 206
195This wipes your complete F<~/.staticperl> directory. Be careful with this, 207This wipes your complete F<~/.staticperl> directory. Be careful with this,
196it nukes your perl download, perl sources, perl distribution and any 208it nukes your perl download, perl sources, perl distribution and any
236(required by L<AnyEvent::HTTPD>) implements various URI schemes as extra 248(required by L<AnyEvent::HTTPD>) implements various URI schemes as extra
237modules - since L<AnyEvent::HTTPD> only needs C<http> URIs, we only need 249modules - since L<AnyEvent::HTTPD> only needs C<http> URIs, we only need
238to include that module. I found out about these dependencies by carefully 250to include that module. I found out about these dependencies by carefully
239watching any error messages about missing modules... 251watching any error messages about missing modules...
240 252
253Instead of building a new perl binary, you can also build a standalone
254application:
255
256 # build the app
257 staticperl mkapp app --boot eg/httpd \
258 -MAnyEvent::Impl::Perl -MAnyEvent::HTTPD -MURI::http
259
260 # run it
261 ./app
262
241=head3 OPTION PROCESSING 263=head3 OPTION PROCESSING
242 264
243All options can be given as arguments on the command line (typically 265All options can be given as arguments on the command line (typically
244using long (e.g. C<--verbose>) or short option (e.g. C<-v>) style). Since 266using long (e.g. C<--verbose>) or short option (e.g. C<-v>) style). Since
245specifying a lot of modules can make the command line very cumbersome, 267specifying a lot of modules can make the command line very cumbersome,
287is also a lot slower, so is best used for production builds. Note that 309is also a lot slower, so is best used for production builds. Note that
288this method doesn't optimise for raw file size, but for best compression 310this method doesn't optimise for raw file size, but for best compression
289(that means that the uncompressed file size is a bit larger, but the files 311(that means that the uncompressed file size is a bit larger, but the files
290compress better, e.g. with F<upx>). 312compress better, e.g. with F<upx>).
291 313
314Last not least, if you need accurate line numbers in error messages,
292Last not least, in the unlikely case where C<pod> is too slow, or some 315or in the unlikely case where C<pod> is too slow, or some module gets
293module gets mistreated, you can specify C<none> to not mangle included 316mistreated, you can specify C<none> to not mangle included perl sources in
294perl sources in any way. 317any way.
295 318
296=item --perl 319=item --perl
297 320
298After writing out the bundle files, try to link a new perl interpreter. It 321After writing out the bundle files, try to link a new perl interpreter. It
299will be called F<perl> and will be left in the current working 322will be called F<perl> and will be left in the current working
302This switch is automatically used when F<staticperl> is invoked with the 325This switch is automatically used when F<staticperl> is invoked with the
303C<mkperl> command (instead of C<mkbundle>): 326C<mkperl> command (instead of C<mkbundle>):
304 327
305 # build a new ./perl with only common::sense in it - very small :) 328 # build a new ./perl with only common::sense in it - very small :)
306 staticperl mkperl -Mcommon::sense 329 staticperl mkperl -Mcommon::sense
330
331=item --app name
332
333After writing out the bundle files, try to link a new standalone
334program. It will be called C<name>, and the bundle files get removed after
335linking it.
336
337The difference to the (mutually exclusive) C<--perl> option is that the
338binary created by this option will not try to act as a perl interpreter -
339instead it will simply initialise the perl interpreter, clean it up and
340exit.
341
342This switch is automatically used when F<staticperl> is invoked with the
343C<mkapp> command (instead of C<mkbundle>):
344
345To let it do something useful you I<must> add some boot code, e.g. with
346the C<--boot> option.
347
348Example: create a standalone perl binary that will execute F<appfile> when
349it is started.
350
351 staticperl mkbundle --app myexe --boot appfile
307 352
308=item --use module | -Mmodule 353=item --use module | -Mmodule
309 354
310Include the named module and all direct dependencies. This is done by 355Include the named module and all direct dependencies. This is done by
311C<require>'ing the module in a subprocess and tracing which other modules 356C<require>'ing the module in a subprocess and tracing which other modules
382 # specification file 427 # specification file
383 add file1 myfiles/file1 428 add file1 myfiles/file1
384 add file2 myfiles/file2 429 add file2 myfiles/file2
385 add file3 myfiles/file3 430 add file3 myfiles/file3
386 431
432=item --binadd "file" | --add "file alias"
433
434Just like C<--add>, except that it treats the file as binary and adds it
435without any processing.
436
437You should probably add a C</> prefix to avoid clashing with embedded
438perl files (whose paths do not start with C</>), and/or use a special
439directory, such as C</res/name>.
440
441You can later get a copy of these files by calling C<staticperl::find
442"alias">.
443
387=item --static 444=item --static
388 445
389When C<--perl> is also given, link statically instead of dynamically. The 446When C<--perl> is also given, link statically instead of dynamically. The
390default is to link the new perl interpreter fully dynamic (that means all 447default is to link the new perl interpreter fully dynamic (that means all
391perl modules are linked statically, but all external libraries are still 448perl modules are linked statically, but all external libraries are still
402Any other argument is interpreted as a bundle specification file, which 459Any other argument is interpreted as a bundle specification file, which
403supports most long options (without extra quoting), one option per line. 460supports most long options (without extra quoting), one option per line.
404 461
405=back 462=back
406 463
407=head2 F<STATCPERL> CONFIGURATION AND HOOKS 464=head2 F<STATICPERL> CONFIGURATION AND HOOKS
408 465
409During (each) startup, F<staticperl> tries to source the following shell 466During (each) startup, F<staticperl> tries to source the following shell
410files in order: 467files in order:
411 468
412 /etc/staticperlrc 469 /etc/staticperlrc
428=item C<EMAIL> 485=item C<EMAIL>
429 486
430The e-mail address of the person who built this binary. Has no good 487The e-mail address of the person who built this binary. Has no good
431default, so should be specified by you. 488default, so should be specified by you.
432 489
490=item C<CPAN>
491
492The URL of the CPAN mirror to use (e.g. L<http://mirror.netcologne.de/cpan/>).
493
494=item C<EXTRA_MODULES>
495
496Additional modules installed during F<staticperl install>. Here you can
497set which modules you want have to installed from CPAN.
498
499Example: I really really need EV, AnyEvent, Coro and AnyEvent::AIO.
500
501 EXTRA_MODULES="EV AnyEvent Coro AnyEvent::AIO"
502
503Note that you can also use a C<postinstall> hook to achieve this, and
504more.
505
433=back 506=back
434 507
435=head4 Variables you might I<want> to override 508=head4 Variables you might I<want> to override
436 509
437=over 4 510=over 4
438 511
512=item C<STATICPERL>
513
514The directory where staticperl stores all its files
515(default: F<~/.staticperl>).
516
517=item C<PERL_MM_USE_DEFAULT>, C<EV_EXTRA_DEFS>, ...
518
519Usually set to C<1> to make modules "less inquisitive" during their
520installation, you can set any environment variable you want - some modules
521(such as L<Coro> or L<EV>) use environment variables for further tweaking.
522
439=item C<PERLVER> 523=item C<PERL_VERSION>
440 524
441The perl version to install - default is currently C<5.12.2>, but C<5.8.9> 525The perl version to install - default is currently C<5.12.2>, but C<5.8.9>
442is also a good choice (5.8.9 is much smaller than 5.12.2, while 5.10.1 is 526is also a good choice (5.8.9 is much smaller than 5.12.2, while 5.10.1 is
443about as big as 5.12.2). 527about as big as 5.12.2).
444 528
445=item C<CPAN>
446
447The URL of the CPAN mirror to use (e.g. L<http://mirror.netcologne.de/cpan/>).
448
449=item C<EXTRA_MODULES>
450
451Additional modules installed during F<staticperl install>. Here you can
452set which modules you want have to installed from CPAN.
453
454Example: I really really need EV, AnyEvent, Coro and IO::AIO.
455
456 EXTRA_MODULES="EV AnyEvent Coro IO::AIO"
457
458Note that you can also use a C<postinstall> hook to achieve this, and
459more.
460
461=item C<PERL_MM_USE_DEFAULT>, C<EV_EXTRA_DEFS>, ...
462
463Usually set to C<1> to make modules "less inquisitive" during their
464installation, you can set any environment variable you want - some modules
465(such as L<Coro> or L<EV>) use environment variables for further tweaking.
466
467=item C<STATICPERL>
468
469The directory where staticperl stores all its files
470(default: F<~/.staticperl>).
471
472=item C<PREFIX> 529=item C<PERL_PREFIX>
473 530
474The prefix where perl gets installed (default: F<$STATICPERL/perl>), 531The prefix where perl gets installed (default: F<$STATICPERL/perl>),
475i.e. where the F<bin> and F<lib> subdirectories will end up. 532i.e. where the F<bin> and F<lib> subdirectories will end up.
533
534=item C<PERL_CONFIGURE>
535
536Additional Configure options - these are simply passed to the perl
537Configure script. For example, if you wanted to enable dynamic loading,
538you could pass C<-Dusedl>. To enable ithreads (Why would you want that
539insanity? Don't! Use L<forks> instead!) you would pass C<-Duseithreads>
540and so on.
541
542More commonly, you would either activate 64 bit integer support
543(C<-Duse64bitint>), or disable large files support (-Uuselargefiles), to
544reduce filesize further.
476 545
477=item C<PERL_CPPFLAGS>, C<PERL_OPTIMIZE>, C<PERL_LDFLAGS>, C<PERL_LIBS> 546=item C<PERL_CPPFLAGS>, C<PERL_OPTIMIZE>, C<PERL_LDFLAGS>, C<PERL_LIBS>
478 547
479These flags are passed to perl's F<Configure> script, and are generally 548These flags are passed to perl's F<Configure> script, and are generally
480optimised for small size (at the cost of performance). Since they also 549optimised for small size (at the cost of performance). Since they also
517 instcpan Anyevent::AIO AnyEvent::HTTPD 586 instcpan Anyevent::AIO AnyEvent::HTTPD
518 } 587 }
519 588
520=over 4 589=over 4
521 590
591=item preconfigure
592
593Called just before running F<./Configur> in the perl source
594directory. Current working directory is the perl source directory.
595
596This can be used to set any C<PERL_xxx> variables, which might be costly
597to compute.
598
522=item postconfigure 599=item postconfigure
523 600
524Called after configuring, but before building perl. Current working 601Called after configuring, but before building perl. Current working
525directory is the perl source directory. 602directory is the perl source directory.
526 603
527Could be used to tailor/patch config.sh (followed by F<./Configure -S>) or 604Could be used to tailor/patch config.sh (followed by F<sh Configure -S>)
528do any other modifications. 605or do any other modifications.
529 606
530=item postbuild 607=item postbuild
531 608
532Called after building, but before installing perl. Current working 609Called after building, but before installing perl. Current working
533directory is the perl source directory. 610directory is the perl source directory.
548The script must return with a zero exit status, or the installation will 625The script must return with a zero exit status, or the installation will
549fail. 626fail.
550 627
551=back 628=back
552 629
630=head1 ANATOMY OF A BUNDLE
631
632When not building a new perl binary, C<mkbundle> will leave a number of
633files in the current working directory, which can be used to embed a perl
634interpreter in your program.
635
636Intimate knowledge of L<perlembed> and preferably some experience with
637embedding perl is highly recommended.
638
639C<mkperl> (or the C<--perl> option) basically does this to link the new
640interpreter (it also adds a main program to F<bundle.>):
641
642 $Config{cc} $(cat bundle.ccopts) -o perl bundle.c $(cat bundle.ldopts)
643
644=over 4
645
646=item bundle.h
647
648A header file that contains the prototypes of the few symbols "exported"
649by bundle.c, and also exposes the perl headers to the application.
650
651=over 4
652
653=item staticperl_init ()
654
655Initialises the perl interpreter. You can use the normal perl functions
656after calling this function, for example, to define extra functions or
657to load a .pm file that contains some initialisation code, or the main
658program function:
659
660 XS (xsfunction)
661 {
662 dXSARGS;
663
664 // now we have items, ST(i) etc.
665 }
666
667 static void
668 run_myapp(void)
669 {
670 staticperl_init ();
671 newXSproto ("myapp::xsfunction", xsfunction, __FILE__, "$$;$");
672 eval_pv ("require myapp::main", 1); // executes "myapp/main.pm"
673 }
674
675=item staticperl_xs_init (pTHX)
676
677Sometimes you need direct control over C<perl_parse> and C<perl_run>, in
678which case you do not want to use C<staticperl_init> but call them on your
679own.
680
681Then you need this function - either pass it directly as the C<xs_init>
682function to C<perl_parse>, or call it from your own C<xs_init> function.
683
684=item staticperl_cleanup ()
685
686In the unlikely case that you want to destroy the perl interpreter, here
687is the corresponding function.
688
689=item PerlInterpreter *staticperl
690
691The perl interpreter pointer used by staticperl. Not normally so useful,
692but there it is.
693
694=back
695
696=item bundle.ccopts
697
698Contains the compiler options required to compile at least F<bundle.c> and
699any file that includes F<bundle.h> - you should probably use it in your
700C<CFLAGS>.
701
702=item bundle.ldopts
703
704The linker options needed to link the final program.
705
706=back
707
708=head1 RUNTIME FUNCTIONALITY
709
710Binaries created with C<mkbundle>/C<mkperl> contain extra functions, which
711are required to access the bundled perl sources, but might be useful for
712other purposes.
713
714In addition, for the embedded loading of perl files to work, F<staticperl>
715overrides the C<@INC> array.
716
717=over 4
718
719=item $file = staticperl::find $path
720
721Returns the data associated with the given C<$path>
722(e.g. C<Digest/MD5.pm>, C<auto/POSIX/autosplit.ix>), which is basically
723the UNIX path relative to the perl library directory.
724
725Returns C<undef> if the file isn't embedded.
726
727=item @paths = staticperl::list
728
729Returns the list of all paths embedded in this binary.
730
731=back
732
733=head1 FULLY STATIC BINARIES - BUILDROOT
734
735To make truly static (Linux-) libraries, you might want to have a look at
736buildroot (L<http://buildroot.uclibc.org/>).
737
738Buildroot is primarily meant to set up a cross-compile environment (which
739is not so useful as perl doesn't quite like cross compiles), but it can also compile
740a chroot environment where you can use F<staticperl>.
741
742To do so, download buildroot, and enable "Build options => development
743files in target filesystem" and optionally "Build options => gcc
744optimization level (optimize for size)". At the time of writing, I had
745good experiences with GCC 4.4.x but not GCC 4.5.
746
747To minimise code size, I used C<-pipe -ffunction-sections -fdata-sections
748-finline-limit=8 -fno-builtin-strlen -mtune=i386>. The C<-mtune=i386>
749doesn't decrease codesize much, but it makes the file much more
750compressible.
751
752If you don't need Coro or threads, you can go with "linuxthreads.old" (or
753no thread support). For Coro, it is highly recommended to switch to a
754uClibc newer than 0.9.31 (at the time of this writing, I used the 20101201
755snapshot) and enable NPTL, otherwise Coro needs to be configured with the
756ultra-slow pthreads backend to work around linuxthreads bugs (it also uses
757twice the address space needed for stacks).
758
759If you use C<linuxthreads.old>, then you should also be aware that
760uClibc shares C<errno> between all threads when statically linking. See
761L<http://lists.uclibc.org/pipermail/uclibc/2010-June/044157.html> for a
762workaround (And L<https://bugs.uclibc.org/2089> for discussion).
763
764C<ccache> support is also recommended, especially if you want
765to play around with buildroot options. Enabling the C<miniperl>
766package will probably enable all options required for a successful
767perl build. F<staticperl> itself additionally needs either C<wget>
768(recommended, for CPAN) or C<curl>.
769
770As for shells, busybox should provide all that is needed, but the default
771busybox configuration doesn't include F<comm> which is needed by perl -
772either make a custom busybox config, or compile coreutils.
773
774For the latter route, you might find that bash has some bugs that keep
775it from working properly in a chroot - either use dash (and link it to
776F</bin/sh> inside the chroot) or link busybox to F</bin/sh>, using it's
777built-in ash shell.
778
779Finally, you need F</dev/null> inside the chroot for many scripts to work
780- F<cp /dev/null output/target/dev> or bind-mounting your F</dev> will
781both provide this.
782
783After you have compiled and set up your buildroot target, you can copy
784F<staticperl> from the C<App::Staticperl> distribution or from your
785perl f<bin> directory (if you installed it) into the F<output/target>
786filesystem, chroot inside and run it.
787
553=head1 AUTHOR 788=head1 AUTHOR
554 789
555 Marc Lehmann <schmorp@schmorp.de> 790 Marc Lehmann <schmorp@schmorp.de>
556 http://software.schmorp.de/pkg/staticperl.html 791 http://software.schmorp.de/pkg/staticperl.html

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines