[ViewVC] Diff of: cvs/AnyEvent-Fork/Fork.pm

Comparing AnyEvent-Fork/Fork.pm (file contents):
Revision 1.17 by root, Fri Apr 5 23:42:24 2013 UTC vs.
Revision 1.26 by root, Sat Apr 6 08:58:51 2013 UTC

 =head1 SYNOPSIS
    use AnyEvent::Fork;
-   ##################################################################
+   AnyEvent::Fork
+      ->new
+      ->require ("MyModule")
+      ->run ("MyModule::server", my $cv = AE::cv);
+   my $fh = $cv->recv;
+=head1 DESCRIPTION
+This module allows you to create new processes, without actually forking
+them from your current process (avoiding the problems of forking), but
+preserving most of the advantages of fork.
+It can be used to create new worker processes or new independent
+subprocesses for short- and long-running jobs, process pools (e.g. for use
+in pre-forked servers) but also to spawn new external processes (such as
+CGI scripts from a web server), which can be faster (and more well behaved)
+than using fork+exec in big processes.
+Special care has been taken to make this module useful from other modules,
+while still supporting specialised environments such as L<App::Staticperl>
+or L<PAR::Packer>.
+=head1 WHAT THIS MODULE IS NOT
+This module only creates processes and lets you pass file handles and
+strings to it, and run perl code. It does not implement any kind of RPC -
+there is no back channel from the process back to you, and there is no RPC
+or message passing going on.
+If you need some form of RPC, you can either implement it yourself
+in whatever way you like, use some message-passing module such
+as L<AnyEvent::MP>, some pipe such as L<AnyEvent::ZeroMQ>, use
+L<AnyEvent::Handle> on both sides to send e.g. JSON or Storable messages,
+and so on.
+=head1 PROBLEM STATEMENT
+There are two traditional ways to implement parallel processing on UNIX
+like operating systems - fork and process, and fork+exec and process. They
+have different advantages and disadvantages that I describe below,
+together with how this module tries to mitigate the disadvantages.
+=over 4
+=item Forking from a big process can be very slow.
+A 5GB process needs 0.05s to fork on my 3.6GHz amd64 GNU/Linux box. This
+overhead is often shared with exec (because you have to fork first), but
+in some circumstances (e.g. when vfork is used), fork+exec can be much
+faster.
+This module can help here by telling a small(er) helper process to fork,
+which is faster then forking the main process, and also uses vfork where
+possible. This gives the speed of vfork, with the flexibility of fork.
+=item Forking usually creates a copy-on-write copy of the parent
+process.
+For example, modules or data files that are loaded will not use additional
+memory after a fork. When exec'ing a new process, modules and data files
+might need to be loaded again, at extra CPU and memory cost. But when
+forking, literally all data structures are copied - if the program frees
+them and replaces them by new data, the child processes will retain the
+old version even if it isn't used, which can suddenly and unexpectedly
+increase memory usage when freeing memory.
+The trade-off is between more sharing with fork (which can be good or
+bad), and no sharing with exec.
+This module allows the main program to do a controlled fork, and allows
+modules to exec processes safely at any time. When creating a custom
+process pool you can take advantage of data sharing via fork without
+risking to share large dynamic data structures that will blow up child
+memory usage.
+In other words, this module puts you into control over what is being
+shared and what isn't, at all times.
+=item Exec'ing a new perl process might be difficult.
+For example, it is not easy to find the correct path to the perl
+interpreter - C<$^X> might not be a perl interpreter at all.
+This module tries hard to identify the correct path to the perl
+interpreter. With a cooperative main program, exec'ing the interpreter
+might not even be necessary, but even without help from the main program,
+it will still work when used from a module.
+=item Exec'ing a new perl process might be slow, as all necessary modules
+have to be loaded from disk again, with no guarantees of success.
+Long running processes might run into problems when perl is upgraded
+and modules are no longer loadable because they refer to a different
+perl version, or parts of a distribution are newer than the ones already
+loaded.
+This module supports creating pre-initialised perl processes to be used as
+a template for new processes.
+=item Forking might be impossible when a program is running.
+For example, POSIX makes it almost impossible to fork from a
+multi-threaded program while doing anything useful in the child - in
+fact, if your perl program uses POSIX threads (even indirectly via
+e.g. L<IO::AIO> or L<threads>), you cannot call fork on the perl level
+anymore without risking corruption issues on a number of operating
+systems.
+This module can safely fork helper processes at any time, by calling
+fork+exec in C, in a POSIX-compatible way (via L<Proc::FastSpawn>).
+=item Parallel processing with fork might be inconvenient or difficult
+to implement. Modules might not work in both parent and child.
+For example, when a program uses an event loop and creates watchers it
+becomes very hard to use the event loop from a child program, as the
+watchers already exist but are only meaningful in the parent. Worse, a
+module might want to use such a module, not knowing whether another module
+or the main program also does, leading to problems.
+Apart from event loops, graphical toolkits also commonly fall into the
+"unsafe module" category, or just about anything that communicates with
+the external world, such as network libraries and file I/O modules, which
+usually don't like being copied and then allowed to continue in two
+processes.
+With this module only the main program is allowed to create new processes
+by forking (because only the main program can know when it is still safe
+to do so) - all other processes are created via fork+exec, which makes it
+possible to use modules such as event loops or window interfaces safely.
+=back
+=head1 EXAMPLES
-   # create a single new process, tell it to run your worker function
+=head2 Create a single new process, tell it to run your worker function.
    AnyEvent::Fork
       ->new
       ->require ("MyModule")
       ->run ("MyModule::worker, sub {
       # now $slave_filehandle is connected to the $master_filehandle
       # in the original prorcess. have fun!
    }
-   ##################################################################
-   # create a pool of server processes all accepting on the same socket
+=head2 Create a pool of server processes all accepting on the same socket.
    # create listener socket
    my $listener = ...;
    # create a pool template, initialise it and give it the socket
       while (my $socket = $listener->accept) {
          # do sth. with new socket
       }
    }
-=head1 DESCRIPTION
+=head2 use AnyEvent::Fork as a faster fork+exec
-This module allows you to create new processes, without actually forking
+This runs /bin/echo hi, with stdout redirected to /tmp/log and stderr to
-them from your current process (avoiding the problems of forking), but
+the communications socket. It is usually faster than fork+exec, but still
-preserving most of the advantages of fork.
+let's you prepare the environment.
-It can be used to create new worker processes or new independent
+   open my $output, ">/tmp/log" or die "$!";
-subprocesses for short- and long-running jobs, process pools (e.g. for use
-in pre-forked servers) but also to spawn new external processes (such as
-CGI scripts from a web server), which can be faster (and more well behaved)
-than using fork+exec in big processes.
-Special care has been taken to make this module useful from other modules,
+   AnyEvent::Fork
-while still supporting specialised environments such as L<App::Staticperl>
+      ->new
-or L<PAR::Packer>.
+      ->eval ('
+           sub run {
+              my ($fh, $output, @cmd) = @_;
-=head1 WHAT THIS MODULE IS NOT
+              # perl will clear close-on-exec on STDOUT/STDERR
+              open STDOUT, ">&", $output or die;
+              open STDERR, ">&", $fh or die;
-This module only creates processes and lets you pass file handles and
+              exec @cmd;
-strings to it, and run perl code. It does not implement any kind of RPC -
+           }
-there is no back channel from the process back to you, and there is no RPC
+        ')
-or message passing going on.
+      ->send_fh ($output)
+      ->send_arg ("/bin/echo", "hi")
+      ->run ("run", my $cv = AE::cv);
-If you need some form of RPC, you can either implement it yourself
+   my $stderr = $cv->recv;
-in whatever way you like, use some message-passing module such
-as L<AnyEvent::MP>, some pipe such as L<AnyEvent::ZeroMQ>, use
-L<AnyEvent::Handle> on both sides to send e.g. JSON or Storable messages,
-and so on.
-=head1 PROBLEM STATEMENT
-There are two ways to implement parallel processing on UNIX like operating
-systems - fork and process, and fork+exec and process. They have different
-advantages and disadvantages that I describe below, together with how this
-module tries to mitigate the disadvantages.
-=over 4
-=item Forking from a big process can be very slow (a 5GB process needs
-0.05s to fork on my 3.6GHz amd64 GNU/Linux box for example). This overhead
-is often shared with exec (because you have to fork first), but in some
-circumstances (e.g. when vfork is used), fork+exec can be much faster.
-This module can help here by telling a small(er) helper process to fork,
-or fork+exec instead.
-=item Forking usually creates a copy-on-write copy of the parent
-process. Memory (for example, modules or data files that have been
-will not take additional memory). When exec'ing a new process, modules
-and data files might need to be loaded again, at extra CPU and memory
-cost. Likewise when forking, all data structures are copied as well - if
-the program frees them and replaces them by new data, the child processes
-will retain the memory even if it isn't used.
-This module allows the main program to do a controlled fork, and allows
-modules to exec processes safely at any time. When creating a custom
-process pool you can take advantage of data sharing via fork without
-risking to share large dynamic data structures that will blow up child
-memory usage.
-=item Exec'ing a new perl process might be difficult and slow. For
-example, it is not easy to find the correct path to the perl interpreter,
-and all modules have to be loaded from disk again. Long running processes
-might run into problems when perl is upgraded for example.
-This module supports creating pre-initialised perl processes to be used
-as template, and also tries hard to identify the correct path to the perl
-interpreter. With a cooperative main program, exec'ing the interpreter
-might not even be necessary.
-=item Forking might be impossible when a program is running. For example,
-POSIX makes it almost impossible to fork from a multi-threaded program and
-do anything useful in the child - strictly speaking, if your perl program
-uses posix threads (even indirectly via e.g. L<IO::AIO> or L<threads>),
-you cannot call fork on the perl level anymore, at all.
-This module can safely fork helper processes at any time, by calling
-fork+exec in C, in a POSIX-compatible way.
-=item Parallel processing with fork might be inconvenient or difficult
-to implement. For example, when a program uses an event loop and creates
-watchers it becomes very hard to use the event loop from a child
-program, as the watchers already exist but are only meaningful in the
-parent. Worse, a module might want to use such a system, not knowing
-whether another module or the main program also does, leading to problems.
-This module only lets the main program create pools by forking (because
-only the main program can know when it is still safe to do so) - all other
-pools are created by fork+exec, after which such modules can again be
-loaded.
-=back
 =head1 CONCEPTS
 This module can create new processes either by executing a new perl
 process, or by forking from an existing "template" process.
 package AnyEvent::Fork;
 use common::sense;
-use Socket ();
+use Errno ();
 use AnyEvent;
 use AnyEvent::Util ();
 use IO::FDPass;
-our $VERSION = 0.2;
+our $VERSION = 0.5;
 our $PERL; # the path to the perl interpreter, deduces with various forms of magic
 =item my $pool = new AnyEvent::Fork key => value...
 our $TEMPLATE;
 sub _cmd {
    my $self = shift;
-   #TODO: maybe append the packet to any existing string command already in the queue
-   # ideally, we would want to use "a (w/a)*" as format string, but perl versions
+   # ideally, we would want to use "a (w/a)*" as format string, but perl
-   # from at least 5.8.9 to 5.16.3 are all buggy and can't unpack it.
+   # versions from at least 5.8.9 to 5.16.3 are all buggy and can't unpack
+   # it.
-   push @{ $self->[2] }, pack "L/a*", pack "(w/a*)*", @_;
+   push @{ $self->[2] }, pack "a L/a*", $_[0], $_[1];
    $self->[3] ||= AE::io $self->[1], 1, sub {
+      do {
-      # send the next "thing" in the queue - either a reference to an fh,
+         # send the next "thing" in the queue - either a reference to an fh,
-      # or a plain string.
+         # or a plain string.
-      if (ref $self->[2][0]) {
+         if (ref $self->[2][0]) {
-         # send fh
+            # send fh
-         IO::FDPass::send fileno $self->[1], fileno ${ $self->[2][0] }
+            unless (IO::FDPass::send fileno $self->[1], fileno ${ $self->[2][0] }) {
+               return if $! == Errno::EAGAIN || $! == Errno::EWOULDBLOCK;
+               undef $self->[3];
+               die "AnyEvent::Fork: file descriptor send failure: $!";
+            }
-            and shift @{ $self->[2] };
+            shift @{ $self->[2] };
-      } else {
+         } else {
-         # send string
+            # send string
-         my $len = syswrite $self->[1], $self->[2][0]
+            my $len = syswrite $self->[1], $self->[2][0];
+            unless ($len) {
+               return if $! == Errno::EAGAIN || $! == Errno::EWOULDBLOCK;
+               undef $self->[3];
-            or do { undef $self->[3]; die "AnyEvent::Fork: command write failure: $!" };
+               die "AnyEvent::Fork: command write failure: $!";
+            }
-         substr $self->[2][0], 0, $len, "";
+            substr $self->[2][0], 0, $len, "";
-         shift @{ $self->[2] } unless length $self->[2][0];
+            shift @{ $self->[2] } unless length $self->[2][0];
-      }
+         }
+      } while @{ $self->[2] };
-      unless (@{ $self->[2] }) {
+      # everything written
-         undef $self->[3];
+      undef $self->[3];
-         # invoke run callback
+      # invoke run callback, if any
-         $self->[0]->($self->[1]) if $self->[0];
+      $self->[4]->($self->[1]) if $self->[4];
-      }
    };
    () # make sure we don't leak the watcher
 }
 sub _new {
-   my ($self, $fh) = @_;
+   my ($self, $fh, $pid) = @_;
    AnyEvent::Util::fh_nonblocking $fh, 1;
    $self = bless [
-      undef, # run callback
+      $pid,
       $fh,
       [],    # write queue - strings or fd's
       undef, # AE watcher
    ], $self;
       exit 0;
    } elsif (!$pid) {
       die "AnyEvent::Fork::Early/Template: unable to fork template process: $!";
    }
-   AnyEvent::Fork->_new ($fh)
+   AnyEvent::Fork->_new ($fh, $pid)
 }
 =item my $proc = new AnyEvent::Fork
 Create a new "empty" perl interpreter process and returns its process
    # quick. also doesn't work in win32. of course. what did you expect
    #local $ENV{PERL5LIB} = join ":", grep !ref, @INC;
    my %env = %ENV;
    $env{PERL5LIB} = join +($^O eq "MSWin32" ? ";" : ":"), grep !ref, @INC;
-   Proc::FastSpawn::spawn (
+   my $pid = Proc::FastSpawn::spawn (
       $perl,
       ["perl", "-MAnyEvent::Fork::Serve", "-e", "AnyEvent::Fork::Serve::me", fileno $slave, $$],
       [map "$_=$env{$_}", keys %env],
    ) or die "unable to spawn AnyEvent::Fork server: $!";
-   $self->_new ($fh)
+   $self->_new ($fh, $pid)
+}
+=item $pid = $proc->pid
+Returns the process id of the process I<iff it is a direct child of the
+process> running AnyEvent::Fork, and C<undef> otherwise.
+Normally, only processes created via C<< AnyEvent::Fork->new_exec >> and
+L<AnyEvent::Fork::Template> are direct children, and you are responsible
+to clean up their zombies when they die.
+All other processes are not direct children, and will be cleaned up by
+AnyEvent::Fork.
+=cut
+sub pid {
+   $_[0][0]
 }
 =item $proc = $proc->eval ($perlcode, @args)
 Evaluates the given C<$perlcode> as ... perl code, while setting C<@_> to
-the strings specified by C<@args>.
+the strings specified by C<@args>, in the "main" package.
 This call is meant to do any custom initialisation that might be required
 (for example, the C<require> method uses it). It's not supposed to be used
 to completely take over the process, use C<run> for that.
 The code will usually be executed after this call returns, and there is no
 way to pass anything back to the calling process. Any evaluation errors
 will be reported to stderr and cause the process to exit.
+If you want to execute some code to take over the process (see the
+"fork+exec" example in the SYNOPSIS), you should compile a function via
+C<eval> first, and then call it via C<run>. This also gives you access to
+any arguments passed via the C<send_xxx> methods, such as file handles.
 Returns the process object for easy chaining of method calls.
 =cut
 sub eval {
    my ($self, $code, @args) = @_;
-   $self->_cmd (e => $code, @args);
+   $self->_cmd (e => pack "(w/a*)*", $code, @args);
    $self
 }
 =item $proc = $proc->require ($module, ...)
 =item $proc = $proc->send_arg ($string, ...)
 Send one or more argument strings to the process, to prepare a call to
 C<run>. The strings can be any octet string.
+The protocol is optimised to pass a moderate number of relatively short
+strings - while you can pass up to 4GB of data in one go, this is more
+meant to pass some ID information or other startup info, not big chunks of
+data.
 Returns the process object for easy chaining of method calls.
 =cut
 sub send_arg {
    my ($self, @arg) = @_;
-   $self->_cmd (a => @arg);
+   $self->_cmd (a => pack "(w/a*)*", @arg);
    $self
 }
 =item $proc->run ($func, $cb->($fh))
-Enter the function specified by the fully qualified name in C<$func> in
+Enter the function specified by the function name in C<$func> in the
-the process. The function is called with the communication socket as first
+process. The function is called with the communication socket as first
 argument, followed by all file handles and string arguments sent earlier
 via C<send_fh> and C<send_arg> methods, in the order they were called.
-If the called function returns, the process exits.
+The function name should be fully qualified, but if it isn't, it will be
+looked up in the main package.
-Preparing the process can take time - when the process is ready, the
+If the called function returns, doesn't exist, or any error occurs, the
+process exits.
+Preparing the process is done in the background - when all commands have
-callback is invoked with the local communications socket as argument.
+been sent, the callback is invoked with the local communications socket
+as argument. At this point you can start using the socket in any way you
+like.
-The process object becomes unusable on return from this function.
+The process object becomes unusable on return from this function - any
+further method calls result in undefined behaviour.
 If the communication socket isn't used, it should be closed on both sides,
 to save on kernel memory.
 The socket is non-blocking in the parent, and blocking in the newly
-created process. The close-on-exec flag is set on both. Even if not used
+created process. The close-on-exec flag is set in both.
-otherwise, the socket can be a good indicator for the existence of the
+Even if not used otherwise, the socket can be a good indicator for the
-process - if the other process exits, you get a readable event on it,
+existence of the process - if the other process exits, you get a readable
-because exiting the process closes the socket (if it didn't create any
+event on it, because exiting the process closes the socket (if it didn't
-children using fork).
+create any children using fork).
 Example: create a template for a process pool, pass a few strings, some
 file handles, then fork, pass one more string, and run some code.
    my $pool = AnyEvent::Fork
          ->send_arg ("str3")
          ->run ("Some::function", sub {
             my ($fh) = @_;
             # fh is nonblocking, but we trust that the OS can accept these
-            # extra 3 octets anyway.
+            # few octets anyway.
             syswrite $fh, "hi #$_\n";
             # $fh is being closed here, as we don't store it anywhere
          });
    }
    # Some::function might look like this - all parameters passed before fork
    # and after will be passed, in order, after the communications socket.
    sub Some::function {
       my ($fh, $str1, $str2, $fh1, $fh2, $str3) = @_;
-      print scalar <$fh>; # prints "hi 1\n" and "hi 2\n"
+      print scalar <$fh>; # prints "hi #1\n" and "hi #2\n" in any order
    }
 =cut
 sub run {
    my ($self, $func, $cb) = @_;
-   $self->[0] = $cb;
+   $self->[4] = $cb;
    $self->_cmd (r => $func);
 }
 =back
 =head1 PERFORMANCE
 Now for some unscientific benchmark numbers (all done on an amd64
 GNU/Linux box). These are intended to give you an idea of the relative
-performance you can expect.
+performance you can expect, they are not meant to be absolute performance
+numbers.
 OK, so, I ran a simple benchmark that creates a socket pair, forks, calls
 exit in the child and waits for the socket to close in the parent. I did
-load AnyEvent, EV and AnyEvent::Fork, for a total process size of 6312kB.
+load AnyEvent, EV and AnyEvent::Fork, for a total process size of 5100kB.
-   2079 new processes per second, using socketpair + fork manually
+   2079 new processes per second, using manual socketpair + fork
 Then I did the same thing, but instead of calling fork, I called
 AnyEvent::Fork->new->run ("CORE::exit") and then again waited for the
 socket form the child to close on exit. This does the same thing as manual
 socket pair + fork, except that what is forked is the template process
 This section lists typical problems that remain. I hope by recognising
 them, most can be avoided.
 =over 4
-=item exit runs destructors
 =item "leaked" file descriptors for exec'ed processes
 POSIX systems inherit file descriptors by default when exec'ing a new
 process. While perl itself laudably sets the close-on-exec flags on new
 file handles, most C libraries don't care, and even if all cared, it's
 The solution is to either not load these modules before use'ing
 L<AnyEvent::Fork::Early> or L<AnyEvent::Fork::Template>, or to delay
 initialising them, for example, by calling C<init Gtk2> manually.
+=item exit runs destructors
+This only applies to users of Lc<AnyEvent::Fork:Early> and
+L<AnyEvent::Fork::Template>.
+When a process created by AnyEvent::Fork exits, it might do so by calling
+exit, or simply letting perl reach the end of the program. At which point
+Perl runs all destructors.
+Not all destructors are fork-safe - for example, an object that represents
+the connection to an X display might tell the X server to free resources,
+which is inconvenient when the "real" object in the parent still needs to
+use them.
+This is obviously not a problem for L<AnyEvent::Fork::Early>, as you used
+it as the very first thing, right?
+It is a problem for L<AnyEvent::Fork::Template> though - and the solution
+is to not create objects with nontrivial destructors that might have an
+effect outside of Perl.
 =back
 =head1 PORTABILITY NOTES
 Native win32 perls are somewhat supported (AnyEvent::Fork::Early is a nop,

Diff Legend

-–
+Removed lines
-+
+Added lines
-<
+Changed lines
->
+Changed lines

Comparing AnyEvent-Fork/Fork.pm (file contents): Revision 1.17 by root, Fri Apr 5 23:42:24 2013 UTC vs. Revision 1.26 by root, Sat Apr 6 08:58:51 2013 UTC

Diff Legend

Comparing AnyEvent-Fork/Fork.pm (file contents):
Revision 1.17 by root, Fri Apr 5 23:42:24 2013 UTC vs.
Revision 1.26 by root, Sat Apr 6 08:58:51 2013 UTC