[ViewVC] Diff of: cvs/AnyEvent-Fork-RPC/RPC.pm

Comparing AnyEvent-Fork-RPC/RPC.pm (file contents):
Revision 1.15 by root, Thu Apr 18 13:15:23 2013 UTC vs.
Revision 1.43 by root, Tue Mar 26 04:19:31 2019 UTC

…		…
2		2
3	AnyEvent::Fork::RPC - simple RPC extension for AnyEvent::Fork	3	AnyEvent::Fork::RPC - simple RPC extension for AnyEvent::Fork
4		4
5	=head1 SYNOPSIS	5	=head1 SYNOPSIS
6		6
		7	use AnyEvent::Fork;
7	use AnyEvent::Fork::RPC;	8	use AnyEvent::Fork::RPC;
8	# use AnyEvent::Fork is not needed
9		9
10	my $rpc = AnyEvent::Fork	10	my $rpc = AnyEvent::Fork
11	->new	11	->new
12	->require ("MyModule")	12	->require ("MyModule")
13	->AnyEvent::Fork::RPC::run (	13	->AnyEvent::Fork::RPC::run (
14	"MyModule::server",	14	"MyModule::server",
15	);	15	);
16		16
		17	use AnyEvent;
		18
17	my $cv = AE::cv;	19	my $cv = AE::cv;
18		20
19	$rpc->(1, 2, 3, sub {	21	$rpc->(1, 2, 3, sub {
20	print "MyModule::server returned @_\n";	22	print "MyModule::server returned @_\n";
21	$cv->send;	23	$cv->send;
…		…
24	$cv->recv;	26	$cv->recv;
25		27
26	=head1 DESCRIPTION	28	=head1 DESCRIPTION
27		29
28	This module implements a simple RPC protocol and backend for processes	30	This module implements a simple RPC protocol and backend for processes
29	created via L<AnyEvent::Fork>, allowing you to call a function in the	31	created via L<AnyEvent::Fork> or L<AnyEvent::Fork::Remote>, allowing you
30	child process and receive its return values (up to 4GB serialised).	32	to call a function in the child process and receive its return values (up
		33	to 4GB serialised).
31		34
32	It implements two different backends: a synchronous one that works like a	35	It implements two different backends: a synchronous one that works like a
33	normal function call, and an asynchronous one that can run multiple jobs	36	normal function call, and an asynchronous one that can run multiple jobs
34	concurrently in the child, using AnyEvent.	37	concurrently in the child, using AnyEvent.
35		38
36	It also implements an asynchronous event mechanism from the child to the	39	It also implements an asynchronous event mechanism from the child to the
37	parent, that could be used for progress indications or other information.	40	parent, that could be used for progress indications or other information.
38
39	Loading this module also always loads L<AnyEvent::Fork>, so you can make a
40	separate C<use AnyEvent::Fork> if you wish, but you don't have to.
41		41
42	=head1 EXAMPLES	42	=head1 EXAMPLES
43		43
44	=head2 Example 1: Synchronous Backend	44	=head2 Example 1: Synchronous Backend
45		45
…		…
49	silly, but illustrates the use of events.	49	silly, but illustrates the use of events.
50		50
51	First the parent process:	51	First the parent process:
52		52
53	use AnyEvent;	53	use AnyEvent;
		54	use AnyEvent::Fork;
54	use AnyEvent::Fork::RPC;	55	use AnyEvent::Fork::RPC;
55		56
56	my $done = AE::cv;	57	my $done = AE::cv;
57		58
58	my $rpc = AnyEvent::Fork	59	my $rpc = AnyEvent::Fork
59	->new	60	->new
60	->require ("MyWorker")	61	->require ("MyWorker")
61	->AnyEvent::Fork::RPC::run ("MyWorker::run",	62	->AnyEvent::Fork::RPC::run ("MyWorker::run",
62	on_error => sub { warn "FATAL: $_[0]"; exit 1 },	63	on_error => sub { warn "ERROR: $_[0]"; exit 1 },
63	on_event => sub { warn "$_[0] requests handled\n" },	64	on_event => sub { warn "$_[0] requests handled\n" },
64	on_destroy => $done,	65	on_destroy => $done,
65	);	66	);
66		67
67	for my $id (1..6) {	68	for my $id (1..6) {
…		…
174	you really I<are> done.	175	you really I<are> done.
175		176
176	=head2 Example 2: Asynchronous Backend	177	=head2 Example 2: Asynchronous Backend
177		178
178	This example implements multiple count-downs in the child, using	179	This example implements multiple count-downs in the child, using
179	L<AnyEvent> timers. While this is a bit silly (one could use timers in te	180	L<AnyEvent> timers. While this is a bit silly (one could use timers in the
180	parent just as well), it illustrates the ability to use AnyEvent in the	181	parent just as well), it illustrates the ability to use AnyEvent in the
181	child and the fact that responses can arrive in a different order then the	182	child and the fact that responses can arrive in a different order then the
182	requests.	183	requests.
183		184
184	It also shows how to embed the actual child code into a C<__DATA__>	185	It also shows how to embed the actual child code into a C<__DATA__>
…		…
189	so silly anymore.	190	so silly anymore.
190		191
191	Without further ado, here is the code:	192	Without further ado, here is the code:
192		193
193	use AnyEvent;	194	use AnyEvent;
		195	use AnyEvent::Fork;
194	use AnyEvent::Fork::RPC;	196	use AnyEvent::Fork::RPC;
195		197
196	my $done = AE::cv;	198	my $done = AE::cv;
197		199
198	my $rpc = AnyEvent::Fork	200	my $rpc = AnyEvent::Fork
199	->new	201	->new
200	->require ("AnyEvent::Fork::RPC::Async")	202	->require ("AnyEvent::Fork::RPC::Async")
201	->eval (do { local $/; <DATA> })	203	->eval (do { local $/; <DATA> })
202	->AnyEvent::Fork::RPC::run ("run",	204	->AnyEvent::Fork::RPC::run ("run",
203	async => 1,	205	async => 1,
204	on_error => sub { warn "FATAL: $_[0]"; exit 1 },	206	on_error => sub { warn "ERROR: $_[0]"; exit 1 },
205	on_event => sub { print $_[0] },	207	on_event => sub { print $_[0] },
206	on_destroy => $done,	208	on_destroy => $done,
207	);	209	);
208		210
209	for my $count (3, 2, 1) {	211	for my $count (3, 2, 1) {
…		…
285		287
286	This concludes the async example. Since L<AnyEvent::Fork> does not	288	This concludes the async example. Since L<AnyEvent::Fork> does not
287	actually fork, you are free to use about any module in the child, not just	289	actually fork, you are free to use about any module in the child, not just
288	L<AnyEvent>, but also L<IO::AIO>, or L<Tk> for example.	290	L<AnyEvent>, but also L<IO::AIO>, or L<Tk> for example.
289		291
		292	=head2 Example 3: Asynchronous backend with Coro
		293
		294	With L<Coro> you can create a nice asynchronous backend implementation by
		295	defining an rpc server function that creates a new Coro thread for every
		296	request that calls a function "normally", i.e. the parameters from the
		297	parent process are passed to it, and any return values are returned to the
		298	parent process, e.g.:
		299
		300	package My::Arith;
		301
		302	sub add {
		303	return $_[0] + $_[1];
		304	}
		305
		306	sub mul {
		307	return $_[0] * $_[1];
		308	}
		309
		310	sub run {
		311	my ($done, $func, @arg) = @_;
		312
		313	Coro::async_pool {
		314	$done->($func->(@arg));
		315	};
		316	}
		317
		318	The C<run> function creates a new thread for every invocation, using the
		319	first argument as function name, and calls the C<$done> callback on it's
		320	return values. This makes it quite natural to define the C<add> and C<mul>
		321	functions to add or multiply two numbers and return the result.
		322
		323	Since this is the asynchronous backend, it's quite possible to define RPC
		324	function that do I/O or wait for external events - their execution will
		325	overlap as needed.
		326
		327	The above could be used like this:
		328
		329	my $rpc = AnyEvent::Fork
		330	->new
		331	->require ("MyWorker")
		332	->AnyEvent::Fork::RPC::run ("My::Arith::run",
		333	on_error => ..., on_event => ..., on_destroy => ...,
		334	);
		335
		336	$rpc->(add => 1, 3, Coro::rouse_cb); say Coro::rouse_wait;
		337	$rpc->(mul => 3, 2, Coro::rouse_cb); say Coro::rouse_wait;
		338
		339	The C<say>'s will print C<4> and C<6>.
		340
		341	=head2 Example 4: Forward AnyEvent::Log messages using C<on_event>
		342
		343	This partial example shows how to use the C<event> function to forward
		344	L<AnyEvent::Log> messages to the parent.
		345
		346	For this, the parent needs to provide a suitable C<on_event>:
		347
		348	->AnyEvent::Fork::RPC::run (
		349	on_event => sub {
		350	if ($_[0] eq "ae_log") {
		351	my (undef, $level, $message) = @_;
		352	AE::log $level, $message;
		353	} else {
		354	# other event types
		355	}
		356	},
		357	)
		358
		359	In the child, as early as possible, the following code should reconfigure
		360	L<AnyEvent::Log> to log via C<AnyEvent::Fork::RPC::event>:
		361
		362	$AnyEvent::Log::LOG->log_cb (sub {
		363	my ($timestamp, $orig_ctx, $level, $message) = @{+shift};
		364
		365	if (defined &AnyEvent::Fork::RPC::event) {
		366	AnyEvent::Fork::RPC::event (ae_log => $level, $message);
		367	} else {
		368	warn "[$$ before init] $message\n";
		369	}
		370	});
		371
		372	There is an important twist - the C<AnyEvent::Fork::RPC::event> function
		373	is only defined when the child is fully initialised. If you redirect the
		374	log messages in your C<init> function for example, then the C<event>
		375	function might not yet be available. This is why the log callback checks
		376	whether the fucntion is there using C<defined>, and only then uses it to
		377	log the message.
		378
290	=head1 PARENT PROCESS USAGE	379	=head1 PARENT PROCESS USAGE
291		380
292	This module exports nothing, and only implements a single function:	381	This module exports nothing, and only implements a single function:
293		382
294	=over 4	383	=over 4
…		…
301		390
302	use Errno ();	391	use Errno ();
303	use Guard ();	392	use Guard ();
304		393
305	use AnyEvent;	394	use AnyEvent;
306	use AnyEvent::Fork; # we don't actually depend on it, this is for convenience
307		395
308	our $VERSION = 0.1;	396	our $VERSION = 1.24;
309		397
310	=item my $rpc = AnyEvent::Fork::RPC::run $fork, $function, [key => value...]	398	=item my $rpc = AnyEvent::Fork::RPC::run $fork, $function, [key => value...]
311		399
312	The traditional way to call it. But it is way cooler to call it in the	400	The traditional way to call it. But it is way cooler to call it in the
313	following way:	401	following way:
…		…
333	Called on (fatal) errors, with a descriptive (hopefully) message. If	421	Called on (fatal) errors, with a descriptive (hopefully) message. If
334	this callback is not provided, but C<on_event> is, then the C<on_event>	422	this callback is not provided, but C<on_event> is, then the C<on_event>
335	callback is called with the first argument being the string C<error>,	423	callback is called with the first argument being the string C<error>,
336	followed by the error message.	424	followed by the error message.
337		425
338	If neither handler is provided it prints the error to STDERR and will	426	If neither handler is provided, then the error is reported with loglevel
339	start failing badly.	427	C<error> via C<AE::log>.
340		428
341	=item on_event => $cb->(...)	429	=item on_event => $cb->(...)
342		430
343	Called for every call to the C<AnyEvent::Fork::RPC::event> function in the	431	Called for every call to the C<AnyEvent::Fork::RPC::event> function in the
344	child, with the arguments of that function passed to the callback.	432	child, with the arguments of that function passed to the callback.
…		…
366	It is called very early - before the serialisers are created or the	454	It is called very early - before the serialisers are created or the
367	C<$function> name is resolved into a function reference, so it could be	455	C<$function> name is resolved into a function reference, so it could be
368	used to load any modules that provide the serialiser or function. It can	456	used to load any modules that provide the serialiser or function. It can
369	not, however, create events.	457	not, however, create events.
370		458
		459	=item done => $function (default C<CORE::exit>)
		460
		461	The function to call when the asynchronous backend detects an end of file
		462	condition when reading from the communications socket I<and> there are no
		463	outstanding requests. It's ignored by the synchronous backend.
		464
		465	By overriding this you can prolong the life of a RPC process after e.g.
		466	the parent has exited by running the event loop in the provided function
		467	(or simply calling it, for example, when your child process uses L<EV> you
		468	could provide L<EV::run> as C<done> function).
		469
		470	Of course, in that case you are responsible for exiting at the appropriate
		471	time and not returning from
		472
371	=item async => $boolean (default: 0)	473	=item async => $boolean (default: 0)
372		474
373	The default server used in the child does all I/O blockingly, and only	475	The default server used in the child does all I/O blockingly, and only
374	allows a single RPC call to execute concurrently.	476	allows a single RPC call to execute concurrently.
375		477
…		…
392		494
393	All arguments, result data and event data have to be serialised to be	495	All arguments, result data and event data have to be serialised to be
394	transferred between the processes. For this, they have to be frozen and	496	transferred between the processes. For this, they have to be frozen and
395	thawed in both parent and child processes.	497	thawed in both parent and child processes.
396		498
397	By default, only octet strings can be passed between the processes, which	499	By default, only octet strings can be passed between the processes,
398	is reasonably fast and efficient and requires no extra modules.	500	which is reasonably fast and efficient and requires no extra modules
		501	(the C<AnyEvent::Fork::RPC> distribution does not provide these extra
		502	serialiser modules).
399		503
400	For more complicated use cases, you can provide your own freeze and thaw	504	For more complicated use cases, you can provide your own freeze and thaw
401	functions, by specifying a string with perl source code. It's supposed to	505	functions, by specifying a string with perl source code. It's supposed to
402	return two code references when evaluated: the first receives a list of	506	return two code references when evaluated: the first receives a list of
403	perl values and must return an octet string. The second receives the octet	507	perl values and must return an octet string. The second receives the octet
…		…
405		509
406	If you need an external module for serialisation, then you can either	510	If you need an external module for serialisation, then you can either
407	pre-load it into your L<AnyEvent::Fork> process, or you can add a C<use>	511	pre-load it into your L<AnyEvent::Fork> process, or you can add a C<use>
408	or C<require> statement into the serialiser string. Or both.	512	or C<require> statement into the serialiser string. Or both.
409		513
410	Here are some examples - some of them are also available as global	514	Here are some examples - all of them are also available as global
411	variables that make them easier to use.	515	variables that make them easier to use.
412		516
413	=over 4	517	=over 4
414		518
415	=item octet strings - C<$AnyEvent::Fork::RPC::STRING_SERIALISER>	519	=item C<$AnyEvent::Fork::RPC::STRING_SERIALISER> - octet strings only
416		520
417	This serialiser concatenates length-prefixes octet strings, and is the	521	This serialiser (currently the default) concatenates length-prefixes octet
418	default.	522	strings, and is the default. That means you can only pass (and return)
		523	strings containing character codes 0-255.
		524
		525	The main advantages of this serialiser are the high speed and that it
		526	doesn't need another module. The main disadvantage is that you are very
		527	limited in what you can pass - only octet strings.
419		528
420	Implementation:	529	Implementation:
421		530
422	(	531	(
423	sub { pack "(w/a)", @_ },	532	sub { pack "(w/a)", @_ },
424	sub { unpack "(w/a)", shift }	533	sub { unpack "(w/a)", shift }
425	)	534	)
426		535
427	=item json - C<$AnyEvent::Fork::RPC::JSON_SERIALISER>	536	=item C<$AnyEvent::Fork::RPC::CBOR_XS_SERIALISER> - uses L<CBOR::XS>
		537
		538	This serialiser creates CBOR::XS arrays - you have to make sure the
		539	L<CBOR::XS> module is installed for this serialiser to work. It can be
		540	beneficial for sharing when you preload the L<CBOR::XS> module in a template
		541	process.
		542
		543	L<CBOR::XS> is about as fast as the octet string serialiser, but supports
		544	complex data structures (similar to JSON) and is faster than any of the
		545	other serialisers. If you have the L<CBOR::XS> module available, it's the
		546	best choice.
		547
		548	The encoder enables C<allow_sharing> (so this serialisation method can
		549	encode cyclic and self-referencing data structures).
		550
		551	Implementation:
		552
		553	use CBOR::XS ();
		554	(
		555	sub { CBOR::XS::encode_cbor_sharing \@_ },
		556	sub { @{ CBOR::XS::decode_cbor shift } }
		557	)
		558
		559	=item C<$AnyEvent::Fork::RPC::JSON_SERIALISER> - uses L<JSON::XS> or L<JSON>
428		560
429	This serialiser creates JSON arrays - you have to make sure the L<JSON>	561	This serialiser creates JSON arrays - you have to make sure the L<JSON>
430	module is installed for this serialiser to work. It can be beneficial for	562	module is installed for this serialiser to work. It can be beneficial for
431	sharing when you preload the L<JSON> module in a template process.	563	sharing when you preload the L<JSON> module in a template process.
432		564
…		…
440	(	572	(
441	sub { JSON::encode_json \@_ },	573	sub { JSON::encode_json \@_ },
442	sub { @{ JSON::decode_json shift } }	574	sub { @{ JSON::decode_json shift } }
443	)	575	)
444		576
445	=item storable - C<$AnyEvent::Fork::RPC::STORABLE_SERIALISER>	577	=item C<$AnyEvent::Fork::RPC::STORABLE_SERIALISER> - L<Storable>
446		578
447	This serialiser uses L<Storable>, which means it has high chance of	579	This serialiser uses L<Storable>, which means it has high chance of
448	serialising just about anything you throw at it, at the cost of having	580	serialising just about anything you throw at it, at the cost of having
449	very high overhead per operation. It also comes with perl.	581	very high overhead per operation. It also comes with perl. It should be
		582	used when you need to serialise complex data structures.
450		583
451	Implementation:	584	Implementation:
452		585
453	use Storable ();	586	use Storable ();
454	(	587	(
455	sub { Storable::freeze \@_ },	588	sub { Storable::freeze \@_ },
456	sub { @{ Storable::thaw shift } }	589	sub { @{ Storable::thaw shift } }
457	)	590	)
458		591
		592	=item C<$AnyEvent::Fork::RPC::NSTORABLE_SERIALISER> - portable Storable
		593
		594	This serialiser also uses L<Storable>, but uses it's "network" format
		595	to serialise data, which makes it possible to talk to different
		596	perl binaries (for example, when talking to a process created with
		597	L<AnyEvent::Fork::Remote>).
		598
		599	Implementation:
		600
		601	use Storable ();
		602	(
		603	sub { Storable::nfreeze \@_ },
		604	sub { @{ Storable::thaw shift } }
		605	)
		606
459	=back	607	=back
460		608
461	=back	609	=back
462		610
463	See the examples section earlier in this document for some actual	611	See the examples section earlier in this document for some actual
464	examples.	612	examples.
465		613
466	=cut	614	=cut
467		615
468	our $STRING_SERIALISER = '(sub { pack "(w/a)", @_ }, sub { unpack "(w/a)", shift })';	616	our $STRING_SERIALISER = '(sub { pack "(w/a)", @_ }, sub { unpack "(w/a)", shift })';
		617	our $CBOR_XS_SERIALISER = 'use CBOR::XS (); (sub { CBOR::XS::encode_cbor_sharing \@_ }, sub { @{ CBOR::XS::decode_cbor shift } })';
469	our $JSON_SERIALISER = 'use JSON (); (sub { JSON::encode_json \@_ }, sub { @{ JSON::decode_json shift } })';	618	our $JSON_SERIALISER = 'use JSON (); (sub { JSON::encode_json \@_ }, sub { @{ JSON::decode_json shift } })';
470	our $STORABLE_SERIALISER = 'use Storable (); (sub { Storable::freeze \@_ }, sub { @{ Storable::thaw shift } })';	619	our $STORABLE_SERIALISER = 'use Storable (); (sub { Storable::freeze \@_ }, sub { @{ Storable::thaw shift } })';
		620	our $NSTORABLE_SERIALISER = 'use Storable (); (sub { Storable::nfreeze \@_ }, sub { @{ Storable::thaw shift } })';
471		621
472	sub run {	622	sub run {
473	my ($self, $function, %arg) = @_;	623	my ($self, $function, %arg) = @_;
474		624
475	my $serialiser = delete $arg{serialiser} \|\| $STRING_SERIALISER;	625	my $serialiser = delete $arg{serialiser} \|\| $STRING_SERIALISER;
…		…
478	my $on_destroy = delete $arg{on_destroy};	628	my $on_destroy = delete $arg{on_destroy};
479		629
480	# default for on_error is to on_event, if specified	630	# default for on_error is to on_event, if specified
481	$on_error \|\|= $on_event	631	$on_error \|\|= $on_event
482	? sub { $on_event->(error => shift) }	632	? sub { $on_event->(error => shift) }
483	: sub { die "AnyEvent::Fork::RPC: uncaught error: $_[0].\n" };	633	: sub { AE::log die => "AnyEvent::Fork::RPC: uncaught error: $_[0]." };
484		634
485	# default for on_event is to raise an error	635	# default for on_event is to raise an error
486	$on_event \|\|= sub { $on_error->("event received, but no on_event handler") };	636	$on_event \|\|= sub { $on_error->("event received, but no on_event handler") };
487		637
488	my ($f, $t) = eval $serialiser; die $@ if $@;	638	my ($f, $t) = eval $serialiser; die $@ if $@;
…		…
509	};	659	};
510		660
511	my $module = "AnyEvent::Fork::RPC::" . ($arg{async} ? "Async" : "Sync");	661	my $module = "AnyEvent::Fork::RPC::" . ($arg{async} ? "Async" : "Sync");
512		662
513	$self->require ($module)	663	$self->require ($module)
514	->send_arg ($function, $arg{init}, $serialiser)	664	->send_arg ($function, $arg{init}, $serialiser, $arg{done} \|\| "$module\::do_exit")
515	->run ("$module\::run", sub {	665	->run ("$module\::run", sub {
516	$fh = shift;	666	$fh = shift
		667	or return $on_error->("connection failed");
517		668
518	my ($id, $len);	669	my ($id, $len);
519	$rw = AE::io $fh, 0, sub {	670	$rw = AE::io $fh, 0, sub {
520	$rlen = $rlen * 2 + 16 if $rlen - 128 < length $rbuf;	671	$rlen = $rlen * 2 + 16 if $rlen - 128 < length $rbuf;
521	$len = sysread $fh, $rbuf, $rlen - length $rbuf, length $rbuf;	672	$len = sysread $fh, $rbuf, $rlen - length $rbuf, length $rbuf;
522		673
523	if ($len) {	674	if ($len) {
524	while (8 <= length $rbuf) {	675	while (8 <= length $rbuf) {
525	($id, $len) = unpack "LL", $rbuf;	676	($id, $len) = unpack "NN", $rbuf;
526	8 + $len <= length $rbuf	677	8 + $len <= length $rbuf
527	or last;	678	or last;
528		679
529	my @r = $t->(substr $rbuf, 8, $len);	680	my @r = $t->(substr $rbuf, 8, $len);
530	substr $rbuf, 0, 8 + $len, "";	681	substr $rbuf, 0, 8 + $len, "";
…		…
546	undef $rw; undef $ww; # it ends here	697	undef $rw; undef $ww; # it ends here
547		698
548	if (@rcb \|\| %rcb) {	699	if (@rcb \|\| %rcb) {
549	$on_error->("unexpected eof");	700	$on_error->("unexpected eof");
550	} else {	701	} else {
551	$on_destroy->();	702	$on_destroy->()
		703	if $on_destroy;
552	}	704	}
553	} elsif ($! != Errno::EAGAIN && $! != Errno::EWOULDBLOCK) {	705	} elsif ($! != Errno::EAGAIN && $! != Errno::EWOULDBLOCK) {
554	undef $rw; undef $ww; # it ends here	706	undef $rw; undef $ww; # it ends here
555	$on_error->("read: $!");	707	$on_error->("read: $!");
556	}	708	}
…		…
559	$ww \|\|= AE::io $fh, 1, $wcb;	711	$ww \|\|= AE::io $fh, 1, $wcb;
560	});	712	});
561		713
562	my $guard = Guard::guard {	714	my $guard = Guard::guard {
563	$shutdown = 1;	715	$shutdown = 1;
564	$ww \|\|= $fh && AE::io $fh, 1, $wcb;	716
		717	shutdown $fh, 1 if $fh && !$ww;
565	};	718	};
566		719
567	my $id;	720	my $id;
568		721
569	$arg{async}	722	$arg{async}
…		…
571	$id = ($id == 0xffffffff ? 0 : $id) + 1;	724	$id = ($id == 0xffffffff ? 0 : $id) + 1;
572	$id = ($id == 0xffffffff ? 0 : $id) + 1 while exists $rcb{$id}; # rarely loops	725	$id = ($id == 0xffffffff ? 0 : $id) + 1 while exists $rcb{$id}; # rarely loops
573		726
574	$rcb{$id} = pop;	727	$rcb{$id} = pop;
575		728
576	$guard; # keep it alive	729	$guard if 0; # keep it alive
577		730
578	$wbuf .= pack "LL/a*", $id, &$f;	731	$wbuf .= pack "NN/a*", $id, &$f;
579	$ww \|\|= $fh && AE::io $fh, 1, $wcb;	732	$ww \|\|= $fh && AE::io $fh, 1, $wcb;
580	}	733	}
581	: sub {	734	: sub {
582	push @rcb, pop;	735	push @rcb, pop;
583		736
584	$guard; # keep it alive	737	$guard; # keep it alive
585		738
586	$wbuf .= pack "L/a*", &$f;	739	$wbuf .= pack "N/a*", &$f;
587	$ww \|\|= $fh && AE::io $fh, 1, $wcb;	740	$ww \|\|= $fh && AE::io $fh, 1, $wcb;
588	}	741	}
589	}	742	}
590		743
591	=item $rpc->(..., $cb->(...))	744	=item $rpc->(..., $cb->(...))
…		…
630	child process to the parent, except that there is no notion of return	783	child process to the parent, except that there is no notion of return
631	values.	784	values.
632		785
633	See the examples section earlier in this document for some actual	786	See the examples section earlier in this document for some actual
634	examples.	787	examples.
		788
		789	Note: the event data, like any data send to the parent, might not be sent
		790	immediatelly but queued for later sending, so there is no guarantee that
		791	the event has been sent to the parent when the call returns - when you
		792	e.g. exit directly after calling this function, the parent might never
		793	receive the event.
		794
		795	=back
		796
		797	=head2 PROCESS EXIT
		798
		799	If and when the child process exits depends on the backend and
		800	configuration. Apart from explicit exits (e.g. by calling C<exit>) or
		801	runtime conditions (uncaught exceptions, signals etc.), the backends exit
		802	under these conditions:
		803
		804	=over 4
		805
		806	=item Synchronous Backend
		807
		808	The synchronous backend is very simple: when the process waits for another
		809	request to arrive and the writing side (usually in the parent) is closed,
		810	it will exit normally, i.e. as if your main program reached the end of the
		811	file.
		812
		813	That means that if your parent process exits, the RPC process will usually
		814	exit as well, either because it is idle anyway, or because it executes a
		815	request. In the latter case, you will likely get an error when the RPc
		816	process tries to send the results to the parent (because agruably, you
		817	shouldn't exit your parent while there are still outstanding requests).
		818
		819	The process is usually quiescent when it happens, so it should rarely be a
		820	problem, and C<END> handlers can be used to clean up.
		821
		822	=item Asynchronous Backend
		823
		824	For the asynchronous backend, things are more complicated: Whenever it
		825	listens for another request by the parent, it might detect that the socket
		826	was closed (e.g. because the parent exited). It will sotp listening for
		827	new requests and instead try to write out any remaining data (if any) or
		828	simply check whether the socket can be written to. After this, the RPC
		829	process is effectively done - no new requests are incoming, no outstanding
		830	request data can be written back.
		831
		832	Since chances are high that there are event watchers that the RPC server
		833	knows nothing about (why else would one use the async backend if not for
		834	the ability to register watchers?), the event loop would often happily
		835	continue.
		836
		837	This is why the asynchronous backend explicitly calls C<CORE::exit> when
		838	it is done (under other circumstances, such as when there is an I/O error
		839	and there is outstanding data to write, it will log a fatal message via
		840	L<AnyEvent::Log>, also causing the program to exit).
		841
		842	You can override this by specifying a function name to call via the C<done>
		843	parameter instead.
635		844
636	=back	845	=back
637		846
638	=head1 ADVANCED TOPICS	847	=head1 ADVANCED TOPICS
639		848
…		…
695	are queued and the jobs are slow, they will all run concurrently. The	904	are queued and the jobs are slow, they will all run concurrently. The
696	child must implement some queueing/limiting mechanism if this causes	905	child must implement some queueing/limiting mechanism if this causes
697	problems. Alternatively, the parent could limit the amount of rpc calls	906	problems. Alternatively, the parent could limit the amount of rpc calls
698	that are outstanding.	907	that are outstanding.
699		908
700	Blocking use of condvars is not supported.	909	Blocking use of condvars is not supported (in the main thread, outside of
		910	e.g. L<Coro> threads).
701		911
702	Using event-based modules such as L<IO::AIO>, L<Gtk2>, L<Tk> and so on is	912	Using event-based modules such as L<IO::AIO>, L<Gtk2>, L<Tk> and so on is
703	easy.	913	easy.
704		914
705	=back	915	=back
…		…
722	half it has passed earlier.	932	half it has passed earlier.
723		933
724	Here is some (untested) pseudocode to that effect:	934	Here is some (untested) pseudocode to that effect:
725		935
726	use AnyEvent::Util;	936	use AnyEvent::Util;
		937	use AnyEvent::Fork;
727	use AnyEvent::Fork::RPC;	938	use AnyEvent::Fork::RPC;
728	use IO::FDPass;	939	use IO::FDPass;
729		940
730	my ($s1, $s2) = AnyEvent::Util::portable_socketpair;	941	my ($s1, $s2) = AnyEvent::Util::portable_socketpair;
731		942
…		…
767		978
768	Of course, this might be blocking if you pass a lot of file descriptors,	979	Of course, this might be blocking if you pass a lot of file descriptors,
769	so you might want to look into L<AnyEvent::FDpasser> which can handle the	980	so you might want to look into L<AnyEvent::FDpasser> which can handle the
770	gory details.	981	gory details.
771		982
		983	=head1 EXCEPTIONS
		984
		985	There are no provisions whatsoever for catching exceptions at this time -
		986	in the child, exceptions might kill the process, causing calls to be lost
		987	and the parent encountering a fatal error. In the parent, exceptions in
		988	the result callback will not be caught and cause undefined behaviour.
		989
772	=head1 SEE ALSO	990	=head1 SEE ALSO
773		991
774	L<AnyEvent::Fork> (to create the processes in the first place),	992	L<AnyEvent::Fork>, to create the processes in the first place.
		993
		994	L<AnyEvent::Fork::Remote>, likewise, but helpful for remote processes.
		995
775	L<AnyEvent::Fork::Pool> (to manage whole pools of processes).	996	L<AnyEvent::Fork::Pool>, to manage whole pools of processes.
776		997
777	=head1 AUTHOR AND CONTACT INFORMATION	998	=head1 AUTHOR AND CONTACT INFORMATION
778		999
779	Marc Lehmann <schmorp@schmorp.de>	1000	Marc Lehmann <schmorp@schmorp.de>
780	http://software.schmorp.de/pkg/AnyEvent-Fork-RPC	1001	http://software.schmorp.de/pkg/AnyEvent-Fork-RPC

Diff Legend

-–
+Removed lines
-+
+Added lines
-<
+Changed lines
->
+Changed lines

Comparing AnyEvent-Fork-RPC/RPC.pm (file contents): Revision 1.15 by root, Thu Apr 18 13:15:23 2013 UTC vs. Revision 1.43 by root, Tue Mar 26 04:19:31 2019 UTC

Diff Legend

Comparing AnyEvent-Fork-RPC/RPC.pm (file contents):
Revision 1.15 by root, Thu Apr 18 13:15:23 2013 UTC vs.
Revision 1.43 by root, Tue Mar 26 04:19:31 2019 UTC