=head1 NAME Coro::Storable - offer a more fine-grained Storable interface =head1 SYNOPSIS use Coro::Storable; =head1 DESCRIPTION This module implements a few functions from the Storable module in a way so that it cede's more often. Some applications (such as the Deliantra game server) sometimes need to load large Storable objects without blocking the server for a long time. This is being implemented by using a perlio layer that feeds only small amounts of data (4096 bytes per call) into Storable, and C'ing regularly (at most 100 times per second by default, though). As Storable is not reentrant, this module also wraps most functions of the Storable module so that only one freeze or thaw is done at any one moment (and recursive invocations are not currently supported). =head1 FUNCTIONS =over 4 =item $ref = thaw $pst Retrieve an object from the given $pst, which must have been created with C or C/C (sorry, but Storable uses incompatible formats for disk/mem objects). This function will cede regularly. =item $pst = freeze $ref Freeze the given scalar into a Storable object. It uses the same format as C. This functino will cede regularly. =item $pst = nfreeze $ref Same as C but is compatible to C (note the C). =item $pst = blocking_freeze $ref Same as C but is guaranteed to block. This is useful e.g. in C when you want to serialise a data structure for use with the C function for this module. You cannot use C for this as Storable uses incompatible formats for memory and file images, and this module uses file images. =item $pst = blocking_nfreeze $ref Same as C but uses C internally. =item $guard = guard Acquire the Storable lock, for when you want to call Storable yourself. Note that this module already wraps all Storable functions, so there is rarely the need to do this yourself. =back =cut package Coro::Storable; use strict qw(subs vars); no warnings; use Coro (); use Coro::Semaphore (); BEGIN { # suppress warnings local $^W = 0; require Storable; } use Storable; use base "Exporter"; our $VERSION = 5.14; our @EXPORT = qw(thaw freeze nfreeze blocking_thaw blocking_freeze blocking_nfreeze); our $GRANULARITY = 0.01; my $lock = new Coro::Semaphore; sub guard { $lock->guard } # wrap xs functions for (qw(net_pstore pstore net_mstore mstore pretrieve mretrieve dclone)) { my $orig = \&{"Storable::$_"}; *{"Storable::$_"} = sub { my $guard = $lock->guard; &$orig }; die if $@; } sub thaw($) { open my $fh, "<:cede($GRANULARITY)", \$_[0] or die "cannot open pst via PerlIO::cede: $!"; Storable::fd_retrieve $fh } sub freeze($) { open my $fh, ">:cede($GRANULARITY)", \my $buf or die "cannot open pst via PerlIO::cede: $!"; Storable::store_fd $_[0], $fh; close $fh; $buf } sub nfreeze($) { open my $fh, ">:cede($GRANULARITY)", \my $buf or die "cannot open pst via PerlIO::cede: $!"; Storable::nstore_fd $_[0], $fh; close $fh; $buf } sub blocking_thaw($) { open my $fh, "<", \$_[0] or die "cannot open pst: $!"; Storable::fd_retrieve $fh } sub blocking_freeze($) { open my $fh, ">", \my $buf or die "cannot open pst: $!"; Storable::store_fd $_[0], $fh; close $fh; $buf } sub blocking_nfreeze($) { open my $fh, ">", \my $buf or die "cannot open pst: $!"; Storable::nstore_fd $_[0], $fh; close $fh; $buf } 1; =head1 AUTHOR Marc Lehmann http://home.schmorp.de/ =cut