ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/lib/AnyEvent/Log.pm
(Generate patch)

Comparing AnyEvent/lib/AnyEvent/Log.pm (file contents):
Revision 1.13 by root, Sat Aug 20 01:34:12 2011 UTC vs.
Revision 1.70 by root, Tue Sep 3 11:46:29 2019 UTC

2 2
3AnyEvent::Log - simple logging "framework" 3AnyEvent::Log - simple logging "framework"
4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 # simple use 7Simple uses:
8
8 use AnyEvent; 9 use AnyEvent;
9 10
10 AE::log debug => "hit my knee"; 11 AE::log fatal => "No config found, cannot continue!"; # never returns
11 AE::log warn => "it's a bit too hot"; 12 AE::log alert => "The battery died!";
12 AE::log error => "the flag was false!"; 13 AE::log crit => "The battery is too hot!";
13 AE::log fatal => "the bit toggled! run!"; 14 AE::log error => "Division by zero attempted.";
15 AE::log warn => "Couldn't delete the file.";
16 AE::log note => "Attempted to create config, but config already exists.";
17 AE::log info => "File soandso successfully deleted.";
18 AE::log debug => "the function returned 3";
19 AE::log trace => "going to call function abc";
14 20
15 # "complex" use 21Log level overview:
22
23 LVL NAME SYSLOG PERL NOTE
24 1 fatal emerg exit system unusable, aborts program!
25 2 alert failure in primary system
26 3 critical crit failure in backup system
27 4 error err die non-urgent program errors, a bug
28 5 warn warning possible problem, not necessarily error
29 6 note notice unusual conditions
30 7 info normal messages, no action required
31 8 debug debugging messages for development
32 9 trace copious tracing output
33
34"Complex" uses (for speed sensitive code, e.g. trace/debug messages):
35
16 use AnyEvent::Log; 36 use AnyEvent::Log;
17 37
18 my $tracer = AnyEvent::Log::logger trace => \$my $trace; 38 my $tracer = AnyEvent::Log::logger trace => \my $trace;
19 39
20 $tracer->("i am here") if $trace; 40 $tracer->("i am here") if $trace;
21 $tracer->(sub { "lots of data: " . Dumper $self }) if $trace; 41 $tracer->(sub { "lots of data: " . Dumper $self }) if $trace;
22 42
23 # configuration 43Configuration (also look at the EXAMPLES section):
24 44
25 # set logging for this package to maximum 45 # set default logging level to suppress anything below "notice"
46 # i.e. enable logging at "notice" or above - the default is to
47 # to not log anything at all.
48 $AnyEvent::Log::FILTER->level ("notice");
49
50 # set logging for the current package to errors and higher only
26 AnyEvent::Log::ctx->level ("all"); 51 AnyEvent::Log::ctx->level ("error");
27 52
28 # set logging globally to anything below debug 53 # enable logging for the current package, regardless of global logging level
54 AnyEvent::Log::ctx->attach ($AnyEvent::Log::LOG);
55
56 # enable debug logging for module some::mod and enable logging by default
29 (AnyEvent::Log::ctx "")->level ("notice"); 57 (AnyEvent::Log::ctx "some::mod")->level ("debug");
58 (AnyEvent::Log::ctx "some::mod")->attach ($AnyEvent::Log::LOG);
30 59
31 # see also EXAMPLES, below 60 # send all critical and higher priority messages to syslog,
32 61 # regardless of (most) other settings
33 # disable logging for package "AnyEvent" and all packages below it 62 $AnyEvent::Log::COLLECT->attach (new AnyEvent::Log::Ctx
34 AnyEvent->AnyEvent::Log::ctx->level (0); 63 level => "critical",
35 64 log_to_syslog => "user",
36 # log everything below debug to a file, for the whole program 65 );
37 my $ctx = AnyEvent::Log::ctx;
38 $ctx->log_cb (sub { print FILE shift; 0 });
39 (AnyEvent::Log::ctx "")->add ($ctx);
40 66
41=head1 DESCRIPTION 67=head1 DESCRIPTION
42 68
43This module implements a relatively simple "logging framework". It doesn't 69This module implements a relatively simple "logging framework". It doesn't
44attempt to be "the" logging solution or even "a" logging solution for 70attempt to be "the" logging solution or even "a" logging solution for
45AnyEvent - AnyEvent simply creates logging messages internally, and this 71AnyEvent - AnyEvent simply creates logging messages internally, and this
46module more or less exposes the mechanism, with some extra spiff to allow 72module more or less exposes the mechanism, with some extra spiff to allow
47using it from other modules as well. 73using it from other modules as well.
48 74
49Remember that the default verbosity level is C<0>, so nothing will be 75Remember that the default verbosity level is C<4> (C<error>), so only
50logged, unless you set C<PERL_ANYEVENT_VERBOSE> to a higher number before 76errors and more important messages will be logged, unless you set
51starting your program, or change the logging level at runtime with 77C<PERL_ANYEVENT_VERBOSE> to a higher number before starting your program
52something like: 78(C<AE_VERBOSE=5> is recommended during development), or change the logging
79level at runtime with something like:
53 80
54 use AnyEvent; 81 use AnyEvent::Log;
55 (AnyEvent::Log::ctx "")->level ("info"); 82 $AnyEvent::Log::FILTER->level ("info");
56 83
57The design goal behind this module was to keep it simple (and small), 84The design goal behind this module was to keep it simple (and small),
58but make it powerful enough to be potentially useful for any module, and 85but make it powerful enough to be potentially useful for any module,
59extensive enough for the most common tasks, such as logging to multiple 86and extensive enough for the most common tasks, such as logging to
60targets, or being able to log into a database. 87multiple targets, or being able to log into a database.
88
89The module is also usable before AnyEvent itself is initialised, in which
90case some of the functionality might be reduced.
91
92The amount of documentation might indicate otherwise, but the runtime part
93of the module is still just below 300 lines of code.
94
95=head1 LOGGING LEVELS
96
97Logging levels in this module range from C<1> (highest priority) to C<9>
98(lowest priority). Note that the lowest numerical value is the highest
99priority, so when this document says "higher priority" it means "lower
100numerical value".
101
102Instead of specifying levels by name you can also specify them by aliases:
103
104 LVL NAME SYSLOG PERL NOTE
105 1 fatal emerg exit system unusable, aborts program!
106 2 alert failure in primary system
107 3 critical crit failure in backup system
108 4 error err die non-urgent program errors, a bug
109 5 warn warning possible problem, not necessarily error
110 6 note notice unusual conditions
111 7 info normal messages, no action required
112 8 debug debugging messages for development
113 9 trace copious tracing output
114
115As you can see, some logging levels have multiple aliases - the first one
116is the "official" name, the second one the "syslog" name (if it differs)
117and the third one the "perl" name, suggesting (only!) that you log C<die>
118messages at C<error> priority. The NOTE column tries to provide some
119rationale on how to chose a logging level.
120
121As a rough guideline, levels 1..3 are primarily meant for users of the
122program (admins, staff), and are the only ones logged to STDERR by
123default. Levels 4..6 are meant for users and developers alike, while
124levels 7..9 are usually meant for developers.
125
126You can normally only log a message once at highest priority level (C<1>,
127C<fatal>), because logging a fatal message will also quit the program - so
128use it sparingly :)
129
130For example, a program that finds an unknown switch on the commandline
131might well use a fatal logging level to tell users about it - the "system"
132in this case would be the program, or module.
133
134Some methods also offer some extra levels, such as C<0>, C<off>, C<none>
135or C<all> - these are only valid for the methods that documented them.
61 136
62=head1 LOGGING FUNCTIONS 137=head1 LOGGING FUNCTIONS
63 138
64These functions allow you to log messages. They always use the caller's 139The following functions allow you to log messages. They always use the
65package as a "logging module/source". Also, the main logging function is 140caller's package as a "logging context". Also, the main logging function,
66callable as C<AnyEvent::log> or C<AE::log> when the C<AnyEvent> module is 141C<log>, is aliased to C<AnyEvent::log> and C<AE::log> when the C<AnyEvent>
67loaded. 142module is loaded.
68 143
69=over 4 144=over 4
70 145
71=cut 146=cut
72 147
73package AnyEvent::Log; 148package AnyEvent::Log;
74 149
75use Carp (); 150use Carp ();
76use POSIX (); 151use POSIX ();
77 152
153# layout of a context
154# 0 1 2 3 4, 5
155# [$title, $level, %$slaves, &$logcb, &$fmtcb, $cap]
156
78use AnyEvent (); BEGIN { AnyEvent::common_sense } 157use AnyEvent (); BEGIN { AnyEvent::common_sense }
79use AnyEvent::Util (); 158#use AnyEvent::Util (); need to load this in a delayed fashion, as it uses AE::log
159
160our $VERSION = $AnyEvent::VERSION;
161
162our ($COLLECT, $FILTER, $LOG);
80 163
81our ($now_int, $now_str1, $now_str2); 164our ($now_int, $now_str1, $now_str2);
82 165
83# Format Time, not public - yet? 166# Format Time, not public - yet?
84sub ft($) { 167sub format_time($) {
85 my $i = int $_[0]; 168 my $i = int $_[0];
86 my $f = sprintf "%06d", 1e6 * ($_[0] - $i); 169 my $f = sprintf "%06d", 1e6 * ($_[0] - $i);
87 170
88 ($now_int, $now_str1, $now_str2) = ($i, split /\x01/, POSIX::strftime "%Y-%m-%d %H:%M:%S.\x01 %z", localtime $i) 171 ($now_int, $now_str1, $now_str2) = ($i, split /\x01/, POSIX::strftime "%Y-%m-%d %H:%M:%S.\x01 %z", localtime $i)
89 if $now_int != $i; 172 if $now_int != $i;
90 173
91 "$now_str1$f$now_str2" 174 "$now_str1$f$now_str2"
92} 175}
93 176
94our %CTX; # all logging contexts 177our %CTX; # all package contexts
95 178
96# creates a default package context object for the given package 179# creates a default package context object for the given package
97sub _pkg_ctx($) { 180sub _pkg_ctx($) {
98 my $ctx = bless [$_[0], (1 << 10) - 1 - 1, {}], "AnyEvent::Log::Ctx"; 181 my $ctx = bless [$_[0], (1 << 10) - 1 - 1, {}], "AnyEvent::Log::Ctx";
99 182
100 # link "parent" package 183 # link "parent" package
101 my $pkg = $_[0] =~ /^(.+)::/ ? $1 : "AE::Log::Top"; 184 my $parent = $_[0] =~ /^(.+)::/
185 ? $CTX{$1} ||= &_pkg_ctx ("$1")
186 : $COLLECT;
102 187
103 $pkg = $CTX{$pkg} ||= &_pkg_ctx ($pkg);
104 $ctx->[2]{$pkg+0} = $pkg; 188 $ctx->[2]{$parent+0} = $parent;
105 189
106 $ctx 190 $ctx
107} 191}
108 192
109=item AnyEvent::Log::log $level, $msg[, @args] 193=item AnyEvent::Log::log $level, $msg[, @args]
110 194
111Requests logging of the given C<$msg> with the given log level (1..9). 195Requests logging of the given C<$msg> with the given log level, and
112You can also use the following strings as log level: C<fatal> (1), 196returns true if the message was logged I<somewhere>.
113C<alert> (2), C<critical> (3), C<error> (4), C<warn> (5), C<note> (6),
114C<info> (7), C<debug> (8), C<trace> (9).
115 197
116For C<fatal> log levels, the program will abort. 198For loglevel C<fatal>, the program will abort.
117 199
118If only a C<$msg> is given, it is logged as-is. With extra C<@args>, the 200If only a C<$msg> is given, it is logged as-is. With extra C<@args>, the
119C<$msg> is interpreted as an sprintf format string. 201C<$msg> is interpreted as an sprintf format string.
120 202
121The C<$msg> should not end with C<\n>, but may if that is convenient for 203The C<$msg> should not end with C<\n>, but may if that is convenient for
124Last not least, C<$msg> might be a code reference, in which case it is 206Last not least, C<$msg> might be a code reference, in which case it is
125supposed to return the message. It will be called only then the message 207supposed to return the message. It will be called only then the message
126actually gets logged, which is useful if it is costly to create the 208actually gets logged, which is useful if it is costly to create the
127message in the first place. 209message in the first place.
128 210
211This function takes care of saving and restoring C<$!> and C<$@>, so you
212don't have to.
213
129Whether the given message will be logged depends on the maximum log level 214Whether the given message will be logged depends on the maximum log level
130and the caller's package. 215and the caller's package. The return value can be used to ensure that
216messages or not "lost" - for example, when L<AnyEvent::Debug> detects a
217runtime error it tries to log it at C<die> level, but if that message is
218lost it simply uses warn.
131 219
132Note that you can (and should) call this function as C<AnyEvent::log> or 220Note that you can (and should) call this function as C<AnyEvent::log> or
133C<AE::log>, without C<use>-ing this module if possible (i.e. you don't 221C<AE::log>, without C<use>-ing this module if possible (i.e. you don't
134need any additional functionality), as those functions will load the 222need any additional functionality), as those functions will load the
135logging module on demand only. They are also much shorter to write. 223logging module on demand only. They are also much shorter to write.
152 240
153=cut 241=cut
154 242
155# also allow syslog equivalent names 243# also allow syslog equivalent names
156our %STR2LEVEL = ( 244our %STR2LEVEL = (
157 fatal => 1, emerg => 1, 245 fatal => 1, emerg => 1, exit => 1,
158 alert => 2, 246 alert => 2,
159 critical => 3, crit => 3, 247 critical => 3, crit => 3,
160 error => 4, err => 4, 248 error => 4, err => 4, die => 4,
161 warn => 5, warning => 5, 249 warn => 5, warning => 5,
162 note => 6, notice => 6, 250 note => 6, notice => 6,
163 info => 7, 251 info => 7,
164 debug => 8, 252 debug => 8,
165 trace => 9, 253 trace => 9,
166); 254);
167 255
168sub now () { time } 256our $TIME_EXACT;
257
258sub exact_time($) {
259 $TIME_EXACT = shift;
260 *_ts = $AnyEvent::MODEL
261 ? $TIME_EXACT ? \&AE::now : \&AE::time
262 : sub () { $TIME_EXACT ? do { require Time::HiRes; Time::HiRes::time () } : time };
263}
264
265BEGIN {
266 exact_time 0;
267}
169 268
170AnyEvent::post_detect { 269AnyEvent::post_detect {
171 *now = \&AE::now; 270 exact_time $TIME_EXACT;
172}; 271};
173 272
174our @LEVEL2STR = qw(0 fatal alert crit error warn note info debug trace); 273our @LEVEL2STR = qw(0 fatal alert crit error warn note info debug trace);
175 274
176# time, ctx, level, msg 275# time, ctx, level, msg
177sub _format($$$$) { 276sub default_format($$$$) {
178 my $ts = ft $_[0]; 277 my $ts = format_time $_[0];
179 my $ct = " "; 278 my $ct = " ";
180 279
181 my @res; 280 my @res;
182 281
183 for (split /\n/, sprintf "%-5s %s: %s", $LEVEL2STR[$_[2]], $_[1][0], $_[3]) { 282 for (split /\n/, sprintf "%-5s %s: %s", $LEVEL2STR[$_[2]], $_[1][0], $_[3]) {
186 } 285 }
187 286
188 join "", @res 287 join "", @res
189} 288}
190 289
290sub fatal_exit() {
291 exit 1;
292}
293
191sub _log { 294sub _log {
192 my ($ctx, $level, $format, @args) = @_; 295 my ($ctx, $level, $format, @args) = @_;
193 296
194 $level = $level > 0 && $level <= 9 297 $level = $level > 0 && $level <= 9
195 ? $level+0 298 ? $level+0
196 : $STR2LEVEL{$level} || Carp::croak "$level: not a valid logging level, caught"; 299 : $STR2LEVEL{$level} || Carp::croak "$level: not a valid logging level, caught";
197 300
198 my $mask = 1 << $level; 301 my $mask = 1 << $level;
199 302
200 my (%seen, @ctx, $now, $fmt); 303 my ($success, %seen, @ctx, $now, @fmt);
201 304
202 do 305 do
203 { 306 {
204 # skip if masked 307 # if !ref, then it's a level number
308 if (!ref $ctx) {
309 $level = $ctx;
205 if ($ctx->[1] & $mask && !$seen{$ctx+0}++) { 310 } elsif ($ctx->[1] & $mask and !$seen{$ctx+0}++) {
311 # logging/recursing into this context
312
313 # level cap
314 if ($ctx->[5] > $level) {
315 push @ctx, $level; # restore level when going up in tree
316 $level = $ctx->[5];
317 }
318
319 # log if log cb
206 if ($ctx->[3]) { 320 if ($ctx->[3]) {
207 # logging target found 321 # logging target found
322
323 local ($!, $@);
208 324
209 # now get raw message, unless we have it already 325 # now get raw message, unless we have it already
210 unless ($now) { 326 unless ($now) {
211 $format = $format->() if ref $format; 327 $format = $format->() if ref $format;
212 $format = sprintf $format, @args if @args; 328 $format = sprintf $format, @args if @args;
213 $format =~ s/\n$//; 329 $format =~ s/\n$//;
214 $now = AE::now; 330 $now = _ts;
215 }; 331 };
216 332
217 # format msg 333 # format msg
218 my $str = $ctx->[4] 334 my $str = $ctx->[4]
219 ? $ctx->[4]($now, $_[0], $level, $format) 335 ? $ctx->[4]($now, $_[0], $level, $format)
220 : $fmt ||= _format $now, $_[0], $level, $format; 336 : ($fmt[$level] ||= default_format $now, $_[0], $level, $format);
221 337
338 $success = 1;
339
222 $ctx->[3]($str); 340 $ctx->[3]($str)
341 or push @ctx, values %{ $ctx->[2] }; # not consumed - propagate
342 } else {
343 push @ctx, values %{ $ctx->[2] }; # not masked - propagate
223 } 344 }
224
225 # not masked, not consumed - propagate to parent contexts
226 push @ctx, values %{ $ctx->[2] };
227 } 345 }
228 } 346 }
229 while $ctx = pop @ctx; 347 while $ctx = pop @ctx;
230 348
231 exit 1 if $level <= 1; 349 fatal_exit if $level <= 1;
350
351 $success
232} 352}
233 353
234sub log($$;@) { 354sub log($$;@) {
235 _log 355 _log
236 $CTX{ (caller)[0] } ||= _pkg_ctx +(caller)[0], 356 $CTX{ (caller)[0] } ||= _pkg_ctx +(caller)[0],
237 @_; 357 @_;
238} 358}
239 359
240*AnyEvent::log = *AE::log = \&log;
241
242=item $logger = AnyEvent::Log::logger $level[, \$enabled] 360=item $logger = AnyEvent::Log::logger $level[, \$enabled]
243 361
244Creates a code reference that, when called, acts as if the 362Creates a code reference that, when called, acts as if the
245C<AnyEvent::Log::log> function was called at this point with the givne 363C<AnyEvent::Log::log> function was called at this point with the given
246level. C<$logger> is passed a C<$msg> and optional C<@args>, just as with 364level. C<$logger> is passed a C<$msg> and optional C<@args>, just as with
247the C<AnyEvent::Log::log> function: 365the C<AnyEvent::Log::log> function:
248 366
249 my $debug_log = AnyEvent::Log::logger "debug"; 367 my $debug_log = AnyEvent::Log::logger "debug";
250 368
275 # and later in your program 393 # and later in your program
276 $debug_log->("yo, stuff here") if $debug; 394 $debug_log->("yo, stuff here") if $debug;
277 395
278 $debug and $debug_log->("123"); 396 $debug and $debug_log->("123");
279 397
280Note: currently the enabled var is always true - that will be fixed in a
281future version :)
282
283=cut 398=cut
284 399
285our %LOGGER; 400our %LOGGER;
286 401
287# re-assess logging status for all loggers 402# re-assess logging status for all loggers
288sub _reassess { 403sub _reassess {
404 local $SIG{__DIE__};
405 my $die = sub { die };
406
289 for (@_ ? $LOGGER{$_[0]} : values %LOGGER) { 407 for (@_ ? $LOGGER{$_[0]} : values %LOGGER) {
290 my ($ctx, $level, $renabled) = @$_; 408 my ($ctx, $level, $renabled) = @$_;
291 409
292 # to detect whether a message would be logged, we # actually 410 # to detect whether a message would be logged, we actually
293 # try to log one and die. this isn't fast, but we can be 411 # try to log one and die. this isn't fast, but we can be
294 # sure that the logging decision is correct :) 412 # sure that the logging decision is correct :)
295 413
296 $$renabled = !eval { 414 $$renabled = !eval {
297 local $SIG{__DIE__};
298
299 _log $ctx, $level, sub { die }; 415 _log $ctx, $level, $die;
300 416
301 1 417 1
302 }; 418 };
303
304 $$renabled = 1; # TODO
305 } 419 }
306} 420}
307 421
308sub _logger($;$) { 422sub _logger {
309 my ($ctx, $level, $renabled) = @_; 423 my ($ctx, $level, $renabled) = @_;
310 424
311 $renabled ||= \my $enabled;
312
313 $$renabled = 1; 425 $$renabled = 1;
314 426
315 my $logger = [$ctx, $level, $renabled]; 427 my $logger = [$ctx, $level, $renabled];
316 428
317 $LOGGER{$logger+0} = $logger; 429 $LOGGER{$logger+0} = $logger;
318 430
319 _reassess $logger+0; 431 _reassess $logger+0;
320 432
433 require AnyEvent::Util unless $AnyEvent::Util::VERSION;
321 my $guard = AnyEvent::Util::guard { 434 my $guard = AnyEvent::Util::guard (sub {
322 # "clean up" 435 # "clean up"
323 delete $LOGGER{$logger+0}; 436 delete $LOGGER{$logger+0};
324 }; 437 });
325 438
326 sub { 439 sub {
327 $guard if 0; # keep guard alive, but don't cause runtime overhead 440 $guard if 0; # keep guard alive, but don't cause runtime overhead
328 441
329 _log $ctx, $level, @_ 442 _log $ctx, $level, @_
334sub logger($;$) { 447sub logger($;$) {
335 _logger 448 _logger
336 $CTX{ (caller)[0] } ||= _pkg_ctx +(caller)[0], 449 $CTX{ (caller)[0] } ||= _pkg_ctx +(caller)[0],
337 @_ 450 @_
338} 451}
452
453=item AnyEvent::Log::exact_time $on
454
455By default, C<AnyEvent::Log> will use C<AE::now>, i.e. the cached
456eventloop time, for the log timestamps. After calling this function with a
457true value it will instead resort to C<AE::time>, i.e. fetch the current
458time on each log message. This only makes a difference for event loops
459that actually cache the time (such as L<EV> or L<AnyEvent::Loop>).
460
461This setting can be changed at any time by calling this function.
462
463Since C<AnyEvent::Log> has to work even before the L<AnyEvent> has been
464initialised, this switch will also decide whether to use C<CORE::time> or
465C<Time::HiRes::time> when logging a message before L<AnyEvent> becomes
466available.
467
468=item AnyEvent::Log::format_time $timestamp
469
470Formats a timestamp as returned by C<< AnyEvent->now >> or C<<
471AnyEvent->time >> or many other functions in the same way as
472C<AnyEvent::Log> does.
473
474In your main program (as opposed to in your module) you can override
475the default timestamp display format by loading this module and then
476redefining this function.
477
478Most commonly, this function can be used in formatting callbacks.
479
480=item AnyEvent::Log::default_format $time, $ctx, $level, $msg
481
482Format a log message using the given timestamp, logging context, log level
483and log message.
484
485This is the formatting function used to format messages when no custom
486function is provided.
487
488In your main program (as opposed to in your module) you can override the
489default message format by loading this module and then redefining this
490function.
491
492=item AnyEvent::Log::fatal_exit()
493
494This is the function that is called after logging a C<fatal> log
495message. It must not return.
496
497The default implementation simply calls C<exit 1>.
498
499In your main program (as opposed to in your module) you can override
500the fatal exit function by loading this module and then redefining this
501function. Make sure you don't return.
339 502
340=back 503=back
341 504
342=head1 LOGGING CONTEXTS 505=head1 LOGGING CONTEXTS
343 506
356timestamp, context, level and string message and formats it in the way 519timestamp, context, level and string message and formats it in the way
357it should be logged) and a logging callback (which is responsible for 520it should be logged) and a logging callback (which is responsible for
358actually logging the formatted message and telling C<AnyEvent::Log> 521actually logging the formatted message and telling C<AnyEvent::Log>
359whether it has consumed the message, or whether it should be propagated). 522whether it has consumed the message, or whether it should be propagated).
360 523
361For propagation, a context can have any number of attached I<parent 524For propagation, a context can have any number of attached I<slave
362contexts>. Any message that is neither masked by the logging mask nor 525contexts>. Any message that is neither masked by the logging mask nor
363masked by the logging callback returning true will be passed to all parent 526masked by the logging callback returning true will be passed to all slave
364contexts. 527contexts.
365 528
366Each call to a logging function will log the message at most once per 529Each call to a logging function will log the message at most once per
367context, so it does not matter (much) if there are cycles or if the 530context, so it does not matter (much) if there are cycles or if the
368message can arrive at the same context via multiple paths. 531message can arrive at the same context via multiple paths.
372By default, all logging contexts have an full set of log levels ("all"), a 535By default, all logging contexts have an full set of log levels ("all"), a
373disabled logging callback and the default formatting callback. 536disabled logging callback and the default formatting callback.
374 537
375Package contexts have the package name as logging title by default. 538Package contexts have the package name as logging title by default.
376 539
377They have exactly one parent - the context of the "parent" package. The 540They have exactly one slave - the context of the "parent" package. The
378parent package is simply defined to be the package name without the last 541parent package is simply defined to be the package name without the last
379component, i.e. C<AnyEvent::Debug::Wrapped> becomes C<AnyEvent::Debug>, 542component, i.e. C<AnyEvent::Debug::Wrapped> becomes C<AnyEvent::Debug>,
380and C<AnyEvent> becomes ... C<AnyEvent::Log::Top> which is the 543and C<AnyEvent> becomes ... C<$AnyEvent::Log::COLLECT> which is the
381exception of the rule - just like the parent of any package name in 544exception of the rule - just like the "parent" of any single-component
382Perl is C<main>, the default parent of any top-level package context is 545package name in Perl is C<main>, the default slave of any top-level
383C<AnyEvent::Log::Top>. 546package context is C<$AnyEvent::Log::COLLECT>.
384 547
385Since perl packages form only an approximate hierarchy, this parent 548Since perl packages form only an approximate hierarchy, this slave
386context can of course be removed. 549context can of course be removed.
387 550
388All other (anonymous) contexts have no parents and an empty title by 551All other (anonymous) contexts have no slaves and an empty title by
389default. 552default.
390 553
391When the module is loaded it creates the default context called 554When the module is loaded it creates the C<$AnyEvent::Log::LOG> logging
392C<AnyEvent::Log::Default> (also stored in C<$AnyEvent::Log::Default>), 555context that simply logs everything via C<warn>, without propagating
393which simply logs everything to STDERR and doesn't propagate anything
394anywhere by default. The purpose of the default context is to provide 556anything anywhere by default. The purpose of this context is to provide
395a convenient place to override the global logging target or to attach 557a convenient place to override the global logging target or to attach
396additional log targets. It's not meant for filtering. 558additional log targets. It's not meant for filtering.
397 559
398It then creates the root context called C<AnyEvent::Log::Root> (also 560It then creates the C<$AnyEvent::Log::FILTER> context whose
399stored in C<$AnyEvent::Log::Root>) and sets its log level set to all 561purpose is to suppress all messages with priority higher
400levels up to the one specified by C<$ENV{PERL_ANYEVENT_VERBOSE}>. It 562than C<$ENV{PERL_ANYEVENT_VERBOSE}>. It then attached the
401then attached the default logging context to it. The purpose of the root 563C<$AnyEvent::Log::LOG> context to it. The purpose of the filter context
402context is to simply provide filtering according to some global log level. 564is to simply provide filtering according to some global log level.
403 565
404Finally it creates the top-level package context called 566Finally it creates the top-level package context C<$AnyEvent::Log::COLLECT>
405C<AnyEvent::Log::Top> (also stored in, you might have guessed, 567and attaches the C<$AnyEvent::Log::FILTER> context to it, but otherwise
406C<$AnyEvent::Log::Top>) and attached the root context but otherwise leaves
407it at default config. It's purpose is simply to collect all log messages 568leaves it at default config. Its purpose is simply to collect all log
408system-wide. 569messages system-wide.
409 570
410These three special contexts can also be referred to by the 571The hierarchy is then:
411package/context names C<AE::Log::Default>, C<AE::Log::Root> and
412C<AE::Log::Top>.
413 572
573 any package, eventually -> $COLLECT -> $FILTER -> $LOG
574
414The effect of all this is that log messages, by default, wander up 575The effect of all this is that log messages, by default, wander up to the
415to the root context where log messages with lower priority then 576C<$AnyEvent::Log::COLLECT> context where all messages normally end up,
577from there to C<$AnyEvent::Log::FILTER> where log messages with lower
416C<$ENV{PERL_ANYEVENT_VERBOSE}> will be filtered away and then to the 578priority then C<$ENV{PERL_ANYEVENT_VERBOSE}> will be filtered out and then
417AnyEvent::Log::Default context to be logged to STDERR. 579to the C<$AnyEvent::Log::LOG> context to be passed to C<warn>.
418 580
419Splitting the top level context into three contexts makes it easy to set 581This makes it easy to set a global logging level (by modifying $FILTER),
420a global logging level (by modifying the root context), but still allow 582but still allow other contexts to send, for example, their debug and trace
421other contexts to log, for example, their debug and trace messages to the
422default target despite the global logging level, or to attach additional 583messages to the $LOG target despite the global logging level, or to attach
423log targets that log messages, regardless of the global logging level. 584additional log targets that log messages, regardless of the global logging
585level.
424 586
425It also makes it easy to replace the default STDERR-logger by something 587It also makes it easy to modify the default warn-logger ($LOG) to
426that logs to a file, or to attach additional logging targets. 588something that logs to a file, or to attach additional logging targets
589(such as loggign to a file) by attaching it to $FILTER.
427 590
428=head2 CREATING/FINDING/DESTROYING CONTEXTS 591=head2 CREATING/FINDING/DESTROYING CONTEXTS
429 592
430=over 4 593=over 4
431 594
432=item $ctx = AnyEvent::Log::ctx [$pkg] 595=item $ctx = AnyEvent::Log::ctx [$pkg]
433 596
434This function creates or returns a logging context (which is an object). 597This function creates or returns a logging context (which is an object).
435 598
436If a package name is given, then the context for that packlage is 599If a package name is given, then the context for that package is
437returned. If it is called without any arguments, then the context for the 600returned. If it is called without any arguments, then the context for the
438callers package is returned (i.e. the same context as a C<AE::log> call 601callers package is returned (i.e. the same context as a C<AE::log> call
439would use). 602would use).
440 603
441If C<undef> is given, then it creates a new anonymous context that is not 604If C<undef> is given, then it creates a new anonymous context that is not
453 : bless [undef, (1 << 10) - 1 - 1], "AnyEvent::Log::Ctx" 616 : bless [undef, (1 << 10) - 1 - 1], "AnyEvent::Log::Ctx"
454} 617}
455 618
456=item AnyEvent::Log::reset 619=item AnyEvent::Log::reset
457 620
458Deletes all contexts and recreates the default hierarchy, i.e. resets the 621Resets all package contexts and recreates the default hierarchy if
459logging subsystem to defaults. 622necessary, i.e. resets the logging subsystem to defaults, as much as
623possible. This process keeps references to contexts held by other parts of
624the program intact.
460 625
461This can be used to implement config-file (re-)loading: before loading a 626This can be used to implement config-file (re-)loading: before loading a
462configuration, reset all contexts. 627configuration, reset all contexts.
463 628
464=cut 629=cut
465 630
631our $ORIG_VERBOSE = $AnyEvent::VERBOSE;
632$AnyEvent::VERBOSE = 9;
633
466sub reset { 634sub reset {
467 @$_ = () for values %CTX; # just to be sure - to kill circular logging dependencies 635 # hard to kill complex data structures
468 %CTX = (); 636 # we "recreate" all package loggers and reset the hierarchy
637 while (my ($k, $v) = each %CTX) {
638 @$v = ($k, (1 << 10) - 1 - 1, { });
469 639
470 my $default = ctx undef; 640 $v->attach ($k =~ /^(.+)::/ ? $CTX{$1} : $AnyEvent::Log::COLLECT);
471 $default->title ("AnyEvent::Log::Default");
472 $default->log_cb (sub {
473 print STDERR shift;
474 0
475 }); 641 }
476 $AnyEvent::Log::Default = $CTX{"AnyEvent::Log::Default"} = $CTX{"AE::Log::Default"} = $default;
477 642
478 my $root = ctx undef; 643 @$_ = ($_->[0], (1 << 10) - 1 - 1)
479 $root->title ("AnyEvent::Log::Root"); 644 for $LOG, $FILTER, $COLLECT;
480 $root->level ($AnyEvent::VERBOSE);
481 $root->attach ($default);
482 $AnyEvent::Log::Root = $CTX{"AnyEvent::Log::Root"} = $CTX{"AE::Log::Root"} = $root;
483 645
484 my $top = ctx undef; 646 #$LOG->slaves;
485 $top->title ("AnyEvent::Log::Top"); 647 $LOG->title ('$AnyEvent::Log::LOG');
486 $top->attach ($root); 648 $LOG->log_to_warn;
487 $AnyEvent::Log::Top = $CTX{"AnyEvent::Log::Top"} = $CTX{"AE::Log::Top"} = $top; 649
650 $FILTER->slaves ($LOG);
651 $FILTER->title ('$AnyEvent::Log::FILTER');
652 $FILTER->level ($ORIG_VERBOSE);
653
654 $COLLECT->slaves ($FILTER);
655 $COLLECT->title ('$AnyEvent::Log::COLLECT');
656
657 _reassess;
488} 658}
659
660# override AE::log/logger
661*AnyEvent::log = *AE::log = \&log;
662*AnyEvent::logger = *AE::logger = \&logger;
663
664# convert AnyEvent loggers to AnyEvent::Log loggers
665$_->[0] = ctx $_->[0] # convert "pkg" to "ctx"
666 for values %LOGGER;
667
668# create the default logger contexts
669$LOG = ctx undef;
670$FILTER = ctx undef;
671$COLLECT = ctx undef;
489 672
490AnyEvent::Log::reset; 673AnyEvent::Log::reset;
491 674
492# hello, CPAN, please catch me 675# hello, CPAN, please catch me
493package AnyEvent::Log::Default;
494package AE::Log::Default;
495package AnyEvent::Log::Root;
496package AE::Log::Root;
497package AnyEvent::Log::Top; 676package AnyEvent::Log::LOG;
498package AE::Log::Top; 677package AE::Log::LOG;
678package AnyEvent::Log::FILTER;
679package AE::Log::FILTER;
680package AnyEvent::Log::COLLECT;
681package AE::Log::COLLECT;
499 682
500package AnyEvent::Log::Ctx; 683package AnyEvent::Log::Ctx;
501
502# 0 1 2 3 4
503# [$title, $level, %$parents, &$logcb, &$fmtcb]
504 684
505=item $ctx = new AnyEvent::Log::Ctx methodname => param... 685=item $ctx = new AnyEvent::Log::Ctx methodname => param...
506 686
507This is a convenience constructor that makes it simpler to construct 687This is a convenience constructor that makes it simpler to construct
508anonymous logging contexts. 688anonymous logging contexts.
511name as the key with the value as parameter, unless the value is an 691name as the key with the value as parameter, unless the value is an
512arrayref, in which case it calls the method with the contents of the 692arrayref, in which case it calls the method with the contents of the
513array. The methods are called in the same order as specified. 693array. The methods are called in the same order as specified.
514 694
515Example: create a new logging context and set both the default logging 695Example: create a new logging context and set both the default logging
516level, some parent contexts and a logging callback. 696level, some slave contexts and a logging callback.
517 697
518 $ctx = new AnyEvent::Log::Ctx 698 $ctx = new AnyEvent::Log::Ctx
519 title => "dubious messages", 699 title => "dubious messages",
520 level => "error", 700 level => "error",
521 log_cb => sub { print STDOUT shift; 0 }, 701 log_cb => sub { print STDOUT shift; 0 },
522 parents => [$ctx1, $ctx, $ctx2], 702 slaves => [$ctx1, $ctx, $ctx2],
523 ; 703 ;
524 704
525=back 705=back
526 706
527=cut 707=cut
595Enables logging for the given levels, leaving all others unchanged. 775Enables logging for the given levels, leaving all others unchanged.
596 776
597=item $ctx->disable ($level[, $level...]) 777=item $ctx->disable ($level[, $level...])
598 778
599Disables logging for the given levels, leaving all others unchanged. 779Disables logging for the given levels, leaving all others unchanged.
780
781=item $ctx->cap ($level)
782
783Caps the maximum priority to the given level, for all messages logged
784to, or passing through, this context. That is, while this doesn't affect
785whether a message is logged or passed on, the maximum priority of messages
786will be limited to the specified level - messages with a higher priority
787will be set to the specified priority.
788
789Another way to view this is that C<< ->level >> filters out messages with
790a too low priority, while C<< ->cap >> modifies messages with a too high
791priority.
792
793This is useful when different log targets have different interpretations
794of priority. For example, for a specific command line program, a wrong
795command line switch might well result in a C<fatal> log message, while the
796same message, logged to syslog, is likely I<not> fatal to the system or
797syslog facility as a whole, but more likely a mere C<error>.
798
799This can be modeled by having a stderr logger that logs messages "as-is"
800and a syslog logger that logs messages with a level cap of, say, C<error>,
801or, for truly system-critical components, actually C<critical>.
600 802
601=cut 803=cut
602 804
603sub _lvl_lst { 805sub _lvl_lst {
604 map { 806 map {
606 : $_ eq "all" ? (1 .. 9) 808 : $_ eq "all" ? (1 .. 9)
607 : $STR2LEVEL{$_} || Carp::croak "$_: not a valid logging level, caught" 809 : $STR2LEVEL{$_} || Carp::croak "$_: not a valid logging level, caught"
608 } @_ 810 } @_
609} 811}
610 812
813sub _lvl {
814 $_[0] =~ /^(?:0|off|none)$/ ? 0 : (_lvl_lst $_[0])[-1]
815}
816
611our $NOP_CB = sub { 0 }; 817our $NOP_CB = sub { 0 };
612 818
613sub levels { 819sub levels {
614 my $ctx = shift; 820 my $ctx = shift;
615 $ctx->[1] = 0; 821 $ctx->[1] = 0;
618 AnyEvent::Log::_reassess; 824 AnyEvent::Log::_reassess;
619} 825}
620 826
621sub level { 827sub level {
622 my $ctx = shift; 828 my $ctx = shift;
623 my $lvl = $_[0] =~ /^(?:0|off|none)$/ ? 0 : (_lvl_lst $_[0])[-1];
624
625 $ctx->[1] = ((1 << $lvl) - 1) << 1; 829 $ctx->[1] = ((1 << &_lvl) - 1) << 1;
626 AnyEvent::Log::_reassess; 830 AnyEvent::Log::_reassess;
627} 831}
628 832
629sub enable { 833sub enable {
630 my $ctx = shift; 834 my $ctx = shift;
638 $ctx->[1] &= ~(1 << $_) 842 $ctx->[1] &= ~(1 << $_)
639 for &_lvl_lst; 843 for &_lvl_lst;
640 AnyEvent::Log::_reassess; 844 AnyEvent::Log::_reassess;
641} 845}
642 846
847sub cap {
848 my $ctx = shift;
849 $ctx->[5] = &_lvl;
850}
851
643=back 852=back
644 853
645=head3 PARENT CONTEXTS 854=head3 SLAVE CONTEXTS
646 855
647The following methods attach and detach another logging context to a 856The following methods attach and detach another logging context to a
648logging context. 857logging context.
649 858
650Log messages are propagated to all parent contexts, unless the logging 859Log messages are propagated to all slave contexts, unless the logging
651callback consumes the message. 860callback consumes the message.
652 861
653=over 4 862=over 4
654 863
655=item $ctx->attach ($ctx2[, $ctx3...]) 864=item $ctx->attach ($ctx2[, $ctx3...])
656 865
657Attaches the given contexts as parents to this context. It is not an error 866Attaches the given contexts as slaves to this context. It is not an error
658to add a context twice (the second add will be ignored). 867to add a context twice (the second add will be ignored).
659 868
660A context can be specified either as package name or as a context object. 869A context can be specified either as package name or as a context object.
661 870
662=item $ctx->detach ($ctx2[, $ctx3...]) 871=item $ctx->detach ($ctx2[, $ctx3...])
663 872
664Removes the given parents from this context - it's not an error to attempt 873Removes the given slaves from this context - it's not an error to attempt
665to remove a context that hasn't been added. 874to remove a context that hasn't been added.
666 875
667A context can be specified either as package name or as a context object. 876A context can be specified either as package name or as a context object.
668 877
669=item $ctx->parents ($ctx2[, $ctx3...]) 878=item $ctx->slaves ($ctx2[, $ctx3...])
670 879
671Replaces all parents attached to this context by the ones given. 880Replaces all slaves attached to this context by the ones given.
672 881
673=cut 882=cut
674 883
675sub attach { 884sub attach {
676 my $ctx = shift; 885 my $ctx = shift;
677 886
678 $ctx->[2]{$_+0} = $_ 887 $ctx->[2]{$_+0} = $_
679 for map { AnyEvent::Log::ctx $_ } @_; 888 for map { AnyEvent::Log::ctx $_ } @_;
889 AnyEvent::Log::_reassess;
680} 890}
681 891
682sub detach { 892sub detach {
683 my $ctx = shift; 893 my $ctx = shift;
684 894
685 delete $ctx->[2]{$_+0} 895 delete $ctx->[2]{$_+0}
686 for map { AnyEvent::Log::ctx $_ } @_; 896 for map { AnyEvent::Log::ctx $_ } @_;
897 AnyEvent::Log::_reassess;
687} 898}
688 899
689sub parents { 900sub slaves {
690 undef $_[0][2]; 901 undef $_[0][2];
691 &attach; 902 &attach;
903 AnyEvent::Log::_reassess;
692} 904}
693 905
694=back 906=back
695 907
696=head3 MESSAGE LOGGING 908=head3 LOG TARGETS
697 909
698The following methods configure how the logging context actually does 910The following methods configure how the logging context actually does
699the logging (which consists of formatting the message and printing it or 911the logging (which consists of formatting the message and printing it or
700whatever it wants to do with it) and also allows you to log messages 912whatever it wants to do with it).
701directly to a context, without going via your package context.
702 913
703=over 4 914=over 4
704 915
705=item $ctx->log_cb ($cb->($str)) 916=item $ctx->log_cb ($cb->($str))
706 917
711(see C<fmt_cb> below) - normally simple text strings that end with a 922(see C<fmt_cb> below) - normally simple text strings that end with a
712newline (and are possibly multiline themselves). 923newline (and are possibly multiline themselves).
713 924
714It also has to return true iff it has consumed the log message, and false 925It also has to return true iff it has consumed the log message, and false
715if it hasn't. Consuming a message means that it will not be sent to any 926if it hasn't. Consuming a message means that it will not be sent to any
716parent context. When in doubt, return C<0> from your logging callback. 927slave context. When in doubt, return C<0> from your logging callback.
717 928
718Example: a very simple logging callback, simply dump the message to STDOUT 929Example: a very simple logging callback, simply dump the message to STDOUT
719and do not consume it. 930and do not consume it.
720 931
721 $ctx->log_cb (sub { print STDERR shift; 0 }); 932 $ctx->log_cb (sub { print STDERR shift; 0 });
729your program. 940your program.
730 941
731 $ctx->levels ("debug", "trace"); 942 $ctx->levels ("debug", "trace");
732 $ctx->log_cb (sub { 1 }); # do not log, but eat debug and trace messages 943 $ctx->log_cb (sub { 1 }); # do not log, but eat debug and trace messages
733 944
734=item $ctx->fmt_cb ($fmt_cb->($timestamp, $ctx, $level, $message)) 945=item $ctx->fmt_cb ($fmt_cb->($timestamp, $orig_ctx, $level, $message))
735 946
736Replaces the formatting callback on the context (C<undef> restores the 947Replaces the formatting callback on the context (C<undef> restores the
737default formatter). 948default formatter).
738 949
739The callback is passed the (possibly fractional) timestamp, the original 950The callback is passed the (possibly fractional) timestamp, the original
740logging context, the (numeric) logging level and the raw message string and needs to 951logging context (object, not title), the (numeric) logging level and
741return a formatted log message. In most cases this will be a string, but 952the raw message string and needs to return a formatted log message. In
742it could just as well be an array reference that just stores the values. 953most cases this will be a string, but it could just as well be an array
954reference that just stores the values.
955
956If, for some reason, you want to use C<caller> to find out more about the
957logger then you should walk up the call stack until you are no longer
958inside the C<AnyEvent::Log> package.
959
960To implement your own logging callback, you might find the
961C<AnyEvent::Log::format_time> and C<AnyEvent::Log::default_format>
962functions useful.
963
964Example: format the message just as AnyEvent::Log would, by letting
965AnyEvent::Log do the work. This is a good basis to design a formatting
966callback that only changes minor aspects of the formatting.
967
968 $ctx->fmt_cb (sub {
969 my ($time, $ctx, $lvl, $msg) = @_;
970
971 AnyEvent::Log::default_format $time, $ctx, $lvl, $msg
972 });
743 973
744Example: format just the raw message, with numeric log level in angle 974Example: format just the raw message, with numeric log level in angle
745brackets. 975brackets.
746 976
747 $ctx->fmt_cb (sub { 977 $ctx->fmt_cb (sub {
749 979
750 "<$lvl>$msg\n" 980 "<$lvl>$msg\n"
751 }); 981 });
752 982
753Example: return an array reference with just the log values, and use 983Example: return an array reference with just the log values, and use
754C<PApp::SQL::sql_exec> to store the emssage in a database. 984C<PApp::SQL::sql_exec> to store the message in a database.
755 985
756 $ctx->fmt_cb (sub { \@_ }); 986 $ctx->fmt_cb (sub { \@_ });
757 $ctx->log_cb (sub { 987 $ctx->log_cb (sub {
758 my ($msg) = @_; 988 my ($msg) = @_;
759 989
764 "$msg->[3]"; 994 "$msg->[3]";
765 995
766 0 996 0
767 }); 997 });
768 998
999=item $ctx->log_to_warn
1000
1001Sets the C<log_cb> to simply use C<CORE::warn> to report any messages
1002(usually this logs to STDERR).
1003
1004=item $ctx->log_to_file ($path)
1005
1006Sets the C<log_cb> to log to a file (by appending), unbuffered. The
1007function might return before the log file has been opened or created.
1008
1009=item $ctx->log_to_path ($path)
1010
1011Same as C<< ->log_to_file >>, but opens the file for each message. This
1012is much slower, but allows you to change/move/rename/delete the file at
1013basically any time.
1014
1015Needless(?) to say, if you do not want to be bitten by some evil person
1016calling C<chdir>, the path should be absolute. Doesn't help with
1017C<chroot>, but hey...
1018
1019=item $ctx->log_to_syslog ([$facility])
1020
1021Logs all messages via L<Sys::Syslog>, mapping C<trace> to C<debug> and
1022all the others in the obvious way. If specified, then the C<$facility> is
1023used as the facility (C<user>, C<auth>, C<local0> and so on). The default
1024facility is C<user>.
1025
1026Note that this function also sets a C<fmt_cb> - the logging part requires
1027an array reference with [$level, $str] as input.
1028
769=cut 1029=cut
770 1030
771sub log_cb { 1031sub log_cb {
772 my ($ctx, $cb) = @_; 1032 my ($ctx, $cb) = @_;
773 1033
778 my ($ctx, $cb) = @_; 1038 my ($ctx, $cb) = @_;
779 1039
780 $ctx->[4] = $cb; 1040 $ctx->[4] = $cb;
781} 1041}
782 1042
1043sub log_to_warn {
1044 my ($ctx, $path) = @_;
1045
1046 $ctx->log_cb (sub {
1047 warn shift;
1048 0
1049 });
1050}
1051
1052# this function is a good example of why threads are a must,
1053# simply for priority inversion.
1054sub _log_to_disk {
1055 # eval'uating this at runtime saves 220kb rss - perl has become
1056 # an insane memory waster.
1057 eval q{ # poor man's autoloading {}
1058 sub _log_to_disk {
1059 my ($ctx, $path, $keepopen) = @_;
1060
1061 my $fh;
1062 my @queue;
1063 my $delay;
1064 my $disable;
1065
1066 use AnyEvent::IO ();
1067
1068 my $kick = sub {
1069 undef $delay;
1070 return unless @queue;
1071 $delay = 1;
1072
1073 # we pass $kick to $kick, so $kick itself doesn't keep a reference to $kick.
1074 my $kick = shift;
1075
1076 # write one or more messages
1077 my $write = sub {
1078 # we write as many messages as have been queued
1079 my $data = join "", @queue;
1080 @queue = ();
1081
1082 AnyEvent::IO::aio_write $fh, $data, sub {
1083 $disable = 1;
1084 @_
1085 ? ($_[0] == length $data or AE::log 4 => "unable to write to logfile '$path': short write")
1086 : AE::log 4 => "unable to write to logfile '$path': $!";
1087 undef $disable;
1088
1089 if ($keepopen) {
1090 $kick->($kick);
1091 } else {
1092 AnyEvent::IO::aio_close ($fh, sub {
1093 undef $fh;
1094 $kick->($kick);
1095 });
1096 }
1097 };
1098 };
1099
1100 if ($fh) {
1101 $write->();
1102 } else {
1103 AnyEvent::IO::aio_open
1104 $path,
1105 AnyEvent::IO::O_CREAT | AnyEvent::IO::O_WRONLY | AnyEvent::IO::O_APPEND,
1106 0666,
1107 sub {
1108 $fh = shift
1109 or do {
1110 $disable = 1;
1111 AE::log 4 => "unable to open logfile '$path': $!";
1112 undef $disable;
1113 return;
1114 };
1115
1116 $write->();
1117 }
1118 ;
1119 }
1120 };
1121
1122 $ctx->log_cb (sub {
1123 return if $disable;
1124 push @queue, shift;
1125 $kick->($kick) unless $delay;
1126 0
1127 });
1128
1129 $kick->($kick) if $keepopen; # initial open
1130 };
1131 };
1132 die if $@;
1133 &_log_to_disk
1134}
1135
1136sub log_to_file {
1137 my ($ctx, $path) = @_;
1138
1139 _log_to_disk $ctx, $path, 1;
1140}
1141
1142sub log_to_path {
1143 my ($ctx, $path) = @_;
1144
1145 _log_to_disk $ctx, $path, 0;
1146}
1147
1148sub log_to_syslog {
1149 my ($ctx, $facility) = @_;
1150
1151 require Sys::Syslog;
1152
1153 $ctx->fmt_cb (sub {
1154 my $str = $_[3];
1155 $str =~ s/\n(?=.)/\n+ /g;
1156
1157 [$_[2], "($_[1][0]) $str"]
1158 });
1159
1160 $facility ||= "user";
1161
1162 $ctx->log_cb (sub {
1163 my $lvl = $_[0][0] < 9 ? $_[0][0] : 8;
1164
1165 Sys::Syslog::syslog ("$facility|" . ($lvl - 1), $_)
1166 for split /\n/, $_[0][1];
1167
1168 0
1169 });
1170}
1171
1172=back
1173
1174=head3 MESSAGE LOGGING
1175
1176These methods allow you to log messages directly to a context, without
1177going via your package context.
1178
1179=over 4
1180
783=item $ctx->log ($level, $msg[, @params]) 1181=item $ctx->log ($level, $msg[, @params])
784 1182
785Same as C<AnyEvent::Log::log>, but uses the given context as log context. 1183Same as C<AnyEvent::Log::log>, but uses the given context as log context.
1184
1185Example: log a message in the context of another package.
1186
1187 (AnyEvent::Log::ctx "Other::Package")->log (warn => "heely bo");
786 1188
787=item $logger = $ctx->logger ($level[, \$enabled]) 1189=item $logger = $ctx->logger ($level[, \$enabled])
788 1190
789Same as C<AnyEvent::Log::logger>, but uses the given context as log 1191Same as C<AnyEvent::Log::logger>, but uses the given context as log
790context. 1192context.
792=cut 1194=cut
793 1195
794*log = \&AnyEvent::Log::_log; 1196*log = \&AnyEvent::Log::_log;
795*logger = \&AnyEvent::Log::_logger; 1197*logger = \&AnyEvent::Log::_logger;
796 1198
7971;
798
799=back 1199=back
800 1200
1201=cut
1202
1203package AnyEvent::Log;
1204
1205=head1 CONFIGURATION VIA $ENV{PERL_ANYEVENT_LOG}
1206
1207Logging can also be configured by setting the environment variable
1208C<PERL_ANYEVENT_LOG> (or C<AE_LOG>).
1209
1210The value consists of one or more logging context specifications separated
1211by C<:> or whitespace. Each logging specification in turn starts with a
1212context name, followed by C<=>, followed by zero or more comma-separated
1213configuration directives, here are some examples:
1214
1215 # set default logging level
1216 filter=warn
1217
1218 # log to file instead of to stderr
1219 log=file=/tmp/mylog
1220
1221 # log to file in addition to stderr
1222 log=+%file:%file=file=/tmp/mylog
1223
1224 # enable debug log messages, log warnings and above to syslog
1225 filter=debug:log=+%warnings:%warnings=warn,syslog=LOG_LOCAL0
1226
1227 # log trace messages (only) from AnyEvent::Debug to file
1228 AnyEvent::Debug=+%trace:%trace=only,trace,file=/tmp/tracelog
1229
1230A context name in the log specification can be any of the following:
1231
1232=over 4
1233
1234=item C<collect>, C<filter>, C<log>
1235
1236Correspond to the three predefined C<$AnyEvent::Log::COLLECT>,
1237C<AnyEvent::Log::FILTER> and C<$AnyEvent::Log::LOG> contexts.
1238
1239=item C<%name>
1240
1241Context names starting with a C<%> are anonymous contexts created when the
1242name is first mentioned. The difference to package contexts is that by
1243default they have no attached slaves.
1244
1245This makes it possible to create new log contexts that can be refered to
1246multiple times by name within the same log specification.
1247
1248=item a perl package name
1249
1250Any other string references the logging context associated with the given
1251Perl C<package>. In the unlikely case where you want to specify a package
1252context that matches on of the other context name forms, you can add a
1253C<::> to the package name to force interpretation as a package.
1254
1255=back
1256
1257The configuration specifications can be any number of the following:
1258
1259=over 4
1260
1261=item C<stderr>
1262
1263Configures the context to use Perl's C<warn> function (which typically
1264logs to C<STDERR>). Works like C<log_to_warn>.
1265
1266=item C<file=>I<path>
1267
1268Configures the context to log to a file with the given path. Works like
1269C<log_to_file>.
1270
1271=item C<path=>I<path>
1272
1273Configures the context to log to a file with the given path. Works like
1274C<log_to_path>.
1275
1276=item C<syslog> or C<syslog=>I<expr>
1277
1278Configures the context to log to syslog. If I<expr> is given, then it is
1279evaluated in the L<Sys::Syslog> package, so you could use:
1280
1281 log=syslog=LOG_LOCAL0
1282
1283=item C<nolog>
1284
1285Configures the context to not log anything by itself, which is the
1286default. Same as C<< $ctx->log_cb (undef) >>.
1287
1288=item C<cap=>I<level>
1289
1290Caps logging messages entering this context at the given level, i.e.
1291reduces the priority of messages with higher priority than this level. The
1292default is C<0> (or C<off>), meaning the priority will not be touched.
1293
1294=item C<0> or C<off>
1295
1296Sets the logging level of the context to C<0>, i.e. all messages will be
1297filtered out.
1298
1299=item C<all>
1300
1301Enables all logging levels, i.e. filtering will effectively be switched
1302off (the default).
1303
1304=item C<only>
1305
1306Disables all logging levels, and changes the interpretation of following
1307level specifications to enable the specified level only.
1308
1309Example: only enable debug messages for a context.
1310
1311 context=only,debug
1312
1313=item C<except>
1314
1315Enables all logging levels, and changes the interpretation of following
1316level specifications to disable that level. Rarely used.
1317
1318Example: enable all logging levels except fatal and trace (this is rather
1319nonsensical).
1320
1321 filter=exept,fatal,trace
1322
1323=item C<level>
1324
1325Enables all logging levels, and changes the interpretation of following
1326level specifications to be "that level or any higher priority
1327message". This is the default.
1328
1329Example: log anything at or above warn level.
1330
1331 filter=warn
1332
1333 # or, more verbose
1334 filter=only,level,warn
1335
1336=item C<1>..C<9> or a logging level name (C<error>, C<debug> etc.)
1337
1338A numeric loglevel or the name of a loglevel will be interpreted according
1339to the most recent C<only>, C<except> or C<level> directive. By default,
1340specifying a logging level enables that and any higher priority messages.
1341
1342=item C<+>I<context>
1343
1344Attaches the named context as slave to the context.
1345
1346=item C<+>
1347
1348A lone C<+> detaches all contexts, i.e. clears the slave list from the
1349context. Anonymous (C<%name>) contexts have no attached slaves by default,
1350but package contexts have the parent context as slave by default.
1351
1352Example: log messages from My::Module to a file, do not send them to the
1353default log collector.
1354
1355 My::Module=+,file=/tmp/mymodulelog
1356
1357=back
1358
1359Any character can be escaped by prefixing it with a C<\> (backslash), as
1360usual, so to log to a file containing a comma, colon, backslash and some
1361spaces in the filename, you would do this:
1362
1363 PERL_ANYEVENT_LOG='log=file=/some\ \:file\ with\,\ \\-escapes'
1364
1365Since whitespace (which includes newlines) is allowed, it is fine to
1366specify multiple lines in C<PERL_ANYEVENT_LOG>, e.g.:
1367
1368 PERL_ANYEVENT_LOG="
1369 filter=warn
1370 AnyEvent::Debug=+%trace
1371 %trace=only,trace,+log
1372 " myprog
1373
1374Also, in the unlikely case when you want to concatenate specifications,
1375use whitespace as separator, as C<::> will be interpreted as part of a
1376module name, an empty spec with two separators:
1377
1378 PERL_ANYEVENT_LOG="$PERL_ANYEVENT_LOG MyMod=debug"
1379
1380=cut
1381
1382for (my $spec = $ENV{PERL_ANYEVENT_LOG}) {
1383 my %anon;
1384
1385 my $pkg = sub {
1386 $_[0] eq "log" ? $LOG
1387 : $_[0] eq "filter" ? $FILTER
1388 : $_[0] eq "collect" ? $COLLECT
1389 : $_[0] =~ /^%(.+)$/ ? ($anon{$1} ||= do { my $ctx = ctx undef; $ctx->[0] = $_[0]; $ctx })
1390 : $_[0] =~ /^(.*?)(?:::)?$/ ? ctx "$1" # egad :/
1391 : die # never reached?
1392 };
1393
1394 /\G[[:space:]]+/gc; # skip initial whitespace
1395
1396 while (/\G((?:[^:=[:space:]]+|::|\\.)+)=/gc) {
1397 my $ctx = $pkg->($1);
1398 my $level = "level";
1399
1400 while (/\G((?:[^,:[:space:]]+|::|\\.)+)/gc) {
1401 for ("$1") {
1402 if ($_ eq "stderr" ) { $ctx->log_to_warn;
1403 } elsif (/^file=(.+)/ ) { $ctx->log_to_file ("$1");
1404 } elsif (/^path=(.+)/ ) { $ctx->log_to_path ("$1");
1405 } elsif (/^syslog(?:=(.*))?/ ) { require Sys::Syslog; $ctx->log_to_syslog ("$1");
1406 } elsif ($_ eq "nolog" ) { $ctx->log_cb (undef);
1407 } elsif (/^cap=(.+)/ ) { $ctx->cap ("$1");
1408 } elsif (/^\+(.+)$/ ) { $ctx->attach ($pkg->("$1"));
1409 } elsif ($_ eq "+" ) { $ctx->slaves;
1410 } elsif ($_ eq "off" or $_ eq "0") { $ctx->level (0);
1411 } elsif ($_ eq "all" ) { $ctx->level ("all");
1412 } elsif ($_ eq "level" ) { $ctx->level ("all"); $level = "level";
1413 } elsif ($_ eq "only" ) { $ctx->level ("off"); $level = "enable";
1414 } elsif ($_ eq "except" ) { $ctx->level ("all"); $level = "disable";
1415 } elsif (/^\d$/ ) { $ctx->$level ($_);
1416 } elsif (exists $STR2LEVEL{$_} ) { $ctx->$level ($_);
1417 } else { die "PERL_ANYEVENT_LOG ($spec): parse error at '$_'\n";
1418 }
1419 }
1420
1421 /\G,/gc or last;
1422 }
1423
1424 /\G[:[:space:]]+/gc or last;
1425 }
1426
1427 /\G[[:space:]]+/gc; # skip trailing whitespace
1428
1429 if (/\G(.+)/g) {
1430 die "PERL_ANYEVENT_LOG ($spec): parse error at '$1'\n";
1431 }
1432}
1433
801=head1 EXAMPLES 1434=head1 EXAMPLES
802 1435
803This section shows some common configurations. 1436This section shows some common configurations, both as code, and as
1437C<PERL_ANYEVENT_LOG> string.
804 1438
805=over 4 1439=over 4
806 1440
807=item Setting the global logging level. 1441=item Setting the global logging level.
808 1442
809Either put PERL_ANYEVENT_VERBOSE=<number> into your environment before 1443Either put C<PERL_ANYEVENT_VERBOSE=><number> into your environment before
810running your program, or modify the log level of the root context: 1444running your program, use C<PERL_ANYEVENT_LOG> or modify the log level of
1445the root context at runtime:
811 1446
812 PERL_ANYEVENT_VERBOSE=5 ./myprog 1447 PERL_ANYEVENT_VERBOSE=5 ./myprog
813 1448
1449 PERL_ANYEVENT_LOG=log=warn
1450
814 $AnyEvent::Log::Root->level ("warn"); 1451 $AnyEvent::Log::FILTER->level ("warn");
815 1452
816=item Append all messages to a file instead of sending them to STDERR. 1453=item Append all messages to a file instead of sending them to STDERR.
817 1454
818This is affected by the global logging level. 1455This is affected by the global logging level.
819 1456
820 open my $fh, ">>", $path 1457 $AnyEvent::Log::LOG->log_to_file ($path);
821 or die "$path: $!";
822 1458
823 $AnyEvent::Log::Default->log_cb (sub { 1459 PERL_ANYEVENT_LOG=log=file=/some/path
824 syswrite $fh, shift;
825 0
826 });
827 1460
828=item Write all messages with priority C<error> and higher to a file. 1461=item Write all messages with priority C<error> and higher to a file.
829 1462
830This writes them only when the global logging level allows it, because 1463This writes them only when the global logging level allows it, because
831it is attached to the default context which is invoked I<after> global 1464it is attached to the default context which is invoked I<after> global
832filtering. 1465filtering.
833 1466
834 open my $fh, ">>", $path 1467 $AnyEvent::Log::FILTER->attach (
835 or die "$path: $!"; 1468 new AnyEvent::Log::Ctx log_to_file => $path);
836 1469
837 $AnyEvent::Log::Default->attach (new AnyEvent::Log::Ctx 1470 PERL_ANYEVENT_LOG=filter=+%filelogger:%filelogger=file=/some/path
838 log_cb => sub { syswrite $fh, shift; 0 });
839 1471
840This writes them regardless of the global logging level, because it is 1472This writes them regardless of the global logging level, because it is
841attached to the toplevel context, which receives all messages I<before> 1473attached to the toplevel context, which receives all messages I<before>
842the global filtering. 1474the global filtering.
843 1475
844 $AnyEvent::Log::Top->attach (new AnyEvent::Log::Ctx 1476 $AnyEvent::Log::COLLECT->attach (
845 log_cb => sub { syswrite $fh, shift; 0 }); 1477 new AnyEvent::Log::Ctx log_to_file => $path);
846 1478
1479 PERL_ANYEVENT_LOG=%filelogger=file=/some/path:collect=+%filelogger
1480
847In both cases, messages are still written to STDOUT. 1481In both cases, messages are still written to STDERR.
1482
1483=item Additionally log all messages with C<warn> and higher priority to
1484C<syslog>, but cap at C<error>.
1485
1486This logs all messages to the default log target, but also logs messages
1487with priority C<warn> or higher (and not filtered otherwise) to syslog
1488facility C<user>. Messages with priority higher than C<error> will be
1489logged with level C<error>.
1490
1491 $AnyEvent::Log::LOG->attach (
1492 new AnyEvent::Log::Ctx
1493 level => "warn",
1494 cap => "error",
1495 syslog => "user",
1496 );
1497
1498 PERL_ANYEVENT_LOG=log=+%syslog:%syslog=warn,cap=error,syslog
848 1499
849=item Write trace messages (only) from L<AnyEvent::Debug> to the default logging target(s). 1500=item Write trace messages (only) from L<AnyEvent::Debug> to the default logging target(s).
850 1501
851Attach the CyAnyEvent::Log::Default> context to the C<AnyEvent::Debug> 1502Attach the C<$AnyEvent::Log::LOG> context to the C<AnyEvent::Debug>
852context and increase the C<AnyEvent::Debug> logging level - this simply
853circumvents the global filtering for trace messages. 1503context - this simply circumvents the global filtering for trace messages.
854 1504
855 my $debug = AnyEvent::Debug->AnyEvent::Log::ctx; 1505 my $debug = AnyEvent::Debug->AnyEvent::Log::ctx;
856 $debug->attach ($AnyEvent::Log::Default); 1506 $debug->attach ($AnyEvent::Log::LOG);
857 $debug->levels ("trace"); # not "level"!
858 1507
859This of course works for any package. 1508 PERL_ANYEVENT_LOG=AnyEvent::Debug=+log
1509
1510This of course works for any package, not just L<AnyEvent::Debug>, but
1511assumes the log level for AnyEvent::Debug hasn't been changed from the
1512default.
860 1513
861=back 1514=back
862 1515
1516=head1 ASYNCHRONOUS DISK I/O
1517
1518This module uses L<AnyEvent::IO> to actually write log messages (in
1519C<log_to_file> and C<log_to_path>), so it doesn't block your program when
1520the disk is busy and a non-blocking L<AnyEvent::IO> backend is available.
1521
863=head1 AUTHOR 1522=head1 AUTHOR
864 1523
865 Marc Lehmann <schmorp@schmorp.de> 1524 Marc Lehmann <schmorp@schmorp.de>
866 http://home.schmorp.de/ 1525 http://anyevent.schmorp.de
867 1526
868=cut 1527=cut
1528
15291
1530

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines