ansaurus

Question

Best way to convert log files (*.txt) to web-friendly files (*.html, *.jsp, etc)?

Answer 1

A:

pygmentize can handle some formats, although you may need to whip up a custom lexer for most cases.

Ignacio Vazquez-Abrams 2010-03-12 19:15:54

Thanks, this is interesting, unfortunately, I think that a bunch of my links will need to be hard-coded so python or perl is probably the better way to go.

prometheus 2010-03-12 19:52:26

`pygmentize` is just a frontend to `pygments`, so it's Python under the sheets anyways.

Ignacio Vazquez-Abrams 2010-03-12 19:54:54

Answer 2

+1 A:

I'd use python regular expressions.

>>> import re
>>> a = re.compile(r'[SH]W Failures - \d\d.\d\d.\d\d\d\d - (.*) - \d+ errors -
\d+ warnings')
>>> str = 'SW Failures - 03.09.2010 - /logs/swfailures.txt - 23 errors - 24 warnings'  
>>> b = a.match(str)
>>> b
<_sre.SRE_Match object at 0x7ff34160>
>>> b.groups()
('/logs/swfailures.txt',)
>>> str.replace(b.group(1), '<a href="%s">%s</a>' % (b.group(1), b.group(1)))
'SW Failures - 03.09.2010 - <a href="/logs/swfailures.txt">/logs/swfailures.txt</a> - 23 errors - 24 warnings'

Pierre-Antoine LaFayette 2010-03-12 19:27:35

Answer 3

+3 A:

Here is a simple example using Perl's HTML::Template:

#!/usr/bin/perl

use strict; use warnings;
use HTML::Template;

my $tmpl = HTML::Template->new(scalarref => \ <<EOTMPL
<!DOCTYPE HTML>
<html><head><title>HTMLized Log</title>
<style type="text/css">
#log li { font-family: "Courier New" }
.errors { background:yellow; color:red }
.warnings { background:#3cf; color:blue }
</style>
</head><body>
<ol id="log">
<TMPL_LOOP LOG>
<li><span class="type"><TMPL_VAR TYPE></span>
<span class="date"><TMPL_VAR DATE></span>
<a href="<TMPL_VAR FILE>"><TMPL_VAR FILE></a>
<span class="errors"><TMPL_VAR ERRORS></span>
<span class="warnings"><TMPL_VAR WARNINGS></span>
</li>
</TMPL_LOOP>
</ol></body></html>
EOTMPL
);

my @log;
my @fields = qw( TYPE DATE FILE ERRORS WARNINGS );

while ( my $entry = <DATA> ) {
    chomp $entry;
    last unless $entry =~ /\S/;
    my %entry;
    @entry{ @fields } = split / - /, $entry;
    push @log, \%entry;
}

$tmpl->param(LOG => \@log);
print $tmpl->output;

__DATA__
SW Failures - 03.09.2010 - /logs/swfailures.txt - 23 errors - 24 warnings
HW Failures - 03.09.2010 - /logs/hwfailures.txt - 42 errors - 25 warnings
SW Failures - 03.10.2010 - /logs/swfailures.txt - 32 errors - 27 warnings
HW Failures - 03.10.2010 - /logs/hwfailures.txt - 11 errors - 31 warnings

Sinan Ünür 2010-03-12 19:46:07

Answer 4

+2 A:

I like awk because of its automatic field parsing:

/failures.txt/ {
        $6="<a href=\"" $6 "\">" $6 "</a><br>"
}

{
        print
}

lhf 2010-03-12 19:54:03

Why the down vote?

lhf 2010-03-12 21:21:51

Don't know, I voted you up. Thanks!

prometheus 2010-03-13 04:09:55

ansaurus

tags:

views:

answers:

Best way to convert log files (.txt) to web-friendly files (.html, *.jsp, etc)?

related questions