logs

Keeping 'almost complete' logs even when system crashes

We have a c++ application (console) that runs on windows and unix. This application used output files to output verbose log files of system calls/prints/etc. The prblem is, that in certain occasion we might get signal 11/2 after new features are added. Now whenever, that happenes, we do not get 'almost complete' information from log f...

Any method for going through large log files?

// Java programmers, when I mean method, I mean a 'way to do things'... Hello All, I'm writing a log miner script to monitor various log files at my company, It's written in Perl though I have access to Python and if I REALLY need to, C (though my company doesn't like binary files). It needs to be able to go through the last 24 hours, ...

Appending output to a file at the same time truncating it to N lines

Hello all, I'm trying to find a simple way to append/write to a log, while at the same time keeping it the log trimmed to a reasonable size. I would prefer to not just append files forever, and then have to have a clean up log script. I can't wrap my head around how I would accomplish this gracefully without using some second file as a ...

creating statistics files for users

My software performs a number of jobs throughout the day and I would like to make it possible for my users to examine statistics about these jobs. For example, the data for a job are its results (fail/pass), run duration, user name who started the job, description and an error string. Ideally I would like to simply create a daily log f...

generic timed event viewer/visualization

My application generates a bunch of events at different moments. Events have a timestamp, a duration, a type (error/warning/normal), a description, etc. Is there any application which can take in data (probably from xml files) containing this type of event information, and displays in in a table, with search range by date, etc? ...

PHP - Best way to log user activity and display them on different pages?

I have got my website loggin user activity into a .txt file. I want to be able to show these results on my Admin area in separate pages. So page one shows 1-50 results and so on. But the problem I have is it's set out like this in the .txt file User: Admin IP Address: xx.xxx.xxx.xx Host Address: xxxxxxxxxxxxxxxx Date And Time: Monday 2...

View large text files online in web browser (logs, linux)

Does anybody know any linux (php preferred) simple app to view large files online in browser? Like phpMyAdmin(MySQL) but for files. My php application writes some debug, error and informational events to logs. I know, I can log into database, but for me personally appending file seems as more reliable (because it simple) solution for th...

Getting Heroku logs for past few weeks

I'm trying to get the production logs for the past few weeks off of heroku but when I do heroku logs, it just returns a few lines showing the production log for today. Any way to get heroku logs for the past few weeks? Thanks. ...

Windows log generator

Is there a way to generate specific Windows events? I'm currently developing a solution to get this events through WMI process, but I need all the logs Windows can generate. I know there is a way to make .net solution to write the events to the event viewer, but I don't want that. Is there a way to code or make a solution to make W...

How to stop kernel critical messages from printing to terminal

I have a system that is un-usable because I keep getting logs every second from the kernel. The system can actually start up and in the little spaces between the messages I can actually log in. But the kernel just keeps throwing this message every second on the screen(all the terminals). I want to know if there's a way to stop kernel fro...

Parsing poorly formatted Log files?

I'm working with some log files that are very poorly formatted, the column delimiter is an item that (often) appears within the field and it isn't escaped. For example: sam,male,september,brown,blue,i like cats, and i like dogs Where: name,gender,month,hair,eyes,about So as you can see, the about contains the column delimiter which...

parse an active log file

Looking for a little help getting started on a little project i've had in the back of my mind for a while. I have log file(s) varying in size depending on how often they are cleaned from 50-500MB. I'd like to write a program that will monitor the log file while its actively being written to. when in use it's being changed pretty quickl...

Accesing, Merging IIS extended log files

I need to access, merge and parse my log files using my asp.net application programmatically. I use shared hosting and as I can see log files are out of the root directory of my website? Is there anyway to access those files from my application? ...

Audit logs in MySQL and PHP

Hi, My application has a series of forms. I want to track the following for each of the data fields in a form: Time of change, who changed it, old data and the new data Any suggestions on a solution for this? In my implementation of the database, the structure of a form is defined as DATA in a table, not by it's columns. For example ...

Is it useful to track the history of tasks and bugs in projects developed by one person?

I have trac set up for my private and job projects and I have an ability to define tasks or describe bugs there. As most of the time I work at those projects alone, I usually choose to write the TODO lists on sheets of paper. When a task is done, I just strike it out from the sheet. When the full page of tasks is finished, the sheet is t...

Software to help in log analysis?

Hey guys, I have a quick question. Does anyone know of any software that can help with understanding client-server logs? I have 3 huge logs of 1 server & 2 clients that are time stamped, but only if I could arrange all 3 of them in a UI side by side in a chronological order, it would be so easy for me to understand them. Thanks for an...

How can I write to a log-file easily when deployed on Heroku?

While running on Heroku, I would like to be able to put key information via, say, puts or other such statement, to write to a log file. But Heroku doesn't allow writing to a file, so what is a way to do this easily? ...