log-analysis

Web Log analysis in Java

Hello all, How to read a web server log file in Java. This file is getting updated all the time. If I open a new FileInputStream, will it read the log real time? Regards ...

What is the best log analysis tool that you used?

I'm starting to work on an existing project that has very verbose logging and the logs are a real pain to go through. Have you guys ever used any tools for log analysis/parsing? Can you recommend me something powerful and easy to customize and use? At first I thought I should write a tool to parse the logs, but I'm thinking maybe somethi...

Proper disposal of SharePoint objects?

I hope there's a SharePoint expert here on SO who can help with this. Here's the problem. My SharePoint logs contain this line, several times: An SPRequest object was not disposed before the end of this thread. To avoid wasting system resources, dispose of this object or its parent (such as an SPSite or SPWeb) as soon as you are done ...

Is writing server log files to a database a good idea?

After reading an article about the subject from O'Reilly, I wanted to ask Stack Overflow for their thoughts on the matter. ...

What's the simplest way to count the number of requests to /foo/ that Apache has served?

I'm looking to retroactively parse the logs and count the number of /foo/* requests that have occurred to have a baseline benchmark for a new feature that we're pushing. A simple command line script would be fine -- with an added bonus for being able to specify a date-range. Some use of grep, perhaps? ...

Which is best Postfix Log analyzer?

Which is best Postfix Log analyzer? We are looking for good log analyzer for postfix. We need to analyze the following How many mails queued ? How many mails not delivered ? Why mails are not delivered ? And is it possible to view the subject for the all mail status instead of message id? I mean to review the status of the single mai...

Do you know Apache log analyzer that can handle URL parameters?

Hey! I run a perl script that accepts several arguments through url query parameters. http://example.com/cgi-bin/script.pl?user_id=12345&clent_version=5 The parameters are the following user_id client_version The script is running on Apache server. I want to analyze access.log to find out how many different users I have during...

Glassfish log files analysis

Can I get some recommendations for good log analysis software for Glassfish log files? Since it will not vary from application server to application server dramatically, I guess that there is a common solution for all servers. Thanks ...

Do you know batch log processing tools for hadoop (zohmg alternatives)?

Hello, Since the zohmg project seems to be dead (no new commits since nov 2009), I would like to know if any of you used/uses it (with successful results). Or if you know anything about future of this project. And if not, is there any alternative for this project. I'm looking for tool that will help to extract data from (apache) logs ...

Are there good open-source libraries for parsing search terms from URLs?

I'm looking for a library which parses log files (or incoming requests) and extracts out the search-terms if/when the request came from a search engine. Are there any good libraries which provide this function? Any language will do. ...