logs

How can I calculate the median and standard deviation of a bunch stream of numbers in Perl?

Hi everyone, In our logfiles we store response times for the requests. What's the most efficient way to calculate the median response time, the "75/90/95% of requests were served in less than N time" numbers etc? (I guess a variation of my question is: What's the best way to calculate the median and standard deviation of a bunch stre...

Python Cherrypy Access Log Rotation

If I want the access log for Cherrypy to only get to a fixed size, how would I go about using rotating log files? I've already tried http://www.cherrypy.org/wiki/Logging, which seems out of date, or has information missing. ...

Tools to help process Akamai data logs?

I'm digging through Akamai logs, downloading excel sheets, and then manually joining them so that I can do sorting of data to find top videos and referrers. Are there any tools you know of to help with this kind of processing? I'm looking for something like Urchin used to be for Apache logs, but for Akamai logs. Thanks! ...

building splunk 4.0 "apps" - got feedback?

I'm considering building an app to plug into Splunk 4 to do custom data collection, custom, reporting, etc. (like I see other splunk apps doing) but focused on .NET and J2EE web apps. I'm looking for hints, tips, best practices, etc. to give me a leg up beyond what I can find in the splunk documentation. Anyone have a good list of lin...

Performance effect of enabling apache response time log directive

What affect will enabling the response time (%D) LogFormat directive have on apache performance? The response time is the time taken to serve a request in microseconds. Response time can be enabled like so: #LogFormat "%h %l %u %t \"%r\" %>s %b" # Default LogFormat LogFormat "%h %l %u %t \"%r\" %>s %b %D" # LogFormat including res...

Does SQL Server 2000 log queries that produce errors anywhere?

I've got a distributed deployment of ±20 clients using the same stored procedure to create a record and then attach detail records. We've noticed gaps in the identity fields of the master record. We are not using a transaction in this instance so the only reason we can come up with for the gaps is that one of the developers is swallowing...

Is udp broadcast recorded in the server log?

Apologies if this is a dumb question, I've limited network knowledge. If I sent a string to port 80 on UDP, would the server / receiving IP log it? I'm pretty sure it wouldn't in access logs, but what about firewall logs? ...

How to stream the contents of a file live to a browser

Hiya, I'm trying to find a efficient way to watch the server log on a webpage, i don't mind building an app i just can't work out the best way to do it. Is there a way to keep a stream open to a file with php and to the browser? or will it have to be done by polling the file every x seconds? Thanks in advance, Shadi ...

How does Oracle manage Redo logs?

Can any body give me an idea about Redo logs? An example would be most appreciated. ...

Finding out how when google last crawled

I'd like to find out how current google's cached copy of a large set of pages is. I think I need to look in the logs for IP's, check to find user-agent "googlebot", then export a list that says each page and when it was last visited. I imagine this could be a cron job that runs weekly. If this is right, how would I write the s...

Is it possible to read the log file using Chainsaw?

I am having several log files [ generated via log4j ]. I got to know that we can use Chainsaw to read those logs [ though we can reads those logs in notepad as well ]. But i am unable to figure out how to open a stored log file to see its content. So the simple question is, Is it possible to read the log file using Chainsaw? ...

Understanding Java's GC logs

I turned on verbose GC options on my JDK, and now I'm seeing lines such as 25.598: [CMS-concurrent-sweep-start] 25.622: [CMS-concurrent-sweep: 0.023/0.024 secs] [Times: user=0.02 sys=0.00, real=0.03 secs] 25.623: [CMS-concurrent-reset-start] 25.629: [CMS-concurrent-reset: 0.007/0.007 secs] [Times: user=0.01 sys=0.00, real=0.00 secs] ...

Analyze GC logs for Sun Hotspots, JVM 6

I'm trying to analyze GC behaviour for our application (running in Tomcat, under Sun's Hotspots, JVM 1.6). So far I've: Instructed the JVM to emit GC logs to a separate file using: -Xloggc:gc.log -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCApplicationConcurrentTime -XX:+PrintGC -XX:+PrintGCTimeStamps -XX:+PrintGCDetails ...

Best practices, PHP, tracking millions of impressions per day.

What do I have to do to make 20k mysql inserts per second possible (during peak hours around 1k/sec during slower times)? I've been doing some research and I've seen the "INSERT DELAYED" suggestion, writing to a flat file, "fopen(file,'a')", and then running a chron job to dump the "needed" data into mysql, etc. I've also heard you need ...

get output of last Process on SSAS cube

I have processed a SSAS cube. After it was done processing, I hit the close button - and then realized that I should have saved the output. I think SSAS stores the processing log as a text or XML file, but I do not know what folder to look into. Can someone direct me to retrieving processing logs? ...

What could be causing these error?

I am seeing a very large number of the errors below in my log files. Nothing seems to be causing them in the way that none of our users are seeing any errors. What could be causing them? We are running CF 8. FYI: They are happening many times per second. 12/11 12:30:13 error jrunx.scheduler.SchedulerService.cancel() java.lang.NoSuchMet...

php logging all events of an application scripted in php

What do php geeks, professionals, and all others us to log their flat files. Are there functions that can just log one .php page? Can the logging in php be controlled? On a side-note, anyone used this for logging? [http://www.monperrus.net/martin/phpmodlog%5D%5B1%5D Apparently my first question was not clear... ...

php stop user from viewing logs

<form method = "post" action = "<?php echo $_SERVER['PHP_SELF']; ?>" /> Username:<input type = "text" name ="user"> <br /> Password:<input type = "password" name = "pass"><br /> <input type = "submit" value ="View Logs!"><br /> <?php $user = $_POST['user']; $pass = $_POST['pass']; //Problem here, I need to only allow the user to see lo...

Does Django logs usernames internally

All.. I have a Django site and to access it all the users have to go through the login page. My question is when a user is given a access through the login page to enter the site.Does Django logs the username in any of the Django internal tables.... Thanks....... ...

Leopard Console logs for common files reference

Hi, I am using plugins for one of my Mac OS X(desktop) application. These plugins refer to a common file that contains base class implementation of both the plugins. When the application refers to this common base class, the following message is displayed in the console by the system: " is implemented in both and . One of the two wil...