We've currently got four web servers in a farm generating IIS web logs about 100Mb per day. These can be compressed pretty effieciently down to somewhere around 5% of their size. We are planning to use waRmZip to move them off the servers and onto a SAN. After a week or so we can be confident we don't have any technical issues to invest...
Hi, I am using Context.RewritePath() in ASP.NET 3.5 application running on IIS7. I am doing it in application BeginRequest event and everything works file. Requests for /sports are correctly rewritten to default.aspx?id=1, and so on. The problem is that in my IIS log I see GET requests for /Default.aspx?id=1 and not for /sports. Thi...
Any suggestions for an accurate Web Log analysis tool to generate reports on the IIS logs? We used WebTrends, but I don't feel it was accurate. ...
I need some help getting a regex working to parse all referrers from an apache access log file which come from real links offsite and which are valid referrals from real people rather than bots or spiders. I'm working in Perl. This bit of code almost works already [the access log is opened with the filehandle $fh]: my $totalreferals = ...
I'm using Apache2, Ubuntu 8.10. Currently Apache is logging the gateway's IP as the host ip, what do I have to do to get it to log the remote client's IP address instead? Is this even possible, or does the NAT router "lose" it for good? Update: It actually looks like it's only logging the gateway's IP for addresses from within the net...
Hi SO, I implemented a client side interface which makes a service call to the server using JS in an http GET. When checking my access logs, I see that sometimes, I get multiple requests sometimes as many as 6 within a second-- Making the very same request-- from the same ip -- what do u think this tells ? Thanks ...
I'm trying to see the path my users take when clicking thru a web app I have. I've got logs, awstats and webalizer on the server-side, and I'm looking to install some sort of analytical product. I don't see any breadcrumb/click path data in my log files. Am I missing it? Barring that, what analytical products (Yahoo, Google, etc) can do ...
I have a huge set of log lines and I need to parse each line (so efficiency is very important). Each log line is of the form cust_name time_start time_end (IP or URL )* So ip address, time, time and a possibly empty list of ip addresses or urls separated by semicolons. If there is only ip or url in the last list there is no separato...
Do i have to add entry and exit logs in all the C functions? If, so are there any possible ways to write the entry and exit of a function automatically (Similar to Automatic Entry/Exit using Aspect oriented Programming in java). The application that I'm writing is time critical and adding entry/exit statements for each function might...
LogParser isn't open source and I need this functionality for an open source project I'm working on. I'd like to write a library that allows me to query huge (mostly IIS) log files, preferably with Linq. Do you have any links that could help me? How does a program like LogParser work so fast? How does it handle memory limitations? ...
What tool(s) would you guys recommend for relatively straight forward (nothing fancy) charts based on apache's access.log files? Ideally I'd have something that ran on the server and had access to the directory and understood that the files are .1, .2, .3 etc and knew how to parse them (and had a web front end). I'm assuming there are nu...
Short version: I'm trying to determine the best way to track what the user does on our site. I.e., page they land on, what links they click, where they end up. Most of this information is stored in the log files, but is using the log file the best way for me to proceed? Long version: My boss is preparing to spend a lot of money adverti...
As I have seen, SQL 2008 no longer offers replication over internet in very simple method. Not only that, I can see that the merge replication method installs too many triggers and views onto database and adds additional field named "rowguid". We have more disc space available today then the processor speed. So I decided to write my own...
There's a way to do this? ...
opening a file in WINDOWS/system32/LogFiles with using (StreamReader r = new StreamReader(fileName)) generates exception "because the file is in use by another process". How can I figure out what the other process is? Could it be the server updating the logs? If it is, how can I ensure that my associated scheduled task can also ha...
I have multiple SVN repositories and I'd like to gather some overall statistics from the logs. Basically I'd like to use Excel to make a graph of the number of commits per day, in all the repositories combined. What I need is a simple way to fetch all the logs, combine them and get a formatted list with DATE, SVN REPOSITORY NAME and LOG...
We want to start analyzing usage of our various Subversion repositories, which is something I know is stored in our Apache logs. The problem is that I don't know of any tools out there for doing this. If, for example, I want to get a listing per repository of "There were X1 checkins and Y1 checkouts on day W1, X2 checkouts and Y2 checkin...
If we disable the 'redo logs' of a tablespace in Oracle, will they impact Hibernate's transactions? These are the options present in the Oracle EM on a tablespace level: Enable logging Yes Generate redo logs for creation of tables, indexes and partitions, and for subsequent inserts. Recoverable No Redo log entries are smaller, the a...
I have an excel spreadsheet with two columns. The first column is a label the second column is a numeric value. I would like to remove all the duplicate labels in column "A" and remain with the maximun numeric value in column "B". I've tried to illustrate below (the filter would result in "Consolidated Sheet" given "Original Sheet": NOT...
I have submitted my app to the App Store, and Apple says: At this time, XYZ APP cannot be posted to the App Store because it is crashing on iPhone 3G running iPhone OS 3.1 and iPod touch running iPhone OS 3.1.1 and Mac OS X 10.5.8 whenever a user attempts to add a reminder from their Contacts. There are two ways to reproduce this issue...