I am using a new service to pull xml data from a server. The service provides two methods of logging in, one via a url query: http://<server>/login.asp?username=<User Name>&password=<Password> and the server returns a cookie valid for 7 days. This means instead of logging in for every query (and making my script less effici...
When I go to http://localhost:8080/_ah/admin/cron, as stated in Google's docs, I get the following: Traceback (most recent call last): File "C:\Program Files\Google\google_appengine\google\appengine\ext\webapp\__init__.py", line 501, in __call__ handler.get(*groups) File "C:\Program Files\Google\google_appengine\google\appengine\ext\adm...
The webapps that depend on the public timeline of twitter, how often do they collect the data? There must be hundreds of thousands of messages every minute, correct? How do they manage to collect all the tweets, without missing any of them? ...
I have a bit of a pickle here and wonder if anyone can give me some pointers: I have a cron job which executes for a particular user daily and is supposed to sweep files in a particular directory. Technically, it is two jobs. I've turned on cron.log to verify they're actually executing, and they are: May 24 11:03:01 AppNameGoesHere /...
I have a directory called cron, inside my app directory. In the cron directory, I have put my cron file. How do I access the model inside my cron file? Which is the best place to put my cron file? edit: I'm trying to execute the cron file, directly like ruby cron.rb ...
Hi, I want to a e-cards or something like that. The user can choose the e-cards, after chosen, he must enter the some fields like name(to and from), email(to and from), message and I want to let user to choose which date to send the e-cards. How to send the e-cards on specific day? I need to write a script that run every new day? How to...
Let me rephrase my question, I have a mysql database that is holding emails to be sent, on a shared host. I would like to run a cron job that will read the database and sent out any messages in the database every 10 minutes or so. Now my question is, what is the best way with php to read my database and send out the emails in small batc...
If I have a cron job that run every 10 minutes and for some reason this one time it takes 12 minutes to run the job, will cron start another instance of my code while the previous one is still running? if so how can you prevent this on linux? ...
Our real estate website sends email notifications when properties come on the market matching users saved search criteria. I have a PHP script that runs on the cronjob to process the searches. The system now has over 40,000 users. I ran into an issue where I exhausted the PHP memory size. As the system grows I can continue to increas...
Have the following cronjob set up in root's crontab: (centos 5.x) 2 * * * * /usr/bin/curl --basic --user 'user:pass' http://localhost/cron/do_some_action > /var/www/app/cronlog.log Invoking the actual command works as expected, however when the cronjob runs, it always times out. I've used set_time_limit() and related php.ini settings ...
I am working on a CRON job in PHP which has to do a lot of heavy lifting via the database. Think lots and lots of loops. It executes properly when I limit the data set, but when I run it against the full data set, the script errors out with a simple "Killed" message. set_time_limit is (0) and memory_limit is (-1) Here is the code s...
Hi, I have a rake file, which can be executed successfully at command line. When I set a cronjob to run this rake file, the line "require 'json'" fails. My guess is that cronjob has a different env variable. It doesn't work when I tried to put "puts ENV" in the ruby script. So I'm wondering what I should do to check the different env var...
So, OK, the job runs in cron: it fetches compressed files and processes them. If the files are corrupted, it deletes them. Sometimes they are bad on the remote server, in which case they will be downloaded and deleted each time. My cron logs extensively to STDOUT (directed to logfile in .crontab), using STDERR only for things that cause...
I am developing an application on google app engine and was just checking out cron jobs. Looking at this document it seems pretty easy to schedule the jobs with config files and so on. My question is related to what I should actually put in the url the scheduled task triggers. I was thinking a jsp which triggers a servlet that does wha...
I've got a cron job parsing a few XML feeds every ten minutes and creating a few partials to include on every page in my Rails project with the render: file method. The problem is that, obviously, they don't refresh until the server restarts. Anyway, what can I do to force rails to refresh this file every time? Thanks in advance. ...
I am writing a script to capture disk usage on a system (yes, I know there is software that can do this). For database reporting purposes, I want the interval between data points to be as equal as possible. For example, if I am polling disk usage every 10 minutes, I want every data point to be YYYY-MM-DD HH:[0-5]0:00. If I'm am pollin...
In its current format, Google App Engine's Cron allows that "The shortest time between runs of a task that can be specified is 1 minute." I have an application that where I would prefer it run a task every 10 seconds. Are there any workarounds? ...
Whenever a new user signs up on my site, I want to do some pre-processing to shorten their searches in the future. This involves anywhere from 30 to 2 minutes processing time. Obviously I cannot do this when they click the submit button on signup... or on any PHP page they visit. However, I would like this done within 5 minutes of the...
I have a PHP script that needs to be run at certain times every weekday. Is cron or Windows task scheduler the only way to do this? Is there a way to set this up from within another PHP script? ...
I've currently created a custom rake file that does the following: 1.) Checks an External Feed for "NEW" Items 2.) For each new item in the feed array,it updates my Database with a new record 3.) I've currently got it on a WHILE loop. The while loop has an (@loopcheck) instance variable that is set to true initially, and if any ex...