message-queue

delayed_job: detecting when one instance already running in /etc/init.d/delayed_job

Hi all I've been trying to build a robust /etc/init.d/delayed_job script. Below is my naive attempt which is failing in the case of the daemon already running. #! /bin/sh ... # return 1 if already running do_start() { /path/to/current/script/delayed_job start if [ "$?" -ne "0" ]; then echo "delayed_job i...

Can POSIX message queues be used cross user on Linux?

Hi all, I have implemented a POSIX message queue. On the listener side, I am opening the queue like this: mqdes = mq_open(s_mailbox_name.c_str(), O_RDONLY | O_CREAT, S_IRWXU | S_IRWXG | S_IRWXO, NULL); On the sender side, I am opening the queue like this: mqdes = mq_open(m_s_mailbox_name.c_str(), O_WRONLY); The string is the same o...

multithreading: event driven vs message driven

Is there a difference in performance when multi-threading developed with win32 event objects (CreateEvent) or with thread window message queue. Both should use some kind of WaitFor... calls. My own code almost completely based on event, but maybe I lose something when don't use messages. ...

JBoss JMS Remote Queue ????

Hey All, I want to send messages to remote queue ? what steps should i do i cant find any documentation about that ? anyone can help ?? ? ...

Low-latency, large-scale message queuing

I'm going through a bit of a re-think of large-scale multiplayer games in the age of Facebook applications and cloud computing. Suppose I were to build something on top of existing open protocols, and I want to serve 1,000,000 simultaneous players, just to scope the problem. Suppose each player has an incoming message queue (for chat a...

MSMQ - Create and Send Message

I have a public queue created in a remote machine. I am able to access the queue, create a message and send it from my workstation. However, when I access the remote machine that hosts the message queue, I do not see any messages. Any ideas on what I am missing? Is there anything that need to be configured to receive messages? ...

Is there a Message Bus provider that allows for Durable Subscribersand full replay?

I am trying to find a message bus provider that supports Durable Subscribers and allows me to replay, in order, based on the message timestamp, all messages for a given topic. Futhermore, I would like the message bus to reset each durable consumer's checkpoint when a message arrives late. E.g. Client subscribes to topic 1 at 2009-12-22...

Apache Camel deployment

What is a typical/preferable way to build system with Apache-Camel and ActiveMQ ? How can high availability be achieved ? What container the Camel should run in ? ...

Best Practices for Microsoft Message Queue and Resource Release

I would like to know what are your best practices in using and disposing a message queue. I would also appreciate if there is code especially in the disposing part in order to visualize your concept. The language is in C# or any .NET language will do. The queue that is being used is Microsoft Message Queues. Currently I am encounteri...

Message queuing solutions?

(Edited to try to explain better) We have an agent, written in C++ for Win32. It needs to periodically post information to a server. It must support disconnected operation. That is: the client doesn't always have a connection to the server. Note: This is for communication between an agent running on desktop PCs, to communicate with a s...

requeue a sweatshop job in RabbitMQ

I am working on a Rails application where customer refunds are handed to a Sweatshop worker. If a refund fails (because we cannot reach the payment processor at that time) I want to requeue the job. class RefundWorker < Sweatshop::Worker def process_refund(job) if refund Transaction.find(job[:transaction]).update_attributes(:sta...

what are popular message queue services in Java?

Other than JMS, what other queue based applications/services are popular? Just want to know what is used in the industry, I am learning the basics and want to know what to put on the list. ...

Confused as to when you would use JMS (or a queue in general) versus a database

When you store a message in a queue, isn't it more of meta data information so whoever pulls from the queue knows how to process the data? the actual information in the queue doesn't always hold all the information. Say you have an app like Twitter, whenever someone posts a message, you would still need to store the actual message text...

Bulk database rows to message queue for long running operation

At scheduled times (based on business rules), we need anywhere between 10,000 - 200,000 rows from a database to be processed by a long running operation. Each row needs to be processed individually (they don't depend on each other) and it is ok for this to happen asynchronously. The successful completion of the operation must be document...

What is the fastest producer consumer method in c#

Hi, I am trying to implement a queue thread that listen to some messages . What is the fastest way to do it , this is one-process mulitple thread application. Should I use Apache Qpid ? or just a regular .NET Blocking Queue Class (as in http://www.eggheadcafe.com/articles/20060414.asp)? I will be happy to hear your experience on this m...

Why choosing JMS for asynchronous solution ? Why is it better than a simple entity bean ?

Hi everybody, In most projects I have participated, the choice of an asynchronous solution has been a source of much discussion ... Each time a single entity bean was enough to manage a queue: we just store a message (ticket) in a table and a processing cron unstacks the queue. This simple solution has the advantage of being very simpl...

Threading to Parallelize Synchronous IO in .Net

Currently I'm in the process of designing the messaging system for my application (which uses AMQP on the backend via RabbitMQ). There are going to be multiple instances where a method can get data from multiple sources at the same time (ie. doesn't have to be sequential queries). Originally, I was going to use the ThreadPool and QueueU...

Best Server Side Application for accepting website statistics

I been thinking about how to configure a web statistics to collect information like Google Analytics. I would think that sending the info over would have to be super quick. My initial thought would be to use http://activemq.apache.org/ to receive the information (Quicker than a DB insert) and then a separate process would actually take...

client requirements for messaging system (a la MassTransit) using MSMQ?

Having not used MSMQ before, I'm not at all clear an the client environment requirements to use it. I'm designing a client/server solution that will integrate with a legacy system and I'm sold on messaging. I'd like to use a service bus implementation like MassTransit, but that requires MSMQ. Do I have to ensure that every client PC ha...

Message queue msgsnd mtext field

When using msgsnd the structure mentioned in man page is struct mymsg { long mtype; /* message type */ char mtext[1]; /* body of message */ }; But if you use it like func(char *array, int sizeofarray) { struct mymsg { long mtype; /* message type */ char *ptr; /* body of message */ }; ...