message-queue

What am I doing wrong with boost::interprocess::message_queue?

I've created a boost::message_queue by the following way: namespace bipc = boost::interprocess; ... try { bipc::message_queue::remove("EDBA90AC-289D-4825-98D9-F85185041676"); // The below throws exception, no matter what's the name of the queue... boost::shared_ptr<bipc::message_queue> mq(new bipc::message_queue(bipc::cr...

RabbitMQ Message Consumption ID based (c# API)

i would like to publish/produce a message with some message id, like each message has a particular id.. And at the consumer end i would like to retrieve the messages by prividing the ID. suppose we have multiple consumers than each one should get only those messages which they requested through the message ids. (i hope i am clear enough...

Is message priority inherently unimportant in message queue systems?

It seems like most of the messaging systems I've looked at have basic, if any, support for priority message queues. For example, the AMQP only specifies a minimum of 2 priorities. RabbitMQ, an AMQP implementation, doesn't support any priorities. ActiveMQ will be getting support for 10 message priorities in version 5.4 in a couple days. 1...

Pure java ZeroMQ clients?

I am trying to use ZeroMQ's pub sub messaging, but the client side requires the code to be all Java. I understand that ZeroMQ has a Java binding but that still relies on a c library, therefore I am unable to use it. Is there a ZeroMQ client I can use to connect to the server, or is the implementation simple enough for me to do myself? ...

Acknowledge a message from a different Channel/Session in JMS

I need a message to be Acknowledged in a different Session than the one it is created in. If the consumed message is not ACKed in a given time, it should be added back to the queue. Is this possible using JMS( planning to use ActiveMQ as the broker). ...

Any job queue systems that allow scheduling jobs by date?

I have a Django application. One of my models looks like this: class MyModel(models.Model): def house_cleaning(self): // cleaning up data of the model instance Every time when I update an instance of MyModel, I'd need to clean up the data N days later. So I'd like to schedule a job to call this_instance.house_cleaning() ...

asynchronous processing with PHP - one worker per job

Consider a PHP web application whose purpose is to accept user requests to start generic asynchronous jobs, and then create a worker process/thread to run the job. The jobs are not particularly CPU or memory intensive, but are expected to block on I/O calls fairly often. No more than one or two jobs should be started per second, but due ...

Can I Use Boost Message Queues for Thread Communication

Hi, I am spawning multiple worker threads from a main thread. Can I create message_queue for each thread from the main thread and send messages from the main thread. Am I asking this because message queues are meant for interprocess communication. Do I need to consider anything specific regarding this ...

Does this exists as a cloud service?

Database Redis Casandra MySQL (RDS, while nice, isn't quite agile enough) (other besides RDS) PostgreSQL Queueing RabbitMQ Beanstalkd Gearman Full text search Thinking Sphinx ...

Queue System Farm questions

Hi, Until now, we haven't really needed to implement a queue system in our infrastructure, but now we need some features that cannot be done thru cron jobs (too slow). Our infrastructure is LAMP (PHP) with some NoSQL. I have looked at Gearman and it seems to be perfect for our needs. I know Digg uses it, as well as Yahoo so it must be...

.Net Messaging & STOMP Protocol

I have a doubt regarding .net messaging & its compatibility with other open protocols out there. I would like to know if .net messaging API capable of working with STOMP protocol? How do i make use of this protocol? is there any specific library out there I need to use? thanks for sharing your experience and ideas. ...

Accessing messageQueue from anonymous web service

Hi, I have a public message queue with full permissions to everyone, that I attempt to access from an anonymous web service. Method MessageQueue.Exists -> Returns false all the time. If the queue is public and everyone has permissions, why can't I find it? I changed my code to look like this: MessageQueue queue = new MessageQueue(name...

Sinatra message Queue

Starling is a great (at least for small projects) and simple message queue, however, it doesn't actually manage or start workers that consume the queues. Workling does this for Rails projects, but doesn't work for pure ruby applications, neither for Sinatra. Before I fork workling, or create my own custom one with threads/fork, is there...

Open Source Queue that works with Java, PHP and Python

I'm currently in the market for a new queue system for jobs we have in our system. I've tried beanstalk but it's been unable to keep up with the load. I'm looking for a simple system to get up and running that I can put pieces of data in from producers and have consumers in Java, PHP and Python pull data off and process it. Ideally I'd...

MySQL - How do I efficiently get the row with the lowest ID?

Is there a faster way to update the oldest row of a MySQL table that matches a certain condition than using ORDER BY id LIMIT 1 as in the following query? UPDATE mytable SET field1 = '1' WHERE field1 = 0 ORDER BY id LIMIT 1; Note: Assume the primary key is id and there is also a index on field1. We are updating a single row. We are ...

Writing data to one file from several instances of single application, C#, Visual Studio 2008

I have a Visual Studio project that gets installed to about half of the PCs in our company. The application has an error logging routine that appends error messages to a text file that is kept here: static string _appPath = Path.Combine(Environment.GetFolderPath(Environment.SpecialFolder.CommonApplicationData), Application.CompanyName)...

Implementing message priority in AMQP

Hello all, I'm intending to use AMQP to allow a distributed collection of machines to report to a central location asynchronously. The idea is to drop messages into the queue and allow the central logging entity to process the queue in a decoupled fashion; the 'process' is simply to create or update a row in a database table. A proble...

How should a ZeroMQ worker safely "hang up"?

I started using ZeroMQ this week, and when using the Request-Response pattern I am not sure how to have a worker safely "hang up" and close his socket without possibly dropping a message and causing the customer who sent that message to never get a response. Imagine a worker written in Python who looks something like this: import zmq c ...

How to tell whether Win32 WM_POWERBROADCAST message has interrupted a call stack

How can you tell whether a WM_POWERBROADCAST message has interrupted a call stack? As opposed to happening in isolation with just the message handler call stack? Here's the background: What I see is that during hibernate / resume I get WM_POWERBROADCAST messages. These can seemingly interrupt a (blocked/waiting) callstack for e.g. a WM_...

How can I securely transfer files

I need to automatically transfer an xml file from server A over internet to a server B. Ftp works fine, but should I be use a message queue instead? It should be secure in the order that I won't lose messages and be able to log what is transferred. ...