httpwebrequest

Having problem with a crawl service in .net: Server not responding to IP ping. Is it bandwidth or http connection limit exceeded?

Hi to all I develop web crawling service (windows service / multi-thread) . its work fine, but sometimes my server network not response. and i can't ping server IP (from internet), but can ping by other network card (local ip) that not access to internet. after i open server with remote desktop and stop crawling service. i could ping....

How to force HttpWebRequest to use cache in ASP.NET environment?

In my ASP.NET app I use HttpWebRequest for fetching external resources which I'd like to be cached. Consider the following code: var req = WebRequest.Create("http://google.com/"); req.CachePolicy = new HttpRequestCachePolicy(HttpRequestCacheLevel.CacheIfAvailable); var resp = req.GetResponse(); Console.WriteLine(resp.IsFromCache); var a...

How to change the request IP in HttpWebRequest?

I'm developing a website that will connect to a credit card processing gateway webservice. For security purposes this webservice accepts requests only from IP addresses that were previously informed to them. Since I'm developing locally, my IP changes almost every day. Is there a way for me to change the IP address of a HttpWebRequest s...

Wrapper class for HttpGet / Post in Java?

Hi, Sorry, I'm quite new to Java. I've stumbled across HttpGet and HttpPost which seem to be perfect for my needs, but a little long winded. I have written a rather bad wrapper class, but does anyone know of where to get a better one? Ideally, I'd be able to do String response = fetchContent("http://url/", postdata); where postdata...

How to read the response stream before the Http response completes

When making a request using HttpWebRequest object, I need to call the method GetResponse() to send the request and get the response back. The problem with this method is that it doesn't return the response object until all data has been received. Say I am downloading a 100 MB file, I won't be able to read it until the response finish and...

Maximum page fetch with maximum bandwith

Hi I want to create an application like a spider I've implement fetching page as the following code in multi-thread application but there is two problem 1) I want to use my maximum bandwidth to send/receive request, how should I config my request to do so (Like Download Accelerator application and the like) cause I heard the normal appl...

Receive JSON payload with ZEND framework and / or PHP

I'm receiving a JSON payload from a webservice at my site's internal webpage at /asset/setjob. The following is the JSON payload being posted to /asset/setjob: [{"job": {"source_filename": "beer-drinking-pig.mpg", "current_step": "waiting_for_file", "encoding_profile_id": "nil", "resolution": "nil", ...

Fails proceeding after POSTing to web server

Hello According to this question, it seems like the error "Too many automatic redirections were attempted" is caused when forgetting to use a cookiecontainer to connect to a web server that uses cookies to keep track of the user. However, even though I used "request.CookieContainer = MyCookieContainer", I'm still getting into an endles...

Converting HTTP Response (Java "Properties" stream format) in to NSDictionary.

Hi guyz, I am working on iphone application which contains HTTP Request and Response. The format of the response is a key/value format compatible with the Java "Properties" stream format. I want to store the response into a NSDictionay. Could you suggest me any way to do this? Thank you. sangee Edit: Thanks guyz for the quick rep...

Messing with Encoding and XslCompiledTransform

Hello, im messing with the encodings. For one hand i have a url that is responding me in UTF-8 (im pretty sure thanks to firebug plugin). Im opening the url reading the content in UTF-8 using the following code: StreamReader reader = new StreamReader(response.GetResponseStream(),System.Text.Encoding.UTF8); For other hand i have a ...

Java: Asynchronous task

For some of HTTP requests from clients, there're very complex business logic in server side. Some of these business logics doesn't require to response to the client immediately, like sending a email to somebody. Can I put those tasks in an asynchronous method,so I only need to ensure that they had been executed,I don't need to wait all t...

Can a client dictate whether or not HttpContext is created?

We are getting a lot of hits from Googlebot and BingBot and it appears that none of these requests have an HttpContext. I originally thought that every http request will get a context which obviously is not the case so I'm trying to understand how does an HttpContext gets constructed, is it part of the negotiation between client and ser...

The request was aborted: Could not create SSL/TLS secure channel.

We are enabled to connect to an https server using WebRequest because of this error message : The request was aborted: Could not create SSL/TLS secure channel. We know that the server aint got a valid https certificate with the path used (and we're not even sure if its fully release yet... ) but to bypass this issue, we use the followi...

Performance, serve all CSS at once, or as its needed?

As far as I know, these days there are two main techniques used for including CSS in a website. A) Provide all the CSS used by the website in one (compressed) file B) Provide the CSS for required by the elements on the page that is currently being viewed only Positives for A: The entire CSS used on the site is cached on first visit via...

Basic question about request queues in IIS / ASP.Net

I have an ASP.Net application running under IIS 6. A simple page has two radio buttons and a submit button. If I select radio button "A" and submit the page, a lengthy PDF file is generated, which takes about a minute to build. If I select radio button "B", a small PDF is generated. (In both cases the PDF is written out to the Respon...

c# HttpWebResponse login

Hello all i'm trying to log in a web app from my .net application, but for some reason it doesn't work. Here is the login code: <form action="./process-login.php" method="post"> <table border="0" cellpadding="5" cellspacing="0"> <tr> <td>Username:</td> <td><input type="text" size="20" name="username" v...

Redirected wikipedia request

Hi people, i need to write a program, that can redirect's http://localhost:8080 to en.wikipedia.org, it seems to be easy, but i have some problems(only with wikipedia with another sites works good). I make url to wikipedia: URL url = new URL("http", "en.wikipedia.org", 80, "/wiki"); than URLConnection, extract headers, and when i wan...

How to use http-delete from the shell

Is it possible to send a HTTP DELETE request from the shell and if so, how? ...

Making a HTTP request to API possible with VB/ASP classic?

Is it possible to make requests to a Web API with ASP classic? For example just something as simple as the Flickr API, or was this sort of thing not supported way back when? ...

Google App Engine, Task Queues

How can I remove a task from a task queue? Is Google App Engine Task Queue removes the task from the queue after it is executed? ...