ansaurus

Question

Answer 1

+1 A:

Have you tried the mechanize module? It was made just for this purpose.

Eli Bendersky 2010-05-14 06:17:37

Please let me know how to where to install mechanize

2010-05-14 08:54:31

see instructions here: http://wwwsearch.sourceforge.net/mechanize/download.html - after downloading and unzipping you must run `python setup.py install` in the unzipped mechanize directory

Eli Bendersky 2010-05-14 13:20:32

Answer 2

A:

You can use urllib to send HTTP POST requests.

import urllib
params = urllib.urlencode({
    'name': 'Test 4',
    'scriptPath': '...',
    'script': 'test4.cfg',
    'artifacts': '...',
    'configPath': '...',
    'client.POK_code': '1'
    # Include the additional arguments of the input fields
    # i.e. all checkboxes
})
f = urllib.urlopen('http://url/to/DeployStart.jsp', params)
print f.read()

ThiefMaster 2010-05-14 06:17:39

If u see the code, i would not know these parameters as i get the branch name and the test environment to deploy the build on from a txt file. I had just cpy pasted the html of the webpage for a particular branch and a particular environment

2010-05-14 06:45:51

Answer 3

+1 A:

i downloaded mechanize zip file for the page that u posted and wrote the below code

import re
import mechanize, urllib1, urllib2

br = mechanize.Browser()
br.open("http://10.47.42.27:8080/cruisecontrol/DeployConfig.jsp?name=Test%204&amp;scriptPath=f:/Projects/PokerDeployer&amp;script=test4.cfg&amp;artifacts=f:/cruisecontrol/s_drive/artifacts/Poker-TTM_trunk_nightly_build/20100512230443&amp;configPath=f:/Projects/Poker-TTM_trunk_nightly_build/source/tools/PokerDeployer")
assert br.viewing_html()
print br.title()
print response1.geturl()
print response1.read()

br.select_form(name = "cfg")
response2 = br.submit()

print br.form

But it says ImportError: No module named mechanize

2010-05-14 07:25:27

see instructions here: http://wwwsearch.sourceforge.net/mechanize/download.html - after downloading and unzipping you must run `python setup.py install` in the unzipped mechanize directory

Eli Bendersky 2010-05-14 13:21:13

Answer 4

A:

Hi, Finally managed to use ClientForms It works fine when i passed a static url But when i integrated the code with another code (which uses HTMLParser to parse webpages for the final url i.e the webpage which has the checkboxes and the submit button) i am getting HTTP version error 505.

Below is the code

URL = "http://10.47.42.27:8080/cruisecontrol"

#from urllib2 import urlopen
from HTMLParser import HTMLParser

import re
import ClientForm
import urllib2

# Fetching links using HTMLParser
def get_links(url):
    parser = MyHTMLParser()
    parser.feed(urlopen(url).read())
    parser.close()
    return parser.links

# Build url for Deploy page
def get_deploy_url():
    url = URL + "/buildresults/Poker-TTM_%s_nightly_build" % branch
    print url
    for link in get_links(url):
        if link["href"].startswith("Deploy"):
            return "%s/%s" % (URL, link["href"])

# Build url for Destination page
def get_destination_url():
    url = get_deploy_url()
    print url
    destination_re = re.compile(r"%s" % destination)
    for link in get_links(url):
        if destination_re.search(link["href"]):
            return "http://10.47.42.27:8080/cruisecontrol/" + link["href"]
        print link["href"]

# Parsing HTML pages 
class MyHTMLParser(HTMLParser):
    def __init__(self, *args, **kwd):
        HTMLParser.__init__(self, *args, **kwd)
        self.links = []

    def handle_starttag(self, tag, attrs):
        if tag == "a":
            attrs = dict(attrs)
            if "href" in attrs:
                self.links.append(dict(attrs))

    def handle_endtag(self, tag):
        pass

if __name__ == "__main__":
    # Read the branch name and the test destination to deploy on
    lines = [x.split(':') for x in open("branch_dest.txt")]
    print lines
    branch = "%s" % lines[0][1].strip()
    print branch
    destination = "%s" % lines[1][1].strip()
    print destination

    final_url = get_destination_url()
    if final_url is None:
        print "Cannot deploy here"
    else:
        print final_url
        request = urllib2.Request("%s" % final_url)
        print request
        response = urllib2.urlopen(request)
        forms = ClientForm.ParseResponse(response, backwards_compat = False)
        response.close()
        form = forms[0]
        print form
        form.find_control("all_top").items[0].selected = True
        form.find_control("client.POK_code").items[0].selected = True
        form.find_control("client.SVS_code").items[0].selected = True
        form.find_control("client.PAT_code").items[0].selected = True
        form.find_control("client.POK_code_gms").items[0].selected = True
        form.find_control("client.POK_code_gms_cpn").items[0].selected = True
        form.find_control("client.POK_code_mini").items[0].selected = True
        form.find_control("client.LTM_code").items[0].selected = True
        form.find_control("client.LTM_tot_code").items[0].selected = True
        form.find_control("client.POK_code_paradise").items[0].selected = True
        form.find_control("client.POK_code_forfun").items[0].selected = True
        form.find_control("client.POK_code_pokerheaven").items[0].selected = True
        form.find_control("client.POK_code_totalpoker").items[0].selected = True
        form.find_control("client.POK_code_las").items[0].selected = True
        form.find_control("client.POK_code_italian").items[0].selected = True
        form.find_control("client.POK_code_bulgarian").items[0].selected = True
        form.find_control("client.POK_code_finnish").items[0].selected = True
        form.find_control("client.POK_code_danish").items[0].selected = True
        form.find_control("client.POK_code_french").items[0].selected = True
        form.find_control("client.POK_code_greek").items[0].selected = True
        form.find_control("client.POK_code_german").items[0].selected = True
        form.find_control("client.POK_code_croatian").items[0].selected = True
        form.find_control("client.POK_code_polish").items[0].selected = True
        form.find_control("client.POK_code_portuguese").items[0].selected = True
        form.find_control("client.POK_code_romanian").items[0].selected = True
        form.find_control("client.POK_code_russian").items[0].selected = True
        form.find_control("client.POK_code_slovak").items[0].selected = True
        form.find_control("client.POK_code_spanish").items[0].selected = True
        form.find_control("client.POK_code_czech").items[0].selected = True
        form.find_control("client.POK_code_swedish").items[0].selected = True
        form.find_control("client.POK_code_hungarian").items[0].selected = True
        form.find_control("client.POK_code_turkish").items[0].selected = True
        form.find_control("client.POK_code_albanian").items[0].selected = True
        form.find_control("client.POK_code_austrian").items[0].selected = True
        form.find_control("client.POK_code_brazilian").items[0].selected = True
        form.find_control("all").items[0].selected = True
        print form

        ##request2 = form.click()
        try:
            response2 = urllib2.urlopen(request2)
        except urllib2.HTTPError, response2:
            pass

        print response2.geturl()
        print response2.read()
        response2.close()

Getting below error:

Traceback (most recent call last):
  File "C:\deploy_input_clientform.py", line 66, in <module>
    response = urllib2.urlopen(request)
  File "C:\Python26\lib\urllib2.py", line 126, in urlopen
    return _opener.open(url, data, timeout)
  File "C:\Python26\lib\urllib2.py", line 397, in open
    response = meth(req, response)
  File "C:\Python26\lib\urllib2.py", line 510, in http_response
    'http', request, response, code, msg, hdrs)
  File "C:\Python26\lib\urllib2.py", line 435, in error
    return self._call_chain(*args)
  File "C:\Python26\lib\urllib2.py", line 369, in _call_chain
    result = func(*args)
  File "C:\Python26\lib\urllib2.py", line 518, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 505: HTTP Version Not Supported

Please help!

2010-05-17 07:39:46

Can anybody help me please!

2010-05-18 06:27:28

ansaurus

tags:

views:

answers:

simulating form submit in python

related questions