Saving html page from MATLAB web browser

Question

Following this question I get a message on the retrieved page that "Your browser does not support JavaScript so some functionality may be missing!"

If I open this page with web(url) in MATLAB web browser and accept certificate (once per session), the page opens properly.

How can I save the page source from the browser with a script? Or from system browser? Or may be there is a way to get that page even without browser?

url='https://cgwb.nci.nih.gov/cgi-bin/hgTracks?position=chr7:55054218-55242525';

Answer 1

From what I could tell the page source gets downloaded just fine, just make sure to let Javascript run when you open the saved page locally.

[...]
<script type='text/javascript' src='../js/hgTracks.js'></script>
<noscript><b>Your browser does not support JavaScript so some functionality may be missing!</b></noscript>
[...]

Note that the solution you are using only downloads the web page without any of the attached stuff (images, .css, .js, etc..).

What you can do is call wget to get the page with all of its files:

url = 'https://cgwb.nci.nih.gov/cgi-bin/hgTracks?position=chr7:55054218-55242525';
command = ['wget --no-check-certificate --page-requisites ' url];
system( command );

If you are on a Windows machine, you can always get wget from the GnuWin32 project or from one of the many other implementations.