I want to parse the dates+prices of the month September from the hidden calendar on this URL: http://www.lufthansa.com/vol/vol-paris-berlin . The problem here is that when you press on the month September the page will generate the calendar but witho...

<p><strong>Chapter One</strong></p><p>A piece of computer code</p>     <table>  <tr>  <th>Firstname</th>  <th>Lastname</th>   <th>Age</th>  </tr> <tr>  &l...

I'm trying to get the content from a website, that uses "onClick" instead of "href" in hyperlinks, so the url is always the same, despite of the page you are seeing.  http://www.sas.ul.pt/index.php  This is the website, and the co...

I am trying to get at HTML data that does not appear in the source document but can be exposed, for example, by "inspect element" in Google Chrome.    Example page: http://assignment.uspto.gov/#/search?q=9000000&sort=patAssignorEarliestEx...

right now I'm working on a webcrawler. This one should parse some specific sites and give me an output into an xml-file. Up to this point, it's no problem. The Crawler works and you can customize it realy quickly via a cfg-file. I use Jsoup t...

I create a JSoup Document which includes two <script type="application/javascript">/* .. */</script> elements.  The Issue: When I call .html() or .toString() JSoup will escape my JavaScript.  if (foo && bar)    gets  if (f...

Is there any API for Node.js to get and query html from URLs and static html?  I like to do something like this to use with webscrap:  Document doc = Jsoup.connect("http://en.wikipedia.org/").get(); Elements newsHeadlines = doc.select("#...

I am trying to access some content on a web page that is created by some Javascript. However, the content that I wish to access is created by the javascript after the page has loaded so this chunk of Html source is no where to be found when I try and...

I am trying to develop and application with jsoup and java to scrap some web pages. So what I am hoping to make is to let jsoup get the page source first and the on the page source let the below javascript get executed and return back a result.  $(&#...

I am working in get wheather conditions from a web. http://trestlebikepark.com/  When I  use the Inspect Element Function from Chrome or Firefox I find  the div class with the text I need (34F).   <div class="overlayWeather">...