One block on the page is filled with content by JavaScript and after loading page with Jsoup there is none of that inforamtion. Is there a way to get also JavaScript generated content when parsing page with Jsoup?  Can't paste page code here, s...

I work on a website  with JAVA Jsoup Library to extract some hyperlinks  Document doc = Jsoup.connect("http://www.saudisale.com/SS_a_mpg.aspx").get(); Elements script = doc.select("script") ;    for(Element elementary :doc.select("...

I want to parse the dates+prices of the month September from the hidden calendar on this URL: http://www.lufthansa.com/vol/vol-paris-berlin . The problem here is that when you press on the month September the page will generate the calendar but witho...

<p><strong>Chapter One</strong></p><p>A piece of computer code</p>     <table>  <tr>  <th>Firstname</th>  <th>Lastname</th>   <th>Age</th>  </tr> <tr>  &l...

I'm trying to get the content from a website, that uses "onClick" instead of "href" in hyperlinks, so the url is always the same, despite of the page you are seeing.  http://www.sas.ul.pt/index.php  This is the website, and the co...

I am trying to get at HTML data that does not appear in the source document but can be exposed, for example, by "inspect element" in Google Chrome.    Example page: http://assignment.uspto.gov/#/search?q=9000000&sort=patAssignorEarliestEx...

right now I'm working on a webcrawler. This one should parse some specific sites and give me an output into an xml-file. Up to this point, it's no problem. The Crawler works and you can customize it realy quickly via a cfg-file. I use Jsoup t...

I create a JSoup Document which includes two <script type="application/javascript">/* .. */</script> elements.  The Issue: When I call .html() or .toString() JSoup will escape my JavaScript.  if (foo && bar)    gets  if (f...

Is there any API for Node.js to get and query html from URLs and static html?  I like to do something like this to use with webscrap:  Document doc = Jsoup.connect("http://en.wikipedia.org/").get(); Elements newsHeadlines = doc.select("#...

I am trying to access some content on a web page that is created by some Javascript. However, the content that I wish to access is created by the javascript after the page has loaded so this chunk of Html source is no where to be found when I try and...