I have recently been learning Python and am dipping my hand into building a web-scraper.  It's nothing fancy at all; its only purpose is to get the data off of a betting website and have this data put into Excel.  Most of the issues are solvabl...

I have HTML webpages that I am crawling using xpath. The etree.tostring of a certain node gives me this string:  <script> <!-- function escramble_758(){   var a,b,c   a='+1 '   b='84-'   a+='425-'   b+='7450'...

I am scraping JSON data from a url. The time is military time and I was wondering if there is a way once I retrieve on the client side to convert it to standard time.  Here is the JSON:  [   {     SaturdayClose: "21:00",     SaturdayOpen: ...

I need to do some web scraping. After playing around with different web testing framework, of which most where either too slow (Selenium) or too buggy for my needs (env.js), I decided that zombie.js looks most promising, as it uses a solid set of lib...

This is part of a project I am working on for work.  I want to automate a Sharepoint site, specifically to pull data out of a database that I and my coworkers only have front-end access to.  I FINALLY managed to get mechanize (in python) to accomplis...

I am trying to scrape URLs from a page that uses JavaScript. Instead of having links on the page, they created onClick events for a number of table rows, whereby, when you click the row, it takes you to the link.  I tried scraping the URLs using Mech...

I create a simple web scraper to grab data from a website by using phantomjs. It's doesn't work for me when I used querySelectorAll to get content which I want. Here is my whole code.   var page = require('webpage').create();  var url...

I'm interested in writing a script, preferably one easy to add on to browsers with tools such as Greasemonkey, that sends a page's HTML source code to an external server, where it will later be parsed and useful data would be sent to a databa...

I am looking to grab the Recommended Customer Pricing information from a URL that is defined in an Excel worksheet using VBA.  Those values are in Excel in Cells(i,11), which all point to a specific page on https://ark.intel.com.  The values begin on...

The simple script below returns a bunch of rubbish. It works for most websites, but not william hill:  var Browser = require("zombie"); var assert = require("assert");  // Load the page from localhost browser = new Browser() browser.v...