I'm currently creating a Node.js webscraper/proxy, but I'm having trouble parsing relative Urls found in the scripting part of the source, I figured REGEX would do the trick.  Although it is unknown how I would achieve this.   Is there anyway...
Months ago, Instagram began rendering their public API inoperable by removing most features and refusing to accept new applications for most permissions scopes. Further changes were made this week which further constricts developer options.  Many of...
I am currently writing an Android app that, among other things, uses text information from websites which I do not own. In addition, some of the pages require authentification.  For some pages I have been able to log in and retrieve the html code usi...
Thanks for taking interest in this.  I was given the [tedious] task to look what is the country of origin of some medicins, as they are registered with the colombian food and drug administration. The agency uses a website with a javascript (.jsp ext...
I'm trying to download the HTML of a website that is almost entirely generated by JavaScript.  So, I need to simulate browser access and have been playing around with PhantomJS.  Problem is, the site uses hashbang URLs and I can't seem to get...
My company is using a website that hosts all of our FAQ and customer questions. We have plans to go through and wipe out all of the old data and input new and the service does not have a backup, or archive option for questions we don't want to ap...
What I would like to do is to search a website using VBA, putting some words in the left box and getting results on the right.   The problem is that I don't know HTML and I don't know how to refer to this box. I use GetElementByID but I recei...
I am trying to grab the entire html on a web page that uses lazy load. What I have tried is scrolling all the way to the bottom and then use page.content(). I have also tried scrolling back to the top of the page after I scrolled to the bottom and th...
I am working on a task in which I have to get details from a web page using python request library. I have successfully got the details from the page but it has a button "Show Details" which fetches more details using ajax call, now I need to...
How can I download from links on a JavaScript rendered webpage? Python is the preferred language.  So far, I've tried using the Python bindings for Selenium on a headless server. This approach is terribly slow, fraught with error, and is incapabl...

Tags

Recent Questions

Top Questions

Home Tags Terms of Service Privacy Policy DMCA Contact Us

©2020 All rights reserved.