Web Scraping Javascript In Python / R
I'm doing some personal data science projects and one of them is to see how often certain songs are played on the radio. http://www.iheart.com/live/radio-1045-3401/ Looking at the
Solution 1:
Most web pages that involve dynamic elements have page elements generated and inserted by Javascript that the browser parses and executes for you. You already guessed this, I suspect, based on the question title.
What you see in the page source is the raw HTML before Javascript kicks in and updates it.
You want a headless browser: a browser without a graphical user interface. This will parse and execute Javascript for you, and update page HTML accordingly.
Here is a full list of headless browsers. Note that you can do this task in any language.
Post a Comment for "Web Scraping Javascript In Python / R"