A former coworker of mine over 8 years ago put this image into my head that has never left. He was working as my manager at the time and he had an upcoming large, foundational shifting feature that he wanted to let me know was coming. He said “Don’t do anything right now, but just put this in your noodler and see what comes out.”

Thoughts Slow then fast

With the wide adoption of robust front-end frameworks and CSS-in-JS, traditional methods of targeting xpath or CSS selectors for scraping data from web pages are becoming ineffective. However, this new paradigm of front-end development leaves a key opportunity to improve the web scraping experience.

Thoughts