The Next Web: Holy sheet: How to pull contact details from a website using only Google Sheets. “Are you in a job where you regularly need to collect contact information from companies? And do you find it an annoying and unnecessarily time-consuming task to sort through ever-changing web designs, to find that one button or bit of information you’re actually looking for? Don’t look any further… help is on the way!” Brilliant use of IMPORTXML / XPath.
Hongkiat: 5 Best Web Scraping Tools to Extract Online Data. “These software look for new data manually or automatically, fetching the new or updated data and storing them for your easy access. For example, one may collect info about products and their prices from Amazon using a scraping tool. In this post, we’re listing the use cases of web scraping tools and the top 10 web scraping tools to collect information, with zero codings.”
Smashing Magazine: The Guide To Ethical Scraping Of Dynamic Websites With Node.js And Puppeteer. “For a lot of web scraping tasks, an HTTP client is enough to extract a page’s data. However, when it comes to dynamic websites, a headless browser sometimes becomes indispensable. In this tutorial, we will build a web scraper that can scrape dynamic websites based on Node.js and Puppeteer.”
Hongkiat: How to Scrape Webpages at Regular Intervals (Automatically). “In this write-up, I will introduce you to two methods for web scraping. The first method is a beginner-friendly way to scrape data using a ready-to-use solution. The second method is a programmer-friendly way to scrape data using Scrapy, which supports powerful scraping if well done. Let’s check both of them.”
The Register: Facebook sues to shut down alleged Instagram clone maker over scraping and sharing personal info for cash
The Register: Facebook sues to shut down alleged Instagram clone maker over scraping and sharing personal info for cash . “Facebook on Thursday sued Ensar Sahinturk, a software developer based in Istanbul, Turkey, who is alleged to have built a network of sites that scrape data from Instagram to create Insta-clones.”
ZDNet: Facebook link preview feature used as a proxy in website-scraping scheme. “The technique consisted of using Facebook developer accounts to place calls to Facebook or Facebook Messenger API servers, requesting a link preview for pages a group wanted to scrape. Facebook would fetch the data, assemble it in a link preview, and return it to the data scrappers as an API response, ready to be ingested into the scrapper’s database.” Pretty sure they mean scrapers, but I’m not going to argue with ZDNet.
Washington Post: Chinese firm harvests social media posts, data of prominent Americans and military. “Biographies and service records of aircraft carrier captains and up-and-coming officers in the U.S. Navy. Real-time tweets originating from overseas U.S. military installations. Profiles and family maps of foreign leaders, including their relatives and children. Records of social media chatter among China watchers in Washington. Those digital crumbs, along with millions of other scraps of social media and online data, have been systematically collected since 2017 by a small Chinese company called Shenzhen Zhenhua Data Technology for the stated purpose of providing intelligence to Chinese military, government and commercial clients, according to a copy of the database that was left unsecured on the Internet and retrieved by an Australian cybersecurity consultancy.”
Techdirt: Clearview Hires Prominent First Amendment Lawyer To Argue For Its Right To Sell Scraped Data To Cops
Techdirt: Clearview Hires Prominent First Amendment Lawyer To Argue For Its Right To Sell Scraped Data To Cops. “Clearview — the facial recognition company selling law enforcement agencies (and others) access to billions of photos and personal info scraped from the web — is facing lawsuits over its business model, which appears to violate some states’ data privacy laws. It’s also been hit with cease-and-desist requests from a number of companies whose data has been scraped…. Now, the company appears to be going on the offensive.”
CNET: Facebook sues developer over alleged data scraping abuse. “The social network announced on Thursday that it was filing a lawsuit against Mohammad Zaghar and his website, Massroot8, claiming that the service was grabbing Facebook users’ data without permission. The lawsuit filed in the northern district of California alleged that Zaghar’s website offered its customers the ability to scrape data from their Facebook friends — including their phone numbers, gender, date of birth and email addresses.”
Towards Data Science: How to Scrape Google Shopping Prices with Web Data Extraction. “Google Shopping is a good start to market your online business and convert more sales. However, if you’re a newcomer, it is essential to watch and learn how your competitors brand and market their products from Google Shopping by using a web data extraction tool (web scraping tool).”
Digital Inspiration: How to Scrape Reddit with Google Scripts. “Here’s Google script that will help you download all the user posts from any subreddit on Reddit to a Google Sheet. And because we are using pushshift.io instead of the official Reddit API, we are no longer capped to the first 1000 posts. It will download everything that’s every posted on a subreddit.”