ZDNet: Want to analyse your tweets? How to import Twitter JSON data exports into Excel. “It used to be easy to analyze your Twitter data: you’d go to your settings and ask for a download, and there among all the files would be a CSV file full of your tweets and the associated metadata. You could then load the CSV into Excel, convert it into a table, and save the resulting workbook. Once it was all in hand you were able to apply filters, searches, and, well, whatever analytical techniques you liked. But things have changed at Twitter, and if you request a download of your data it comes as a set of JSON files.”
My Reddit filter tipped me to this new database of black metal music lyrics. From the GitHub page: “Database of Black Metal lyrics in .JSON format to be used for computer-assisted lyric analysis projects, collected from https://lyrics.fandom.com with additional metadata from https://www.metal-archives.com/ for my sociological bachelor thesis on Ideology and Black Metal.” There are over 11,000 songs in this collection.
How-To Geek: How to Scrape a List of Topics from a Subreddit Using Bash. “Reddit offers JSON feeds for each subreddit. Here’s how to create a Bash script that downloads and parses a list of posts from any subreddit you like. This is just one thing you can do with Reddit’s JSON feeds.”
From a gentleman named Simon Willison, and this looks delicious: Datasette Publish: a web app for publishing CSV files as an online database. “I’ve just released Datasette Publish, a web tool for turning one or more CSV files into an online database with a JSON API. Here’s a demo application I built using Datasette Publish, showing Californian campaign finance data using CSV files released by the California Civic Data Coalition. And here’s an animated screencast showing exactly how I built it…” Are there are enough hours in the day? Find out in our next episode, THERE ARE NOT ENOUGH HOURS IN THE DAY.
Archives.gov has a new read/write API. “The dataset for our catalog API contains all archival descriptions, authority records, digitized records (the images, videos, and so on) and their file metadata, all NARA web pages, and public contributions (tags, transcriptions, and comments). The API will allow developers to retrieve all of this metadata in specified formats (JSON or XML) for any given record or search results set.” A read API is pretty great, but wow, a read-write API?