Transformers, Explained: Understand the Model Behind GPT-3, BERT, and T5 (Dale Markowitz)

Dale Markowitz: Transformers, Explained: Understand the Model Behind GPT-3, BERT, and T5. “Transformers are models that can be designed to translate text, write poems and op eds, and even generate computer code. In fact, lots of the amazing research I write about on daleonai.com is built on Transformers, like AlphaFold 2, the model that predicts the structures of proteins from their genetic sequences, as well as powerful natural language processing (NLP) models like GPT-3, BERT, T5, Switch, Meena, and others. You might say they’re more than meets the… ugh, forget it. If you want to stay hip in machine learning and especially NLP, you have to know at least a bit about Transformers. So in this post, we’ll talk about what they are, how they work, and why they’ve been so impactful.”

How-To Geek: What Is Compositing in Photography?

How-To Geek: What Is Compositing in Photography?. “Compositing is a photographic technique where multiple individual photographs (and sometimes digital effects as well) are combined into a single final image. It’s an incredibly popular technique in advertizing, editorial, fashion, fine art, landscape, and lots of other genres of photography. Let’s look at why.” This one is included for me. A good thorough explainer.

A Nobel Prize and a horse dewormer: Explaining the controversy over ivermectin and COVID-19 (PolitiFact)

PolitiFact: A Nobel Prize and a horse dewormer: Explaining the controversy over ivermectin and COVID-19. “Even as prescriptions for ivermectin have risen 24-fold since before the pandemic, and some people have resorted to pressuring hospitals to use it on COVID-19 patients, public health authorities strongly recommend against using ivermectin for COVID-19. There is no conclusive evidence that it is effective, and it carries physical risks. At the same time, those dubiously touting ivermectin aren’t wrong about the Nobel Prize or the drug’s proven but limited uses for humans. ”

VentureBeat: What are graph database query languages?

VentureBeat: What are graph database query languages?. “Classic relational databases can store graphs, and before graph databases it was common for developers to use them because they were the only option. SQL can answer basic questions, but traditional query languages generally can’t answer the most useful and tantalizing questions. Ironically, perhaps, relational databases are not nearly as good at representing very complex relations as graph databases are. Often, the only solution for a relational database query is to return large blocks of data so the client software can run the analysis.”

Laughing Squid: An Explanation of Medieval Art Memes

Laughing Squid: An Explanation of Medieval Art Memes. “The Archivist at Curious Archive digs into the origins of some of the oddest art images from the Medieval era that have since become popular as modern memes. He notes that while a number of pieces reflected such trends as ‘homunculus’ (‘little man’), the ‘Danse Macabre’ (‘Dance of Death’), and ‘The Vitalis of Milan’, many others were created with a sense of humor, perhaps to make their audience laugh.”

CNET: What is an NFT? Everything to know about the expensive digital tokens taking over cryptocurrency

CNET: What is an NFT? Everything to know about the expensive digital tokens taking over cryptocurrency. “Nonfungible tokens, or NFTs, are a new kind of collectible that could — or could not — earn you big bucks. NFTs began in 2017 and became the new craze faster than any other cryptocurrency you may have heard of. But you can’t keep NFTs in your dresser drawer, like Pokemon cards, a comic book or paintings. They’re entirely digital and are tied to almost anything — a video highlight, a meme or even a tweet. If this doesn’t make much sense to you, well you’re not alone.”

EXPLAINER: What is Apple doing with its App Store? (Chron)

Chron: EXPLAINER: What is Apple doing with its App Store?. “Over the past week or so, Apple has eased some longstanding restrictions that helped make its App Store into a big moneymaker for the company. The company has long required app developers to pay high commissions to Apple on the sales of paid apps as well as purchases of subscriptions or digital items inside their apps…. But Apple hasn’t always explained its moves very clearly, leaving some iPhone users with unanswered questions as to what exactly Apple is doing and whether and how they’ll be affected.”

NiemanLab: The New York Times is using Instagram slides and Twitter cards to make stories more digestible

NiemanLab: The New York Times is using Instagram slides and Twitter cards to make stories more digestible . “Last summer, Vox’s Terry Nguyễn wrote about the ways that our Instagram feeds had changed in the wake of the Black Lives Matters movement. We started to see more PowerPoint-looking slides that were made to communicate information about the protests, and they’ve since been co-opted for just about every subject…. But slides like these, when done right and with care, make complex stories (about, say, a mutating virus!) more digestible and accessible.”

Washington Post: What is an NFT, and how did an artist called Beeple sell one for $69 million at Christie’s?

Washington Post: What is an NFT, and how did an artist called Beeple sell one for $69 million at Christie’s?. “Using the same principles behind cryptocurrencies such as bitcoin, NFTs allow people to claim ownership over specific digital files, be they songs, videos or static images. Beeple, whose real name is Mike Winkelmann, is the latest beneficiary of a rush into NFTs that’s a side effect of the fast-growing interest in digital currencies and the technology behind them.”

Techdirt: The Best Summary Of Australia’s News Link Tax / ‘Bargaining Code’ Legal Issues

Techdirt: The Best Summary Of Australia’s News Link Tax / ‘Bargaining Code’ Legal Issues . “The Juice Media, an Australian outfit that is famous for making hilarious ‘Honest Government Ads’, usually for the Australian government (but sometimes for elsewhere) has put out a new ‘ad’ about the link tax in which they explain how it was a fight to take money from one set of giant rich companies, and give it to another set of giant rich companies, and not to do anything useful in between.” Includes several obscenities. Hysterically funny and also enraging.

A beginner’s guide to AI: Ethics in artificial intelligence (TNW Neural)

TNW Neural: A beginner’s guide to AI: Ethics in artificial intelligence. “The most obvious solution for a given problem isn’t always the best solution. For example: it’d be much easier for us to dump all of our trash on our neighbors lawn and let them deal with it. But, for a variety of reasons, it’s probably not the optimal solution. At its core, such an action would be unethical because it forces someone else to assume your burdens in addition to their own. Basically: It’s unethical to pass your garbage along to the next person. And that’s pretty much what we need to focus on when we’re trying to understand ethics in the field of artificial intelligence.”

Covid-19 vaccine basics: Why the rollout is so slow, who can get doses, and what about side effects (STAT News)

STAT News: Covid-19 vaccine basics: Why the rollout is so slow, who can get doses, and what about side effects. “When can we get it? How can we find out? How well will the vaccines work? How close will they get us back to the life we see in TV shows and movies filmed in the before times, when only health workers and trick-or-treaters wore masks and social distancing wasn’t part of anyone’s vernacular. We all have questions; Heck, we’re waiting for our chance to be vaccinated, too. While we wait, we figured we’d try to find some answers to the questions we’re hearing and asking ourselves. Here goes.”