Graphic by Sam Papavasiliou

Artificial Intelligence Generates Real Jokes on Twitter

Creators say we shouldn't worry about being replaced yet
Translate

Creators say we shouldn’t worry about being replaced yet

There is a new breed of bot accounts coming to Twitter, but these aren’t put there by Russia or the CIA or whoever else is trying to influence an election. They’re novelty accounts, posting large quantities of tweets that mimic the style of existing users.

Twitter user @kingdomakrillic runs one of these accounts. He asked to only be referenced by his Twitter account. His parody account, @dril_gpt2, sends out a new tweet in the style of @dril several times a day. @dril is a somewhat mysterious, absurdist comedy account that posts their jokes from behind the pseudo-anonymity of a profile image of an incredibly blurry Jack Nicholson. @kingdomakrillic explains their reasoning for choosing @dril to imitate.

“I wanted to do a GPT-2 bot of someone who was both famous and whose voice on Twitter was near-exclusively comedic,” he says. “If I did, say, a Trump bot, the only humor would come from the novelty of a bot generating Trump-like tweets.”

These imitation @dril tweets can be shockingly on-brand yet original at times. It’s not uncommon to see replies wondering if the tweets from the account are still created by a bot.

@kingdomakrillic assures me the tweets are bot-written but hand-selected.

“Curating the tweets is like DJing. I pace the content out, placing tweets I’m sure are funny next to ones I’m more uncertain about,” @kingdomakrillic says. “Sometimes I screw up. It’s a skill, not 1/10th of the skill that goes into actually writing tweets like dril’s, but it’s still something I need to improve on. There’s no excuse to post duds when you can output infinite text.”

That infinite text doesn’t come from nowhere. It comes from GPT-2, a language model created by OpenAI, a research group with a focus on machine learning.

Sherrene Bogle is a computer science professor at HSU with experience using machine learning. Conceptually, teaching an algorithm how to do something is a lot like teaching a person. Bogle uses the example of teaching an algorithm to recognize whether a bird is in the foreground or the background of an image. First the algorithm is given a set of bird pictures that are already labeled as to whether the bird is in the foreground or background, allowing it to figure out the differences. Then it’s given unlabeled bird images, where it looks for those same differences. The difference between a human in a machine doing this task is that the machine doesn’t actually understand what it’s doing. The machine simply recognizes patterns.

Instead of looking for where birds are in pictures, GPT-2 looks for patterns in text. It’s job is to predict not just the next word, but the next couple paragraphs. GPT-2 is so good at this task that it can make paragraphs of human-readable text after being given only a handful of words. The output text can be about anything, but in order to generate text that mimics the style of a Twitter user, programmers need to retrain the model.

“The potential for harm is less than current human bad actors.”

Max woolf

@kingdomakrilic says he retrained GPT-2 on 9,500 tweets, totaling about 750 kilobytes. This focuses the original GPT-2 training data, consisting of almost 40 gigabytes of data, to accomplish a more simple task. The more simple a task, the better an AI can imitate it. Imitating tweets is simple, and with GPT-2’s vast capabilities, imitation yields good results.

There is also @kingdomakrilic’s curation, which gives many of his followers the impression that the AI is better than it really is.

Max Woolf is a data scientist at BuzzFeed, and the person responsible for making these twitter bots so easy to create. He built a tool, called GPT-2 Simple, to easily retrain GPT-2 with any new data—tweets—and wrote an accompanying tutorial. Some people think AI is a threat to humanity, but Woolf says otherwise.

“The potential for harm is less than current human bad actors,” Woolf says.

@kingdomakrilic agrees with this sentiment.

“Some people get freaked out at the fact that GPT-2 can produce sentences that have humanlike coherence, but are made with no meaning or intent on the bot’s part besides to imitate how humans write,” he says. “Markov chains, Madlibs, autocompletors, esquisite corpses—they’re also capable of creating coherent text with the illusion of intent. They’re just not mysterious black box programs like GPT-2.”

Share This Post

Share on facebook
Share on twitter
Share on email
Share on reddit

More Stories

John Craigie merges folk with humor at the Van Duzer Theatre

by Brad Butterfield John Craigie blended comedic anecdotes with folk music, creating a one-of-a-kind show on March 1 at the Van Duzer Theatre. Describing himself as ‘the love child of John Prine and Mitch Hedberg with a vagabond troubadour edge,’

Women’s volleyball club is being formed at Cal Poly Humboldt

by Jake Knoeller and Dezmond Remington For the first time, a women’s club volleyball team is being formed at Cal Poly Humboldt. The idea was brought up when a large number of women were consistently attending the men’s practices, including

Authors’ Celebration brings writers together

by Dezmond Remington Writers are famously loners, depicted in media as squirreled away in some dark cabin deep in the woods or confined to a cockroach-infested apartment. At the bare minimum, they’re often regarded as imprisoned in their own minds,

4 Comments

  1. wolfgangsterling wolfgangsterling Sunday, February 16, 2020

    Seems Like a Waste of Time and Effort… Years AGO, We were Solving Data Mysteries For the Betterment of Man… now we have DEVOlved to Absurdist Tweets… BUT THE FIRST ONE WAS FUNNY! …anyway… I Got a BSCIS From HSU in 2005 and That Allowed me to get a Great Government Job… at DHHS in Eureka… and I Rode That Horse Until Retirement… Great Teachers: Anne Bourroughs, David and Sharon Tuttle, Hal Campbell, Dr, Guy Alain Amoussou, Chip Dixon and Scott Burgess… THANK YOU!

    • aaaaa aaaaa Thursday, February 11, 2021

      Was proper capitalization not part of the curriculum?

  2. Дмитрий Горецкий Дмитрий Горецкий Thursday, February 20, 2020

    Mate, entertainment is what drives progress, makes it noticeable to us unwashed masses. kingdomakrillic is doing a good job displaying the progress and achievements of those robot model-things

Leave a Reply

%d bloggers like this: