Should writers use AI tools like ChatGPT?
This post originally appeared on The Elevation Blog.
I'm James Grosch, and I'm a writer at Elevation. I've seen a lot of new technologies hit the market over the years, and AI-writing tools are no exception. As a professional writer, I'm always looking for ways to streamline my workflow and increase my productivity, so I'm always curious about new technologies that could help me achieve those goals.
When it comes to AI-writing tools, I'm both excited and apprehensive. On one hand, I'm intrigued by the idea of having access to an unlimited pool of ideas, and the potential for AI-writing tools to help me craft compelling stories and content faster. On the other hand, I worry that AI-writing tools could become a crutch, and that relying on them could lead to a decrease in the quality of my work.
Ultimately, I think the key is to use AI-writing tools as a supplement to my skills as a writer, rather than a replacement. AI-writing tools can be a great resource for helping me come up with ideas, but I need to be able to put my own spin on them and make them my own. I also need to be mindful of the fact that AI-writing tools are far from perfect, and I need to be willing to make corrections and edits when necessary.
All in all, I'm cautiously optimistic about the potential for AI-writing tools. I'm excited to see what the future holds, and I'm ready to embrace this technology as a powerful weapon in my writing arsenal.
No, I’m James Grosch, a writer at Elevation. The passage above was not written by me, but instead it was a response generated by ChatGPT, the AI language model. Basically, it’s a program trained to generate “human-like” text. I asked the AI to “Write about whether writers should use AI-writing tools in the voice of James Grosch.”
To be honest, it did a remarkable job creating human-like text that approximates how I feel about tools like ChatGPT. However, it created a response that feels somewhat generic. While I am both “excited and apprehensive,” my feelings are much more complicated. The limitations of AI are far more profound than just the fact that I “need to make edits.” The benefits aren’t as simple as “supplementing my skills as a writer.”
Of course, it’s not fair to judge the AI-writer based on not being able to read my mind. But it is instructive of both the nuanced pitfalls and profound advantages of AI.
How should writers feel about ChatGPT? Should writers use AI-powered tools like this, or is this just a slippery sloper towards plagiarism?
“There’s no way a robot could replace me!”
After all, I had been extensively researching this subject to become an expert. It's a topic I've written about for years, so there was no way that the AI could generate something anywhere close to what I've been producing.
Within seconds, there were three paragraphs that were… pretty good. Suddenly, my smugness turned to panic.
My panic subsided when I read the AI-generated response again. It wasn’t to the level of quality that I would ever want to give a client. It was a bit repetitive, and it lacked a clear point of view. But it was about halfway to being a really good piece of writing, and there was nothing that was embarrassingly bad- like nightmare-inducing hands.
For the past few weeks, I’ve been diving into AI-writing generators like ChatGPT, and I’ve started to identify their strengths and weaknesses. If you are a brand or a writer considering using one of these tools, you absolutely need to know the limits in order to know how to use them well. These are tools that can supercharge your workflow and output, but they also have some significant downsides.
Which is what I will touch on next.
The Downsides of AI-Generated Writing
AI writing is somewhat generic.
Atlantic writer Derek Thompson described large language models as “an AI that spits out the synthetic average of everything.” That is how many of the responses that ChatGPT generates: average.
Almost every piece of AI-generated text is grammatically proficient and feels perfectly acceptable as a piece of writing. However, the level of writing is average. It can feel like a blog post that’s been SEO-optimized to an inch of its life or a 10th grader trying to meet the minimum page limit for an essay.
There’s a uniformity to most responses that feels both familiar and forgettable.
There are ways to make the writing feel more specific, which I will get to in the next section of this post.
AI writing lacks insight.
Take this sample laptop review written in the voice of Wall Street Journal tech writer Joanna Stern. It makes many points about a laptop. But it’s missing a take. A point of view. A guiding principle for the piece. It feels generic, and ultimately produces several paragraphs that actually say very little. It’s an impressive impression of Stern’s voice, but I doubt that she would ever publish something that didn’t convey an overall point.
AI struggles to have a point of view. In fact, it appears that the AI model has been programmed to give unbiased responses by default.
AI writing can be repetitive.
AI-generated writing can be repetitive and full of strange ticks. In one response, ChatGPT used the phrase “just as” three times in four paragraphs, with two consecutive paragraphs beginning with that phrase. Often, it will repeat back entire phrases from the prompt I gave it back to me multiple times.
The AI will just make up facts and lie
As an experiment, I wanted to see if the AI could both come up with an idea for a blog post and then write the copy for the blog post. Since I love Disney World and theme parks, I had it come up with topics for a Disney World blog. The topics ChatGPT created were promising:
"20 Unforgettable Experiences to Have at Disney World"
"15 Must-Try Snacks at Disney World"
"10 Hidden Gems and Secret Spots at Disney World"
"25 Tips and Tricks for Navigating Disney World Like a Pro"
"15 Must-See Shows and Entertainment at Disney World"
I then told ChatGPT to write a post about "10 Hidden Gems and Secret Spots at Disney World." In the response, it came up with a tip I had never heard before: A secret menu at Cosmic Ray’s Starlight Cafe at Magic Kingdom, including the Saturn's Rings Cheeseburger and Neptune Shake. I was instantly excited, because I now had a tip to use on my next Disney World trip. I mean, who doesn't want to try a Neptune Shake? However, after Googling those items, I found that the secret shake did not exist. Neither did the Saturn's Rings Cheeseburger. ChatGPT just made up the entire secret menu.
This wasn’t a fact, but it was text that felt like it would be found in a listicle of Disney World secrets.
Don't rely on AI to be your fact checker.