Yoast SEO 21.5: Helping you block AI bots in Premium

We are pleased to announce Yoast SEO 21.5, packed with valuable features to elevate your optimization efforts. This release introduces a highly requested option allowing you to block AI web crawlers. Now, you can effortlessly control access to your content and ensure it remains where you want it to be.

Blocking bots used to train AI systems (Premium)

Having the option to block an AI from accessing your content with a web crawler is essential. It helps prevent unauthorized scraping, protect your intellectual property, maintain data privacy, and control your valuable content.

Yoast SEO Premium now introduces a user-friendly feature that simplifies the process in response to the increasing demand for controlling AI robots. With a simple toggle switch, you can effortlessly block AI robots like GPTBot, CCBot, and Google-Extended.

This automated functionality seamlessly integrates with the robots.txt file by automatically adding the necessary lines to disallow access for these crawlers. This solution helps you efficiently protect your content from AI bots without the hassle of manual configuration or intricate technical adjustments.

Think before you do

It is essential to note that blocking or allowing AI bots remains a matter of free choice for each site owner. Every website is unique, with its specific considerations, objectives, and content requirements. Consequently, the decision to block or allow AI bots is one that you must carefully make for your websites.

By providing the flexibility to choose, Yoast SEO lets you personalize your approach and make decisions that align with their needs and preferences. This ensures each site can optimize its content protection and crawler access settings to suit its distinct circumstances.

Please read our article on whether or not to block AI bots from accessing your content.

There’s more

But that’s not all! This update also includes regular enhancements, improvements, and fixes. We have fine-tuned various aspects of our product to provide a smoother, more seamless experience.

Word complexity improvements

We’ve improved various language tools that will assist you in crafting compelling web content. Our enhanced language tools aim to empower you to write better, more engaging content that captivates your readers and strengthens your online presence.

The first one we’ve improved is the word complexity assessment. In this release, we’ve expanded the list of frequently used words in the English language to make the assessment pick up more difficult words.

Inclusive language enhancements

Yoast SEO 21.5 features significant enhancements to the inclusive language analysis. Now, you can ensure your content is optimized for search engines and fosters inclusivity. In this release, we’ve updated the word lists, improved the feedback for specific terms, and fine-tuned the traffic light. Embrace the power of inclusive language and create a more inclusive online space for all.

Changes in handling RSS feeds

We’ve changed how we handle RSS feeds in Yoast SEO 21.5. In the past, we automatically added a nofollow the RSS feeds in WordPress, but we’re changing that today. We have removed the nofollow attribute from RSS feeds.

This change means that search engine crawlers can now freely index and follow the links in your RSS feeds. By removing the nofollow attribute, your content has a higher chance of being discovered by search engines, which might lead to increased visibility.

Updates to attachment page in WordPress 6.4

WordPress 6.4 introduces the wp_attachment_pages_enabled option. You can now control the behavior of attachment pages by enabling or disabling them based on your needs. This offers greater flexibility and allows for a more focused website experience. In Yoast SEO 21.5, we support it, reducing the chances of inconsistencies with our "Enable media pages" setting.

Yoast Local SEO 15.1

We are also updating our Yoast Local SEO plugin to version 15.1! This update includes bug fixes and improvements to enhance your local search optimization experience. Our team has worked hard to address issues and ensure a smooth and efficient user experience. We understand the importance of local SEO for your business, and this update aims to provide a more stable and reliable solution for optimizing your website for local search.

Update now to Yoast SEO 21.5

At Yoast, we are committed to providing you with the best SEO tools and features to help you achieve your goals. Whether you are a seasoned professional or new to the field, we’ve designed our products to cater to your unique needs and help you reach your goals.

Upgrade today to take advantage of the latest features. This includes blocking AI robots, regular updates, and fixes. Plus, you’ll leverage our improved language tools to enhance your content creation process.

Happy optimizing!