Google Bard UI on a phone screen
  • Large Language Models trained on vast amounts of data scrapped from the internet to generate human-like responses.
  • Website publishers previously had no way to opt out of their data being used to train AI models.

Website publishers can now easily opt out of Google Bard or any other future AI models Google makes from using their data for training.

Google announced on Thursday (Sept. 28) it’s giving a way to opt out by disallowing “User-Agent: Google-Extended” in the site’s robots.txt document.

The new tool will allow sites to continue to get scrapped and indexed by crawlers like the Googlebot as the only use case for the data.

This follows a similar move by OpenAI, the creator of ChatGPT, launching a web crawler of its own recently, with instructions on how to block it.

Many sites have already moved to block the web crawler released by OpenAI. Notable among them being Medium, CNN, Reuters and the New York Times.

Leave a Reply

Your email address will not be published. Required fields are marked *

You May Also Like

TausiApp Links Freelance Beauticians to Clients in Kenya

Meet TausiApp, the Kenyan startup changing the beauty game by connecting freelance…

Tech Industry Layoffs and Interconnected Impact:

The tech industry undergoes constant change, marked by recurring waves of layoffs.…

Trends, growth, and market Segmentation in Europe’s fintech scene 

In a recent market report titled “Europe Fintech Market Report 2023-2028,” IMARC…

Every Apple product getting USB-C connector

Apple held its annual product launch event Tuesday, September 12th , at…