Just note that any organization is quite complex, and surely at different times different people in an organization have different purposes, and they may have different understandings if they share the same purposes. So it is pretty common that everybody's actions, understanding, and purposes are not coordinated.
The purpose of an organization is never simple. From Hebert Simon's <Administrative Behavior>:
> The survival and success of organizations depend on their providing sufficient incentives to their members to secure the contributions that are needed to carry out the organizations' tasks
"The Habit Loop is a neurological loop that governs any habit. The habit loop consists of three elements: a cue, a routine, and a reward. Understanding these elements can help in understanding how to change bad habits or form better ones."
GPTBot — the official crawler of OpenAI, has been announced for nearly 2 months. GPTBot is for crawling web information to improve the models of OpenAI, e.g. GPT-4. We are wondering what the reactions from the Internet are. Is the bot being accepted or rejected?
I suspect not many website operators/developers are aware this exists. Usage of robots.txt is unenforceable and would only show intent to OpenAI. This would not be useful for other LLM's as Google, Bing and other search engines already have decades of ingested data to feed their LLM's.
In my poor armchair quarterback opinion if people wish for something to not be crawled then they must make a best effort to ensure only humans are accessing it with strong authentication, legal agreements, best-effort bot detection and also have binding legal contracts that implement punitive actions for doing something with data it was not approved for and then actually follow through with legal action for breach of contract.
ChatGPT only swallows data or content but bring back no traffic to content creators. Maybe this is how Google is different from ChatGPT. But what will become of Google if the experimental generative AI's answer replace all the SERPs? An closed web where no search engine no AI can actually enter?
