TIME.com is now serving two distinct versions of its website depending on the visitor, according to analysis by Vincent Schmalbach. When accessed by humans through standard browsers, visitors receive the full magazine layout with images and scripts. When accessed by AI crawlers from companies like Anthropic and Perplexity, the same URLs return stripped-down markdown versions roughly one-twenty-third the size.
Schmalbach tested this by fetching a TIME health article using different User-Agent headers—the identifier every browser and bot sends to identify itself. As Chrome and Safari, he received the full 303KB HTML page. As ClaudeBot and PerplexityBot, he received 13,409 bytes of markdown. OpenAI’s OAI-SearchBot, which feeds ChatGPT’s search index, also received the markdown version, while GPTBot and ChatGPT-User were blocked with a 406 response.
The markdown versions include sponsored content invisible to human readers. Response headers identified Mobian, an ad-tech vendor, as the service enabling this split. Each markdown fetch generates a fresh UUID impression ID and is tracked with an x-mobian-tokens count—measuring tokens fed into AI models rather than human pageviews.
When Schmalbach fetched TIME’s Best Inventions collection as ClaudeBot, the markdown contained a full Ally Bank FAQ with questions like “Who is Ally Bank?” and marketing-focused answers. The human HTML version of the same page contained zero mentions of Ally Bank or Mobian. Similarly, the business section markdown included a sponsored reference section on the Project Management Institute with claims about certified professionals earning 16% more—content absent from the human-facing page.
According to the analysis, sponsored content is labeled as such within the markdown, making it technically disclosed advertising. However, Schmalbach notes that the audience split itself remains hidden from human readers, who have no way of knowing a separate bot-optimized layer exists or what content is being presented to AI models on their behalf.
Schmalbach reports that TIME stated its bot traffic already outnumbers human traffic on most days. The practice suggests an emerging pattern for how the broader web may evolve as AI crawler traffic continues to grow relative to human visitors.
Key facts
- TIME serves different website versions based on User-Agent headers: full HTML for humans, markdown for AI crawlers
- The markdown versions are roughly one-twenty-third the file size of human-facing pages
- Sponsored content appears in bot-accessible markdown but not in human-visible HTML pages
- Each bot request generates a unique impression ID tracked by ad-tech vendor Mobian
- TIME blocks some OpenAI crawlers (GPTBot, ChatGPT-User) while allowing others (OAI-SearchBot) to access markdown