Technical SEO & Crawlers - Page 2
48 articles
How Soft 404s Triggered a 90% media traffic Crash After Migration
A major media group lost nearly all its organic traffic after a domain migration. Fixing soft 404 errors and indexing issues restored visibility across 13 country sites. The recovery offers key lessons for publishers facing similar SEO challenges.
Cloudflare Sets 2026 Deadline for AI Crawlers to Split From Search
AI companies face new rules on web crawling. Cloudflare will block mixed-use bots from ad pages by default in 2026. Publishers may gain more control and revenue from AI training access.
Chrome Extension Adds Full Metrics to Google AI Overviews
A new Chrome tool lets SEO professionals see complete performance data directly in Google Search Console’s AI Overviews report. No more switching tabs or exporting CSVs. The extension overlays key metrics for faster analysis.
Time and The Economist Build AI-Optimized Webpages for Agentic Search
Major publishers are redesigning parts of their websites for AI agents. New formats aim to keep content visible as AI-driven search grows. Time and The Economist are among those testing agent-friendly site versions.
How ChatGPT Deep Research Actually Reads Your Website
AI-driven site analysis is changing how content is discovered and ranked. Peec AI reveals the step-by-step process behind ChatGPT Deep Research’s approach. Learn what your server logs really show about its behavior.
Beehiiv and Cloudflare Give Newsletter Creators Direct AI Crawler Controls
Independent newsletter publishers can now manage which AI crawlers access their content. Beehiiv’s new integration with Cloudflare brings advanced crawl controls to creators. This move levels the playing field with larger news organizations.
Google’s John Mueller Warns: iFrame Embeds May Harm SEO Rankings
Embedding your site’s content in iframes on other domains could impact search rankings. Google’s John Mueller advises webmasters to block such embeds for better SEO. Learn which security headers matter most.
SEO Experts Highlight Key Habits and Mindset Shifts for 2026
Industry leaders share actionable SEO strategies for consistent results. Learn how to address uncertainty, adapt to new tools, and rethink your approach. Discover what’s driving change in search today.
Google Search Central Live Milan Reveals New AI Reporting Tools
A major update to Google Search Console introduces AI-specific metrics. Site owners can now track clicks and impressions tied to AI features. Experts also debunked common SEO myths at the Milan event.
Google Updates Site Move Guide: Address Change Tool Now Required for All Subdomains
Site owners migrating to a new domain must now submit address change requests for every subdomain, including both www and non-www versions. Google’s updated guidance aims to prevent indexing issues during domain moves.
Le Monde Faces New Challenge as Paying Readers Use AI Agents
Le Monde is rethinking how to serve subscribers who access articles through AI agents. The publisher blocks most bots, but now must adapt as paying readers arrive via new technology.
Google Says US-Specific Folders Offer No SEO Advantage
Site owners managing international content face a key decision. Google’s John Mueller confirms US-specific folders do not impact SEO. Folder choice may help analytics, but rankings remain unchanged. Learn what matters for multinational sites.
Google Confirms LLMS.txt Files Have No Impact on Search Rankings
AI-related files like LLMS.txt won’t affect your site’s visibility. Google updated its guidance to clarify these files are ignored in Search. No need to create special AI files for ranking. Here’s what changed.
Google Clarifies Stance on LLMS.txt Files in Search Rankings
Google has updated its GEO guide to address LLMS.txt files. The company confirms these files do not impact search visibility. Learn what this means for publishers managing AI-related directives.
Google Hints at New Search Console Feature With Mysterious Help Page
A blank help document briefly appeared in Google Search Console, hinting at a possible new tool or report. The page, titled Platform property tooltips, was quickly removed after inquiries. Details remain unknown.
How Google Gemini, ChatGPT and Claude Handle Source Attribution
AI platforms cite sources differently, impacting transparency for users. The number of references can change with each query. Understanding these differences is key for publishers and SEOs.
Gemini Outage Leaves Google Search and AI Features Unscathed
A major Gemini outage did not disrupt Google Search or its AI-powered features. Company leaders confirmed no impact on AI Mode or AI Overviews. Users saw no interruption in search results.
Reuters and Time Clamp Down on AI Bots With Strict Whitelists
Reuters and Time are taking a hard line against AI-powered bots, blocking them by default and only allowing select crawlers through carefully managed whitelists.
New York Bans Stealth AI Crawlers From Accessing Local News Sites
New York has passed a law targeting AI bots that secretly scrape news sites. The legislation aims to protect publishers from hidden crawlers. Media leaders say it will help defend original journalism.
Schema.org Now Displays Real-Time Usage Stats for Every Schema Type
Schema.org has introduced monthly usage statistics for each schema type, letting users see which structured data formats are most widely adopted across millions of domains.
Page 2 by 3