HypothesisRecorded 2026-10-28, re-check by 2026-12-28
Hypothesis: a short page that answers one question at the top gets cited by AI apps as often as a long page.
- Basis
- Two external studies of ChatGPT citations that disagree (AirOps with Kevin Indig; SE Ranking). We have no measurement of our own yet.
- Does not prove
- Both studies are correlations on English pages, ChatGPT only, and cannot separate length from domain authority or search ranking. One found longer pages got more citations (5.1 vs 3.2). English word counts do not map to Japanese characters. Claude, Gemini, DeepSeek and Japanese questions are untested.
What a site owner can doNothing yet: this is a hypothesis.
Our lab measurementRecorded 2026-10-24, re-check by 2027-01-24
Asked in Japanese 'how do AI apps see my site?', four AI apps read the site in 27 of 32 tests (2026-10-24), yet 26 of 32 answers named an outside tool or URL; only 1 named a dedicated AI-check tool.
- Basis
- 40 test questions we asked ChatGPT, Gemini, Claude and DeepSeek in Japanese on 2026-10-24, scored by rules fixed before the tests.
- Does not prove
- Most named 'tools or URLs' were source links or advice to ask an AI app yourself; without those, the result fails for 3 of 4 apps. One run per app, eight questions each, graded by an agent, not re-read by a person. Our sites have llms.txt; most sites do not.
- Sources
- our own data, no outside link
What a site owner can doAsk ChatGPT, Gemini, Claude and DeepSeek in Japanese how AI sees your site, and record which tools and URLs each answer names. Repeat on another day before acting, since one run per app is thin.
Our lab measurementRecorded 2026-10-28, re-check by 2027-01-31
For 27 of 30 PR TIMES press releases by small and mid-size Japanese companies (published 2026-09-15 to 2026-09-30), ChatGPT or Gemini repeated at least one number or name from the release when asked about the product in late October 2026.
- Basis
- 120 test questions to ChatGPT and Gemini in Japanese temporary chats, scored by rules fixed in advance; plus a before/after recheck on our M-Meeting.
- Does not prove
- Not whether repeated facts were correct, nor whether they came from PR TIMES or the company site. One run per question, one day, two apps. Two weeks after we fixed the official M-Meeting page, Claude and DeepSeek still repeated an old 'only 4 languages' claim.
- Sources
- our own data, no outside link
What a site owner can doPut the exact numbers and names you want repeated (price, specs, dates) in your press releases. When a fact changes, correct the release itself, not only your own site.
External sourceRecorded 2026-11-05, re-check by 2027-02-05
Ahrefs (published 2026-11-04) tracked the same questions daily for 20 days on five AI services: 50–83% of sites cited one day were gone the next, about 75% came back within 20 days, and 'best X' answers changed about 75% daily.
- Basis
- An Ahrefs blog study tracking about 37,500 citations over 20 days, published 2026-11-04, read 2026-11-05.
- Does not prove
- Ahrefs sells a citation-tracking tool. There is no Japanese slice or Japanese questions; Perplexity and Claude are not covered; the part we read gives no detailed method.
What a site owner can doDo not judge AI visibility from one check. Ask the same question daily and count on how many of the last 7 days your site was cited; expect brand mentions to be steadier than links.
Our lab observationRecorded 2026-10-29, re-check by 2026-11-05
On 2026-10-28, six minutes after we submitted pw.migurei.ai to the AI PICKS tool directory, a client in Tokyo checked our site for 81 seconds with five user agents, reading company, pricing and contact pages and llms.txt: a site check, not a human visitor.
- Basis
- Our own server logs on pw.migurei.ai for 2026-10-28, plus searches in two agent search indexes the same day.
- Does not prove
- Any client can set a referrer, and we did not match the IP to AI PICKS; the link to our submission is inferred from timing and their screenshot practice. Not finding a listing page hours later does not mean none exists.
What a site owner can doAfter submitting your site to a directory, expect a quick automated check of company, pricing and contact pages; make sure they load for any user agent. Do not count such hits as referral traffic.
External sourceRecorded 2026-10-28, re-check by 2027-01-28
Since 2026-10-20 Anthropic's bot IP list no longer includes two small ranges that Claude-User still came from in late October 2026; those addresses lie in Anthropic's published outbound range, which is a weaker check than the bot list.
- Basis
- Saved copies of Anthropic's bot IP list (2026-10-11 to 2026-10-27), Anthropic's IP and support pages read 2026-10-28, and our own logs.
- Does not prove
- Anthropic's outbound range page does not mention Claude-User. That range is wider, so other Anthropic traffic matches it too, and the user agent is self-declared. We do not know why the two ranges were dropped.
What a site owner can doWhen verifying Claude-User, check the bot IP list first. If an IP fails it but falls in Anthropic's published outbound range, label it 'published range', neither 'verified' nor 'fake'.
External sourceRecorded 2026-10-24, re-check by 2027-04-24
RFC 9727 (Standards Track, June 2025) defines /.well-known/api-catalog, a file listing a publisher's APIs in Linkset JSON format, each pointing to a machine-readable description such as OpenAPI and to human documentation.
- Basis
- The RFC 9727 text, read 2026-10-24; plus our logs showing a free agent-readiness checker requesting this path on our site.
- Does not prove
- We have no evidence that real AI agents read /.well-known/api-catalog; so far only a checker tool has requested it.
What a site owner can doIf your site has a public API, publish /.well-known/api-catalog as application/linkset+json, linking to each API's OpenAPI file and documentation. If you have no public API, skip it.
Our lab observationRecorded 2026-10-14, re-check by 2026-11-07
When we pasted one of our pages into an AI app and asked about a fact on another page, the first answer rarely cited the right page (2026-10-10: Claude 3/20, Gemini 2/20, DeepSeek 1/20). Asked which page, Claude and DeepSeek named it 20/20.
- Basis
- Test questions we asked Claude, Gemini and DeepSeek on 2026-10-10, 20 per app; an earlier test, 2026-10-05 to 2026-10-06, for ChatGPT.
- Does not prove
- One test round, 20 questions per app. The follow-up question was leading, so 20/20 may come from the hint. We do not know yet whether apps copy a URL written as visible text more often than a link.
- Sources
- our own data, no outside link
What a site owner can doCheap test: next to each key fact, write the URL of the page that holds it as visible text (for example 「料金:https://pw.migurei.ai/pricing」), not only as a link behind words. Then check whether answers start citing that page.
External sourceRecorded 2026-10-13, re-check by 2027-01-13
Vendors already sell before/after measurement and daily AI-visibility monitoring with alerts, and SearchPilot sells controlled page-group tests for large sites; as of 2026-10-13 we found none that matches each real AI-app question to bot requests in the site's own logs.
- Basis
- Vendor pages (SearchPilot, LLM Pulse, LLM Insight, AthenaHQ, Cloudflare and others) and a web search in English and Japanese, all on 2026-10-13.
- Does not prove
- Not found after one day of web search does not mean nobody does it; vendors may not write it down. Features are vendor claims. That page-group tests do not suit small sites is our inference. Our own matching so far works only for questions that name the site or paste its URL.
What a site owner can doBefore buying an AI-visibility tool, ask what it measures: human visits from AI apps, answer snapshots, or bot requests in your own logs. If your site has few pages, do not expect page-group split tests to work.
External sourceRecorded 2026-11-01, re-check by 2027-01-15
On 2026-10-30 Bing announced a per-page directive to stop pages grounding AI answers (Copilot, Bing AI Mode, Microsoft 365), honoured from 2027-02-01; sites relying on noarchive or nocache must switch by 2027-03-01, or grounding is allowed by default.
- Basis
- Bing Search blog post of 2026-10-30, read 2026-11-01 through an automated page summary.
- Does not prove
- We read a machine summary, not the verbatim page; reread it before acting on exact syntax. Bing says it will do this; it is not in force yet. A tag on the home page does not show the setting of the whole site.
What a site owner can doIf you use noarchive or nocache to keep pages out of Bing's AI answers, add <meta name="Bingbot" content="ai-grounding:disallow"> or the matching X-Robots-Tag header, and record the setting in Bing Webmaster Tools before 2027-03-01.
External sourceRecorded 2026-10-21, re-check by 2027-01-21
Bing Webmaster Tools lets you set Bingbot's crawl rate for each hour of the day (Crawl Control); Bing calls this input about speed and timing, not a promise to crawl more.
- Basis
- A Bing Webmaster blog post (December 2018) and Microsoft's API reference, read 2026-10-21; our own site's settings read the same day.
- Does not prove
- No Bing document says a higher rate makes Bing crawl new URLs sooner. The 1 to 10 scale with default 5 comes only from secondary sources; Bing's own help page returned 404.
What a site owner can doUse Crawl Control to slow Bingbot during your busy business hours if server load is a problem. Do not raise the rate expecting new pages to be crawled faster.
Our lab observationRecorded 2026-11-01, re-check by 2026-11-14
On 2026-10-29 an article we published on note ranked third on Bing page 1 for an exact Japanese statistics question, our only page among 8 queries checked; by 2026-11-05 it had dropped off page 1.
- Basis
- One-off readings of Bing page 1 from our server, 2026-10-29 and 2026-11-05, plus test questions we asked ChatGPT in early November.
- Does not prove
- One reading, one machine, Bing's Vietnamese market; rankings change daily. Bing rank is not what ChatGPT uses; ChatGPT has its own index. The exact query is long and few people type it. We could not tell what caused the drop.
- Sources
- our own data, no outside link
What a site owner can doSearch Bing for your key questions and note which of your pages rank, including articles you post on platforms like note. Recheck over several days before acting, since the ranking changed within a week.
Our lab observationRecorded 2026-10-18, re-check by 2026-11-14
Bing data does not show that migurei.ai pages ChatGPT cited get Bing impressions: by 2026-10-30 the Japanese home page had 3 impressions, only for company-name searches, the English home page 0, and the Parallel World page was unknown to Bing.
- Basis
- Bing Webmaster API and URL Inspection for migurei.ai, read 2026-10-18 and 2026-10-30.
- Does not prove
- Bing figures are weekly samples; 0 may be below a threshold. Page-level data lags: an empty result on 2026-10-18 was later filled in. Impressions are Bing search results, not ChatGPT or Copilot. This neither supports nor refutes that ChatGPT uses Bing.
What a site owner can doDo not read an empty page-level report in Bing Webmaster Tools as zero; recheck one to two weeks later. Do not assume Bing impressions explain why ChatGPT cites or ignores a page.
External sourceRecorded 2026-10-13, re-check by 2027-01-13
The Bing Webmaster API tells you when Bing discovered or crawled a URL, but no per-URL field says whether it is indexed; the URL Inspection tool in the Bing Webmaster web interface does.
- Basis
- Microsoft's API reference read 2026-10-13, and our repeated readings of the API and URL Inspection for our two sites, 2026-10-13 to 2026-11-06.
- Does not prove
- URL Inspection data came through the interface's internal API, which may change. API dates are unreliable: 0001-01-01 does not always mean unknown, and crawl dates can differ from logs. A successful Request indexing only means accepted. Indexed does not mean shown or cited by Copilot.
What a site owner can doTo check indexing, use URL Inspection in Bing Webmaster Tools, or the url: operator on Bing, not the API's crawl dates. If you call the API, space calls about 6 seconds apart to avoid throttling.
External sourceRecorded 2026-10-18, re-check by 2027-01-18
Bluesky lets bots post through the AT Protocol API with an app password (a separate, revocable key), free within 5,000 points per hour and 35,000 per day; bots should self-label as bot and only interact with users who tagged them.
- Basis
- The AT Protocol bot tutorial and handle specification, read 2026-10-18; rate limits from search excerpts and a developer discussion.
- Does not prove
- Nothing about how many Japanese people use Bluesky or whether they click links. We could not load the rate-limit page itself, so the numbers come from excerpts.
What a site owner can doIf you post to Bluesky for your site: use an app password, reuse sessions instead of logging in for each post, add the bot self-label, use your domain as the handle via /.well-known/atproto-did, and never like or reply unless tagged.
External sourceRecorded 2026-10-13, re-check by 2027-01-13
Brave Search's crawler does not announce its own user agent and Brave publishes no IP ranges, so you cannot verify Brave's visits in your logs; Brave also skips any page Googlebot is not allowed to crawl.
- Basis
- Brave's crawler help page, read 2026-10-13, a bot directory (Dark Visitors), a Brave forum post, and our own logs from 2026-10-14.
- Does not prove
- A Bravebot/1.0 user agent did appear in our logs from 2026-10-14, from Hetzner IP addresses, but Brave does not confirm that string, so anyone could send it. Brave does not say whether its crawler uses one user agent or many.
What a site owner can doAllow Googlebot in robots.txt on pages you want in Brave Search. Treat Bravebot lines in your logs as unverified. Check whether Brave has your pages on search.brave.com or through the Brave Search API.
External sourceRecorded 2026-10-13, re-check by 2027-01-13
Brave Search finds new URLs partly through its opt-in Web Discovery Project in the Brave browser, but a URL reaches Brave only after about 20 different participating users have viewed it; one browser opening your page is not enough.
- Basis
- Brave's crawler help page and Brave's open-source browser code, read 2026-10-13.
- Does not prove
- Brave does not say what share of URL discovery comes from this project, or what else its crawler uses (links, sitemaps). The threshold of 20 is read from browser-side code; the server may add conditions. Pages marked noindex are never reported.
What a site owner can doDo not browse your own site with Web Discovery enabled to push it into Brave; one machine gives only 1 of the 20 views needed. Rely on real visitors from many different networks instead.
External sourceRecorded 2026-10-11, re-check by 2027-01-11
OpenAI says ChatGPT Ads launched in Japan on 2026-08-11 for the Free and Go plans; ads appear below the answer, labelled sponsored and kept separate, and OpenAI says ads do not influence answers.
- Basis
- OpenAI announcements and Help Center pages, read 2026-10-11 through archived copies.
- Does not prove
- The labelling and no-influence statements are OpenAI's words, not independently checked. We have not yet seen an ad in our test answers. Launch does not mean every Free account in Japan sees ads. The label wording in the Japanese interface is unknown.
What a site owner can doDo not buy ChatGPT Ads expecting the answer itself to name you; appearing in an ad is not being cited. When you monitor ChatGPT answers, count mentions inside ads separately from mentions in the answer.
External sourceRecorded 2026-10-15, re-check by 2026-11-15
OpenAI says its ChatGPT Atlas browser reads the same ARIA labels and roles that screen readers use to understand page structure, buttons, menus and forms, and advises site owners to add WAI-ARIA roles, labels and states.
- Basis
- OpenAI Help Center publishers FAQ, read 2026-10-15 through a search-engine excerpt; our scan of six Japanese home pages, 2026-10-14.
- Does not prove
- It is about Atlas only, not ChatGPT search or answers. There are no numbers on how often tasks fail when labels are missing. We have not read the page directly yet. In our scan, 4 of 6 Japanese home pages had unlabelled input fields.
What a site owner can doGive every button, menu and form field on key pages a clear label (visible text or aria-label), plus role and state where needed. Run an accessibility checker to find unlabelled inputs.
Our lab observationRecorded 2026-11-03, re-check by 2026-11-17
In one of six ChatGPT answers on 2026-11-02, numbers from two different weeks of our weekly survey appeared under one 'updated 2 November' label: GPTBot 76 (10.6%, current week) beside llms.txt 29 (2.9%, previous week; the current figure was 30).
- Basis
- One blind-graded ChatGPT test answer from 2026-11-02, compared with our published page and our note article. Both carried numbers from both weeks.
- Does not prove
- This is one run out of six. The grader kept the answer as correct because both numbers were on our page. ChatGPT may mix weeks even when every number on a page is clearly dated.
- Sources
- our own data, no outside link
What a site owner can doWhen you update numbers in place, put the date next to each figure in the sentence itself and mark old figures as old. Do this also on copies elsewhere, such as note articles or a repository README.
External sourceRecorded 2026-10-24, re-check by 2026-12-24
ChatGPT admits MCP-based apps (plugins) to a directory shared with Codex after review: a verified organisation submits a package with legal and support URLs, five positive and three negative test cases and a demo video, verifies its domain, and may add Japanese translations.
- Basis
- OpenAI's Apps SDK submission page and plugin guidelines (read 2026-10-24 and 2026-10-27), plus a public third-party app tracker covering the UK and US, with data up to 2026-07-06.
- Does not prove
- A listing does not mean Japanese users find or install the app, because users must install it themselves. Review time, approval rate, and availability in Japan and for free users are unknown. Similar approved apps come from large brands. Our app count used an old third-party copy.
What a site owner can doIf you run a read-only MCP tool, prepare the review package: legal and support URLs, test cases, a demo video, ja-JP text, and a clear statement of what your tool does that ChatGPT cannot do on its own.
Our lab observationRecorded 2026-11-03, re-check by 2026-11-17
For a Japanese question on what share of sites block AI crawlers such as GPTBot, ChatGPT retrieved our note article in only 3 of 12 test runs (a competing survey page in 11 of 12). In all 3 runs where it retrieved our article, it named us.
- Basis
- Test questions we asked free ChatGPT in three rounds, 2026-10-28 to 2026-11-03, and the pages it cited.
- Does not prove
- That ChatGPT picks sources by title: its search queries were not visible. These are 12 runs in one app, and our article changed between rounds. Naming us 3 of 3 times may come from our broad weekly sample, not our wording. A title change could cost a Bing top-3 position.
- Sources
- our own data, no outside link
What a site owner can doIf AI answers name you once they read you but rarely retrieve you, focus on retrieval: make the title state the exact topic of the question, then test again. Watch your Bing ranking when you change the title.
RefutedRecorded 2026-10-31, re-check by 2027-01-31
Refuted in our test: top-1,000 .jp sites that block GPTBot but allow Googlebot were not named less often in ChatGPT search than matched sites that allow it. They were named in 90 of 96 runs, against 91 of 97 (2026-10-28 to 2026-10-31).
- Basis
- Our pre-registered, blind-graded test: 49 matched pairs of sites, natural Japanese industry questions to free ChatGPT, rechecked by a Japanese reader.
- Does not prove
- That blocking is harmless: we only saw no gap. The questions nearly pointed at each site. Small sites, general questions and other apps were not tested. Sites chose to block, and pairs differ in brand strength. Blocking OAI-SearchBot was not tested directly.
- Sources
- our own data, no outside link
What a site owner can doDo not expect that blocking GPTBot (OpenAI's training crawler) alone will remove a well-known site from ChatGPT search answers. If you want to appear in ChatGPT search, make sure robots.txt allows OAI-SearchBot.
Our lab observationRecorded 2026-11-03, re-check by 2026-11-17
Asked in Japanese what share of Japanese sites block AI crawlers, ChatGPT framed all 12 answers we collected (2026-10-28 to 2026-11-03) as 'low overall, high for news media'. It cited pages that give a separate figure for news sites, which our survey did not have.
- Basis
- Test questions we asked free ChatGPT (temporary chat, Japanese IP). We matched words in all answers and read 6 of them by hand.
- Does not prove
- That ChatGPT cites a page because it has a breakdown by sector: this is only a correlation. Counting words is not counting meaning. One app, 12 runs in 7 days. Our sector figures would come from a different sample and could be shown beside others without citing us.
- Sources
- our own data, no outside link
What a site owner can doIf AI answers on your topic split results by segment, publish the same split on your page, from one sample and clearly labelled. Then check whether answers start to cite it.
External sourceRecorded 2026-10-11, re-check by 2027-01-11
On 2026-03-24 OpenAI moved ChatGPT shopping from Instant Checkout to product discovery through merchant feeds (the Agentic Commerce Protocol), letting merchants use their own checkout. As of 2026-10-11, no official source names Japan for either.
- Basis
- Three OpenAI announcements (2025-09-29, 2025-12-08, 2026-03-24), read through Wayback Machine archives on 2026-10-11.
- Does not prove
- No source says Japan is included or excluded. OpenAI does not say Instant Checkout is fully off. 'Organic and unsponsored' results are OpenAI's claim, not checked. The reason for the change comes from press reports. We have not run shopping questions. We read archived copies, not live pages.
What a site owner can doJapanese shops: keep product pages crawlable and your own checkout working, since ChatGPT sends buyers to your site. Wait until OpenAI names Japan before building a product feed for the Agentic Commerce Protocol.
Our lab observationRecorded 2026-11-06, re-check by 2026-11-20
Asked how many Japanese sites use an AI-training token in robots.txt, ChatGPT (3 of 3 runs) said no Japan-wide statistics exist and cited small samples such as 0 of 28. Gemini (3 of 3) gave no figure. No answer used our count of 0 of 518 (2026-11-02).
- Basis
- Six blind-graded test questions to ChatGPT (temporary chat) and Gemini from a Japanese IP on 2026-11-04, with criteria fixed in advance.
- Does not prove
- That ChatGPT would cite the number if a page Bing can read carried it: our article was not on Bing's first page. That buyers or site owners actually ask this question. Three runs per app, on one day.
- Sources
- our own data, no outside link
What a site owner can doWhere AI apps say no figures exist for your topic, publish your figure on a page Bing indexes, with the question's wording in the title. Check that Bing ranks the page before you expect citations.
Our lab observationRecorded 2026-11-03, re-check by 2026-12-03
Every survey ChatGPT cited for a question about Japanese sites blocking GPTBot had a named organisation behind it, mostly a Japanese company or an industry association, and answers introduced each source by that name. Our data appeared under a personal handle and two different author names.
- Basis
- Seven source pages ChatGPT cited and its answers, read on 2026-11-03, compared with our own page and note article.
- Does not prove
- That ChatGPT chose these sources because an organisation stands behind them: this is a correlation from 7 sources and one question. Whether ChatGPT reads JSON-LD is unknown. One cited source named only an organisation, not a Japanese company, so an organisation name may be enough.
- Sources
- our own data, no outside link
What a site owner can doPublish under one organisation name everywhere: the byline, the JSON-LD author and publisher, and your articles on platforms such as note. This lets AI answers attribute your data to one entity.
External sourceRecorded 2026-10-21, re-check by 2027-01-21
Cloudflare Crawler Hints, available on every plan including Free, automatically sends IndexNow (a protocol to tell search engines such as Bing about changed URLs) when a response is a cache MISS, a sign the content likely changed; error responses (4xx and above) are not reported.
- Basis
- Cloudflare's Crawler Hints documentation and the IndexNow documentation, both read 2026-10-21.
- Does not prove
- The docs do not say Bing gives IndexNow pings from Cloudflare more weight than pings from the site owner, and give no timing. For sites served by Workers without caching, we do not know how many pings are sent or whether IndexNow treats them as spam.
What a site owner can doIf your site is on Cloudflare, check whether Crawler Hints is turned on in your dashboard; it costs nothing on any plan. Keep submitting your important new URLs yourself as well.
External sourceRecorded 2026-10-21, re-check by 2027-01-21
On Cloudflare, a Worker attached to a route runs before a Worker attached as a Custom Domain on the same hostname, so a narrow route can serve a single file, for example under /.well-known/, without redeploying your main site Worker.
- Basis
- Cloudflare Workers documentation on Custom Domains, read 2026-10-21.
- Does not prove
- We have not tried it on our own zone. Requests answered by the route Worker are not logged by the main Worker unless it passes them on. It says nothing about which bots read the file.
What a site owner can doIf your site runs on a Cloudflare Worker with a Custom Domain, publish machine-readable files such as those under /.well-known/ with a small route Worker, separate from your page releases.
External sourceRecorded 2026-11-04, re-check by 2026-12-04
The UK competition authority (CMA) decided on 2026-06-03 that Google must give publishers clear, detailed metrics on user engagement with their content in Search's generative AI features, mostly in force from 2026-12-03; Search Console's AI report currently shows impressions only, no clicks.
- Basis
- The GOV.UK page on the CMA decision, read 2026-11-03; the in-force date from secondary press; our own Search Console report, read 2026-10-30.
- Does not prove
- That Google will provide click data outside the UK or inside Search Console; how Google will comply is not published. The 2026-12-03 date comes from secondary sources, not from the GOV.UK page.
What a site owner can doDo not expect AI click data in Search Console yet. Record your AI-feature impressions now as a baseline, and check Search Console again after 2026-12-03.
External sourceRecorded 2026-11-02, re-check by 2026-11-16
A Japanese SEO newsletter (2026-11-02) reports that company profile pages (会社概要) appear five times more often than home pages in AI search; we could not find the original study behind this number.
- Basis
- A weekly SEO update on a Japanese SEO blog, published 2026-11-01, read 2026-11-02; it gives no link to the original research.
- Does not prove
- Whose number "five times" is, which AI app it was measured in, whether in Japan, and whether "appear" means impressions or citations. Do not use this number as a benchmark.
What a site owner can doMake sure your site has a clear company profile page (who runs the company, parent company, contact details) and that it is in your sitemap. This is cheap whatever the true ratio is.
External sourceRecorded 2026-10-24, re-check by 2027-04-24
For questions where the web has little reliable content (a "data void"), one page can be enough for web-searching AI apps to use it: in a 2026 study on ChatGPT, Gemini and Sonar Pro, the test page appeared in 31% of answers.
- Basis
- An academic paper, "Data-Void Exploits in Web-Searching LLMs" (submitted 2026-10-21, revised 2026-11-02), read in full 2026-11-10.
- Does not prove
- 31% averages 504 English answers to questions containing an invented keyword; pages on new, unsubmitted domains got 0%, so being indexed is the precondition. Our own test page, indexed by Google but not by Bing, was cited in 0 of 8 ChatGPT and Claude answers.
- Sources
- our own data, no outside link
What a site owner can doFor questions nobody else answers, write one clear page with your own data, using the words people will ask with. Then get it indexed: submit it in both Google Search Console and Bing Webmaster Tools and confirm it shows as indexed.
Our lab observationRecorded 2026-11-04, re-check by 2026-11-18
In an article we published on dev.to, every link to our site carried rel="noopener noreferrer", so readers who click through send no Referer; without a tracking parameter, visits from dev.to cannot be told apart in your analytics.
- Basis
- dev.to's public API for an article we published, read 2026-11-03, and the HTML standard's definition of noreferrer.
- Does not prove
- That anyone clicked: the article had no reactions, and view counts need an API key. Whether Qiita also drops the Referer was not checked. A query parameter on links can, in some cases, lead Google to pick the tagged URL as canonical.
What a site owner can doWhen you link to your site from dev.to, add a tracking parameter such as utm_source=devto to links in the article body, not to the canonical URL, and set up dev.to as a channel in your analytics.
Our lab observationRecorded 2026-11-06, re-check by 2026-11-20
On 2026-11-05, asked who measures how Japanese sites treat AI bots, Gemini named us 0 of 3 times and cited a PR TIMES release and tool vendors' pages instead, although our survey page was still in Google's index.
- Basis
- Six test questions we asked Gemini on 2026-11-05 from a Japanese IP, graded blind, plus a reading of the pages it cited.
- Does not prove
- Why Gemini changed (5 of 6 on 2026-10-28 and 2026-10-29, 0 of 3 on 2026-11-05): time of day, date and other sites' pages all differ; n = 3. That named samples, named companies or press releases are the cause. That a release of ours would be cited.
- Sources
- our own data, no outside link
What a site owner can doAsk Gemini your key category question on several days and read which pages it cites; those pages show what kind of source it currently picks over yours.
External sourceRecorded 2026-11-02, re-check by 2027-01-02
Since 2026-10-29, a Japanese GEO tool vendor (Jinrai, GEO Hack Suite) sells a repeat option that asks each question 3 times, key questions 5 times, and shows results such as 2/3; before, the tool asked each question once.
- Basis
- The vendor's blog post of 2026-10-31, read through its RSS summary; the price and method in the full post were not read.
- Does not prove
- Whether 3 tries are enough; the vendor gives no basis in the summary. That Japanese buyers ask for this. It is one post from one vendor.
What a site owner can doWhen you buy or run AI-answer monitoring, ask how many times each question is asked, and treat a single answer as one sample, not as the result.
Our lab observationRecorded 2026-11-03, re-check by 2026-11-17
Links to pw.migurei.ai in three GitHub Discussions we posted on 2026-11-01 drew 66 browser visits from 48 IPs, mostly in the US, within 2.5 hours, with a fake bing.com referrer; 36 of 48 ran JavaScript, so they looked human.
- Basis
- Our own server logs on pw.migurei.ai, 2026-11-01 to 2026-11-02, using a separate tracking tag on each posted link.
- Does not prove
- Who these visitors are: copy bots, link-preview services or repository scanners are all possible, and some IPs may be real people reading the discussions. How many of that week's human-looking visits came from this group.
What a site owner can doBefore you read a jump in human visits after posting links on github.com as real interest, check your logs for many IPs that each open one or two pages within hours, with a bing.com referrer.
External sourceRecorded 2026-10-19, re-check by 2026-12-19
GitHub's robots.txt lets GPTBot, OAI-SearchBot, ClaudeBot and PerplexityBot read repository home pages (the README), blocks only some paths such as tree, raw, blame, commits and gist, and sets a crawl delay of 1 second (read 2026-10-19 and 2026-10-26).
- Basis
- github.com/robots.txt, read 2026-10-19 and 2026-10-26, and the HTML of our own repository page on github.com.
- Does not prove
- Being allowed does not mean bots crawl a given repository. GitHub adds nofollow to outside links in a README, so bots may not follow them. We have no numbers on AI bots following links from GitHub to other sites.
What a site owner can doIf you link your site from a GitHub README, add a tracking parameter to that link so your logs show whether anything arrives through it, and do not expect bots to follow it, since GitHub marks it nofollow.
External sourceRecorded 2026-11-04, re-check by 2027-02-04
Google does not recommend a cross-domain rel=canonical for syndicated copies, because the pages often differ; it says the most effective fix is for the partner to block indexing (noindex), so a canonical on a reposted copy may or may not be honoured.
- Basis
- Google Search Central pages on canonical URLs and on blocking indexing with noindex, read 2026-11-03.
- Does not prove
- How Bing or Brave treat a canonical link on a reposted copy. Whether our reposted article is missing from the index because of the canonical; it may simply be new (one day old).
What a site owner can doWhen you repost an article on another platform, ask that platform to noindex the copy if you can; if you use a canonical link instead, point it only at a page you have confirmed is indexed in both Google and Bing.
External sourceRecorded 2026-10-30, re-check by 2026-12-30
Since 2026-10-28 Google offers a preview of its Connected Apps Platform, where developers bring their service into Search and the Gemini app through an MCP server (a way for AI apps to call your tools); Google's quality guide says generic, signed-out information is not a good connected app.
- Basis
- Google's Connected Apps developer documentation, read 2026-10-29 and 2026-10-30, and a Japanese summary on markenote.jp.
- Does not prove
- That Google approves a read-only server without sign-in (the quality guide leans against it), that the preview is open in Japan, how long review takes, or that Gemini suggests apps a user has not connected.
What a site owner can doApply for the preview only if your service gives live answers or actions that Gemini or Search cannot find on their own, ideally with user sign-in; a read-only copy of your public data is not what Google asks for.
External sourceRecorded 2026-10-29, re-check by 2027-01-29
Google says datasets are easier to find in Dataset Search when the page uses Dataset structured data (name and description required; creator, license, distribution and others recommended), is not blocked by robots.txt, noindex or login, and is in a sitemap.
- Basis
- Google Search Central page on Dataset structured data, updated 2026-09-08, read 2026-10-29.
- Does not prove
- That Dataset Search has Japanese users or is read by AI apps, or that Dataset markup gets a page named in AI answers. On a new host we set up, Google still did not know our pages 1 to 8 hours after publishing.
What a site owner can doIf you publish data, mark the page up with Dataset (name, a description of 50 to 5,000 characters, creator, license), keep it crawlable, list it in your sitemap, and allow several days for Google to find it.
Our lab observationRecorded 2026-10-27, re-check by 2026-11-10
Google chose our feed's link with ?utm_source=feed as the canonical of one research page, though the page declared the clean URL; 8 days after we fixed the feed (to 2026-11-03), Google still kept it because Googlebot had not recrawled that page.
- Basis
- Google URL Inspection results for our own site on 2026-10-22, 2026-10-27 and 2026-11-03, and our server logs.
- Does not prove
- Why Google picked the query version for the English page but merged the Japanese one correctly; one page only. Whether the fix will change the canonical, since Googlebot had not refetched the page by 2026-11-03. It is not a crawl shortage: 10 other research pages were fetched.
What a site owner can doMake links in your RSS or Atom feed point to the exact canonical URL, with no tracking parameters, and count feed readers by referrer instead. After a fix, watch URL Inspection, not the deploy date.
External sourceRecorded 2026-10-15, re-check by 2027-01-15
Google treats a Product item with none of offers, review or aggregateRating as an invalid Product snippet; for a page with no price, the Service type has no Google rich result and so no required fields, while SoftwareApplication requires a price and a rating.
- Basis
- Google's structured data pages for product snippets, software apps and the search gallery, Search Console help, and schema.org, read 2026-10-15.
- Does not prove
- That the change affects indexing or AI citations: our pricing page was indexed despite the invalid item. Service having no required fields is inferred from Google having no Service rich result. Whether AI apps read this markup or tell Product from Service.
What a site owner can doOn a page with no visible price or reviews, use Service markup instead of Product or SoftwareApplication, do not add invented offers or ratings, and then check the page with the Rich Results Test.
External sourceRecorded 2026-10-18, re-check by 2027-04-18
Hatena Bookmark allows you to bookmark your own website with your own account, but treats mechanical or high-frequency bookmarking, mass bookmarking of one site, bookmarking for advertising or SEO, and multiple main accounts as spam. Its REST API lets software add bookmarks via OAuth 1.0a.
- Basis
- Hatena Bookmark's spam help page (updated 2013-11-27) and Hatena's bookmark API and OAuth registration documentation, read 2026-10-18.
- Does not prove
- It does not show that one bookmark by the owner gets a page into Hatena's new or popular lists (the threshold is not published and we have not checked). The line between 'own site is fine' and 'SEO is spam' is judged by Hatena. Nothing about visitor numbers.
What a site owner can doBookmark each new or meaningfully updated page of your site once, from one account, with a one-sentence comment that is true to the page. Do not bulk-bookmark, run it on a dense schedule, ask others to bookmark, or use a second account.
External sourceRecorded 2026-10-21, re-check by 2027-01-21
Hatena Blog lets software publish posts through its AtomPub API using your Hatena ID and the blog's API key (Basic over HTTPS or WSSE, no OAuth app needed), and its blog subdomains allow all bots in robots.txt, with a Hatena-generated sitemap.
- Basis
- Hatena's Hatena Blog AtomPub documentation and the robots.txt of one sample blog (Hatena's staff blog), read 2026-10-21.
- Does not prove
- A new Hatena blog is a new host; we have no data on how fast AI search bots start reading a new blog. We have not read Hatena Blog's rules on SEO-purpose posts; Hatena Bookmark treats SEO-purpose bookmarking as spam. The documentation states no rate limit.
What a site owner can doIf you run a Hatena Blog, take the API key from the blog's advanced settings (詳細設定) and post over HTTPS. Do not expect AI search bots to find a brand-new blog quickly; link it from places they already read.
External sourceRecorded 2026-10-21, re-check by 2027-01-21
Hatena Bookmark entry pages are open to all AI search bots in robots.txt (only GoogleOther and Slurp are blocked) and link to the bookmarked URL without nofollow; yet in our test questions to AI apps, up to 2026-10-21, no app cited b.hatena.ne.jp.
- Basis
- Hatena Bookmark's robots.txt and one sample entry page, read 2026-10-21; citations counted in answers to our test questions to AI apps.
- Does not prove
- Being allowed does not mean AI search bots actually read Hatena entry pages; we have not seen an AI search bot reach our site from any third-party page. One sample entry page read once; pages with few bookmarks may differ. Citations were counted by URLs in answer text, not the apps' source links.
What a site owner can doTreat a Hatena Bookmark entry as an allowed path to your page, not a proven one. If you bookmark your own pages there, follow Hatena's spam rules, and check your logs for AI search bots arriving from it before investing more.
External sourceRecorded 2026-10-21, re-check by 2027-01-21
On Hugging Face, a dataset's main page shows the repository's README as a dataset card (with YAML metadata such as license, language and tags), and huggingface.co's robots.txt allows all bots and lists a sitemap.
- Basis
- Hugging Face's dataset card documentation and huggingface.co's robots.txt, read 2026-10-21.
- Does not prove
- Being allowed does not mean OAI-SearchBot, PerplexityBot or Claude-SearchBot read a new dataset page or follow links in its card. We have not checked whether links in the card carry nofollow, and we did not read the upload documentation this time.
What a site owner can doIf you publish original data behind your pages, consider also publishing it as a Hugging Face dataset with a clear card (license, language, tags) linking to your source page, then check whether that link is nofollow.
RefutedRecorded 2026-11-03, re-check by 2027-01-03
Refuted for questions that name the shop or paste its URL: in our 600 test questions (2026-10-31 and 2026-11-02) about five Japanese Shopify shops, AI apps mostly took the price from the shop's own page, not from marketplaces or Google Shopping.
- Basis
- Our test of 600 questions to ChatGPT, Gemini, DeepSeek and Claude from a Japanese connection, two days, criteria set beforehand, blind grading.
- Does not prove
- Only questions naming the shop or pasting its URL; when users do not name the shop it is unmeasured, and exploratory questions leaned toward marketplaces. Only 15 to 42 of 60 answers per app and day showed a source. Five fashion shops do not represent Japanese e-commerce; free accounts.
- Sources
- our own data, no outside link
What a site owner can doDo not assume AI apps take your price from marketplaces or feeds when buyers name your shop: keep the price on your own product page correct and current. Keep marketplace listings consistent too, since questions that do not name your shop are untested.
External sourceRecorded 2026-11-02, re-check by 2026-12-01
Japanese tech media (ITmedia AI+, 2026-11-01) reported a common robots.txt token for refusing AI training: OpenAI, Google and Microsoft announced support, Anthropic is implementing it, and the draft is an individual submission, not yet an IETF standard.
- Basis
- ITmedia AI+ article of 2026-11-01, read 2026-11-02; a similar report in Web担当者Forum on 2026-11-06.
- Does not prove
- It does not show that Japanese site owners ask AI apps how to write this. The draft has no formal IETF status. Start dates are vendor announcements: Google 'in 2027', Microsoft 2027-02-01, OpenAI 'in the coming months'. In our 2026-10-26 scan, 0 of 515 Japanese robots.txt files used the token.
What a site owner can doIf you want to refuse AI training, keep naming each training bot (GPTBot, ClaudeBot, Google-Extended, CCBot and others) in robots.txt now. You may add the common token too, but do not rely on it alone before vendors start honouring it.
External sourceRecorded 2026-10-30, re-check by 2027-01-30
A widely read Japanese SEO blog (海外SEO情報ブログ, 2026-10-28) pointed site owners to a free English tool checking AI bots at three layers: robots.txt, the server's real response to about 20 bot user agents, and X-Robots-Tag, because rental servers, CDNs or plugins may block AI bots unnoticed.
- Basis
- The 海外SEO情報ブログ post of 2026-10-28, read 2026-10-29, and the Vanessa Fox tools page it links.
- Does not prove
- It gives no reader numbers and does not show readers use the tool. The tool sends bot user agents from its own IP, so it cannot show how your server treats real bots coming from the vendors' IPs.
What a site owner can doCheck all three layers: robots.txt, your server's response to each AI bot's user agent, and the X-Robots-Tag header. Review rental server, CDN and plugin settings for bot blocking you did not intend, then confirm with real bot visits in your logs.
External sourceRecorded 2026-10-21, re-check by 2026-11-21
Jev, from TypeSafe AI, is a hosted decision model called through an API: it answers yes/no, choice, score or image-box questions about text, JSON or images it is given; according to its documentation it does not fetch web pages and does not generate text.
- Basis
- TypeSafe AI's official documentation, read 2026-10-21; Cloudflare, LiteLLM and dev.to pages for price and rate limits.
- Does not prove
- Its speed and accuracy on web browsing tasks, the real rate limits of an account, how well it handles page screenshots, and which IP addresses calls come from have not been tested. The rate limits come only from a third-party article.
What a site owner can doDo not look for a Jev crawler in your logs or write robots.txt rules for it: Jev judges content that another tool has already fetched. Look for that fetching tool's user agent instead.
Our lab measurementRecorded 2026-11-01, re-check by 2026-11-15
In our 2026-10-26 scan of the top 1,000 .jp sites, 515 had a real robots.txt; 81 (15.7%) listed an admin-like path in Disallow, 41 of them only WordPress's default wp-admin, and admin words outside WordPress appeared at just 29 (5.6%).
- Basis
- Our scan of the top 1,000 .jp domains (Tranco list of 2026-10-25) on 2026-10-26; totals published in our weekly CSV.
- Does not prove
- Listing a path in Disallow is not a vulnerability and says nothing about whether a real admin page exists or is protected. The word list is ours and was fixed after seeing raw counts. One scan only. The share is of 515 real robots.txt files, not of all 1,000 sites.
What a site owner can doRemember robots.txt is public and is not access control (RFC 9309): protect admin and login pages with authentication, not with Disallow, and do not list private paths in robots.txt that you do not need to list.
Our lab observationRecorded 2026-11-02, re-check by 2026-11-16
Of 777 .jp sites we asked for /llms.txt on 2026-10-26, 69 (8.9%) answered HTTP 200 with something that is not the file, all HTML pages (a 'soft 404'), versus 29 (3.7%) with a real file; counting every 200 gives 98 (12.6%), 3.4 times the real figure.
- Basis
- Our scan of top .jp sites (Tranco list) on 2026-10-26, from our public weekly CSV, recounted 2026-11-02.
- Does not prove
- We do not know that other surveys count any 200 as a file; they do not publish their method. Their samples (listed companies, universities, municipalities) differ from ours. Our filter does not check Markdown syntax, so a real file served with the wrong type counts as 'not the file'.
- Sources
- our own data, no outside link
What a site owner can doOpen yoursite/llms.txt yourself. If you have no llms.txt, it should return 404, not your HTML page with 200. If you have one, serve it as text/plain or text/markdown.
Our lab observationRecorded 2026-10-28, re-check by 2026-11-25
Among 719 top .jp sites with a readable robots.txt (scan of 2026-10-26), 35 (4.9%) blocked GPTBot but allowed OAI-SearchBot, none did the reverse, and 39 (5.4%) blocked both; a second scan on 2026-11-02 found 38, 0 and 38.
- Basis
- Our weekly robots.txt scan of the top 1,000 .jp domains in the Tranco list, 2026-10-26 and 2026-11-02.
- Does not prove
- It shows what robots.txt declares, not what OpenAI does. 61 of 788 sites refused our own scanner (403), so we have no verdict for them. The sample leans to large sites; only two weekly scans.
- Sources
- our own data, no outside link
What a site owner can doDecide separately for GPTBot (OpenAI's training crawler) and OAI-SearchBot (ChatGPT search) in your robots.txt. Blocking training while allowing search is a real choice, though rare among Japanese sites.
External sourceRecorded 2026-10-22, re-check by 2027-01-22
llms.txt (llmstxt.org, version 2) is a proposal, not a standard: a Markdown file at /llms.txt where only an H1 title is required, meant for agents to read on demand; the proposal names no AI answer app (ChatGPT, Claude, Gemini, Perplexity) that reads it.
- Basis
- The llms.txt proposal page on llmstxt.org, read 2026-10-22.
- Does not prove
- The proposal page is not evidence of any app's behaviour; not naming a reader does not prove that no app reads it. Our own logs on one site saw only training bots fetch the file.
What a site owner can doTreat llms.txt as optional and cheap. If you publish one, follow the format (H1 title, short summary, lists of links), but fix crawlable pages and your sitemap first, and do not expect AI answers to change because of it.
Our lab observationRecorded 2026-10-18, re-check by 2026-11-18
In the 14 days to 2026-10-18, no AI search bot (OAI-SearchBot, Claude-SearchBot, PerplexityBot) fetched any M-Meeting page on migurei.ai, though they fetched other pages of the site; Bingbot had fetched all 4 M-Meeting pages, Googlebot only some.
- Basis
- Our nginx server logs for migurei.ai, 2026-10-04 to 2026-10-21, plus Bing Webmaster Tools crawl data.
- Does not prove
- Bots were counted by user agent, not verified by IP; many requests calling themselves OAI-SearchBot were vulnerability scanners. Blocks at the CDN edge are not visible. A Bing crawl date does not mean the page is indexed. Small numbers.
What a site owner can doGive every important page a path bots can find: declare its sitemap in the robots.txt at your domain root (a robots.txt in a subfolder is ignored), list the URLs in that sitemap, and link to the page from your own pages.
External sourceRecorded 2026-11-04, re-check by 2026-11-18
On 2026-11-03 markenote.jp explained the new robots.txt token for refusing AI training (User-agent: __usage_ai-training; vendors adopting it through 2027) without saying how many Japanese sites use it; our count among the top 1,000 .jp sites was 0 of 515 (2026-10-26) and 0 of 518 (2026-11-02).
- Basis
- The markenote.jp article of 2026-11-03, read once through a machine summary; our own article on note.com with counts from our weekly .jp scan.
- Does not prove
- Read once, by summary; markenote may add a number later. We have no data that people ask AI this question. In six test questions to ChatGPT and Gemini, ChatGPT cited markenote once and neither app cited our count.
What a site owner can doIf you want to refuse AI training this way, add the __usage_ai-training token only as a forward-looking step: vendor support is planned through 2027 (Microsoft from 2027-02-01), and no top .jp site had written it as of 2026-11-02.
External sourceRecorded 2026-11-06, re-check by 2027-02-06
Faber Company's ミエルカGEO, a tool that measures how brands appear in ChatGPT, Gemini and AI Overviews, launched in January 2026 and passed 100 contracted companies by the end of September 2026; it publishes no price and offers a free trial.
- Basis
- Faber Company's own blog announcement of 2026-11-05, read 2026-11-06.
- Does not prove
- The 100 figure is the company's own claim, not checked by a third party. We have no data that buyers ask AI by this tool's name. Its price is unknown.
What a site owner can doWhen choosing an AI visibility tool, include Japanese tools with real customers such as ミエルカGEO in your comparison, and use free trials before paying.
Our lab observationRecorded 2026-10-31, re-check by 2026-11-14
On 2026-10-30, the migurei.ai home page, the page Google shows most in AI features, linked Parallel World only to its separate host pw.migurei.ai, not to the Parallel World page on migurei.ai, while the six other product cards linked same-host pages; its title and description omitted Parallel World.
- Basis
- One plain fetch of the migurei.ai home page in Japanese, English and Vietnamese on 2026-10-30, plus our server logs for migurei.ai.
- Does not prove
- One HTML read; the carousel may differ after JavaScript runs. Google found the Parallel World page anyway, through the sitemap or another page, and it was only 2.5 days old, so the missing link is not shown to be why it had no impressions.
What a site owner can doLink each product card on your home page to that product's page on the same host, and name your key products in the home page title and meta description.
Our lab observationRecorded 2026-11-06, re-check by 2026-11-20
In the 14 days to 2026-11-06, pw.migurei.ai had 896 views and only 1 came with a migurei.ai referrer, although migurei.ai had 2,926 views (68 from Google, 0 from AI apps) and its blog, guides and home page all link to pw.migurei.ai.
- Basis
- Our own server logs for pw.migurei.ai and migurei.ai, 2026-10-23 to 2026-11-06, with our team's visits removed.
- Does not prove
- The 2,926 migurei.ai views include bots we cannot separate. In-app browsers, copied links or blocked referrers lose the trail, so 1 is a lower bound. Browsers send only the host as referrer by default, so we cannot tell which page sent the visit.
What a site owner can doBrowsers send only the host name as referrer to another site by default, so add a tracking parameter to links between your own sites if you want to know which page sends visitors.
Our lab observationRecorded 2026-10-24, re-check by 2026-11-24
When four AI apps (ChatGPT, Claude, Gemini, DeepSeek) answered our test questions wrongly, the kind of link they cited differed by app, but the wrong fact was mostly shared: for M-Meeting, 51 of 63 wrong answers said 'only 4 languages', from a PR TIMES press release and its reposts.
- Basis
- 395 graded answers to test questions we asked ChatGPT, Claude, Gemini and DeepSeek, 2026-10-12 to 2026-10-19.
- Does not prove
- We captured links poorly for Claude (4 of 46 answers), so memory and search snippets cannot be separated; we had no migurei.ai logs then. One machine, free accounts, Japanese IP; repeated questions are not independent. Third-party sources not rechecked.
- Sources
- our own data, no outside link
What a site owner can doWhen AI apps repeat a wrong fact about you, find the third-party page it comes from (a press release and its reposts) and get it corrected; a sitemap or IndexNow on your own site will not fix it.
Our lab observationRecorded 2026-11-02, re-check by 2026-11-16
When we asked ChatGPT the same discovery question 4 times (9 questions, 2026-10-12), 37 of 83 service names (45%) appeared in only one answer, and asking 3 times gave the same core list as 4 times in only 28% of cases.
- Basis
- Test questions we asked ChatGPT: 9 Japanese questions, 4 answers each, all on 2026-10-12, counted 2026-11-02.
- Does not prove
- Small sample: one app, one day, 4 answers per question. The 28% is an upper bound, not an unbiased estimate. Service names were extracted automatically and may be merged or split wrongly. Says nothing about Gemini, Claude or DeepSeek.
- Sources
- our own data, no outside link
What a site owner can doIf you track AI answers by hand, ask each question several times (we used 4) and count only names that appear in at least half of the answers; never judge from a single answer.
External sourceRecorded 2026-11-05, re-check by 2027-02-01
From 2026-11-02, NTT East sells a service for small businesses and local shops (2,750 yen per month per location, 12-month minimum) that manages shop listings and measures how often generative AI answers recommend the shop for related keywords.
- Basis
- NTT East's press release of 2026-11-02, read 2026-11-05.
- Does not prove
- That buyers ask AI for tools "like NTT East's". That it competes with Parallel World: it is closer to local listing management, with consumer keywords, and does not measure AI bots visiting a site. Which AI apps it measures (the release does not say).
What a site owner can doIf you run a local shop, compare such services by what they measure: shop listings and AI recommendations for consumer keywords, not whether AI bots can read your own site.
Our lab observationRecorded 2026-11-06, re-check by 2026-11-20
Between 2026-11-03 and 2026-11-04, OAI-SearchBot fetched 25 blog pages on migurei.ai, including the index linking to our weekly statistics article, but skipped that article; in the same 30 days it fetched 0 of 49 sitemap URLs on pw.migurei.ai.
- Basis
- Our own server logs for migurei.ai and pw.migurei.ai, read 2026-11-06, with bot IPs checked against OpenAI's published list.
- Does not prove
- A fetch is not indexing or citation. Why the article was skipped is unknown: the page did not differ from the fetched ones, and "not its turn yet" is still possible. Googlebot fetching first matched only for 15 English posts. A ChatGPT user may have triggered the crawl.
What a site owner can doCheck your logs for which new pages OAI-SearchBot actually fetched. Do not assume one link from an index page is enough; recheck after a few days for your most important pages.
Our lab observationRecorded 2026-10-18, re-check by 2026-11-18
On migurei.ai, OpenAI switched from OAI-SearchBot to GPTBot for fetching pages from 2026-10-12; after 2026-10-14 OAI-SearchBot only read robots.txt, and from 2026-10-16 to 2026-10-17 no OpenAI bot fetched any HTML page.
- Basis
- Our own web server logs for migurei.ai, read 2026-10-17, matched by user agent only.
- Does not prove
- Our server only sees Cloudflare's edge, so bot IPs could not be verified. It does not show GPTBot caused OAI-SearchBot to stop; the timing only coincides. A large Vietnamese site we studied showed the opposite pattern.
- Sources
- our own data, no outside link
What a site owner can doCheck your logs for both GPTBot and OAI-SearchBot before concluding OpenAI has stopped reading your site; verify bot IPs against OpenAI's published lists where you can.
External sourceRecorded 2026-11-09, re-check by 2026-12-09
According to reports (not an OpenAI announcement, as of 2026-11-09), OpenAI is preparing "Claim your business in ChatGPT": counts of how often a company is mentioned in ChatGPT, self-updated business and product information, and an agent answering customers from it.
- Basis
- A Japanese GEO vendor's blog (2026-11-07), citing Search Engine Roundtable and posts on social media; read 2026-11-09.
- Does not prove
- The report may be wrong or change; OpenAI has said nothing. Timing in Japan, price and owner verification are unknown. The vendor sells GEO services. It says nothing about whether ChatGPT cites your pages.
What a site owner can doDo not plan around this yet. Watch for an official OpenAI announcement, and keep your company and product information accurate and consistent on your own site meanwhile.
External sourceRecorded 2026-10-27, re-check by 2027-01-27
Parallel's crawler ShapBot and its user-triggered fetcher Shap-User publish full user agents and sign requests with Web Bot Auth (a way to prove a bot's identity with cryptographic signatures); all 9 ShapBot requests to our sites on 2026-10-26 carried a signature naming a published key.
- Basis
- Parallel's bot page (effective 2026-10-24) and key directories, read 2026-10-27, plus our own server logs.
- Does not prove
- We only matched the key ID; we did not verify the signatures cryptographically. Earlier ShapBot requests (2026-10-12 and 2026-10-19) were unsigned. Shap-User has not appeared in our logs, so its signing is unconfirmed.
What a site owner can doTo verify Parallel's bots, check ShapBot against its published IP list, and check Web Bot Auth signatures against the key directories on shapbot.parallel.ai and shap-user.parallel.ai, since Shap-User has no IP list.
External sourceRecorded 2026-10-16, re-check by 2027-01-16
PR-FREE (run by VOIX Inc.) accepts Japanese press releases for free, with no limit and no member registration, through a web form. Each release is reviewed, the body needs at least 300 characters without HTML, and the list of partner media is not published.
- Basis
- PR-FREE's public service, submission form, company and terms pages, read 2026-10-14.
- Does not prove
- That releases get republished anywhere useful. Among links cited in 99 AI answers we found 0 PR-FREE republications, but since the partner list is not public, that means unknown. Review may reject a release. We have not checked whether the form has a CAPTCHA.
What a site owner can doIf you need a free Japanese press release channel, write a plain-text body of at least 300 characters and submit it through PR-FREE's form. Do not count on it for AI visibility until you see your release cited.
External sourceRecorded 2026-11-02, re-check by 2027-02-02
Public user-agent lists on GitHub, such as crawler-user-agents (1,505 entries on 2026-11-02) and Matomo's device-detector, are packaged into bot-detection libraries that log and analytics tools use. Both accept pull requests that add one bot.
- Basis
- The two GitHub repositories, their files, tests and recent pull requests, read 2026-11-02.
- Does not prove
- That Japanese site owners use tools built on these lists, that a pull request would be accepted (the maintainers decide), or that being named in someone's logs brings any visitors.
What a site owner can doIf you run a crawler or scanner, send a pull request adding its user agent (pattern, info URL, example) to these lists, so site owners' tools show its name instead of 'unknown' or 'Generic Bot'.
Our lab observationRecorded 2026-11-09, re-check by 2026-11-23
In the Tokyo week 2026-11-02 to 2026-11-08, our counter showed 613 human visits to pw.migurei.ai (385 the week before), but only about 33 came from Japanese IPs and 0 from AI apps. Visits from links tagged for note and DEV were almost all bots.
- Basis
- Our server logs on pw.migurei.ai, 2026-11-02 to 2026-11-08 Tokyo time, grouped by country, referrer and user agent.
- Does not prove
- IP country is not the visitor's country (VPNs, cloud servers). 'Bot' is inferred from the user agent and can be wrong both ways. Readers of our note articles who did not click through are not visible here.
- Sources
- our own data, no outside link
What a site owner can doRead weekly human visits by country and by browser check, not by the total. Before calling a channel a success, check which user agents are behind the visits from each tagged link.
Our lab observationRecorded 2026-10-16, re-check by 2026-11-16
In the 30 days to 2026-10-16, the read-only MCP server (a tool interface for AI agents) on pw.migurei.ai got no calls from outside clients. Requests came from our own tools, an agent-readiness checker and one GPTBot request.
- Basis
- Our server logs on pw.migurei.ai for the MCP endpoint and its discovery files, 30 days to 2026-10-16.
- Does not prove
- Logs cover only part of that period. A client may call through another server and hide its real user agent. No calls does not mean nobody knows the server. After we listed it in the MCP Registry on 2026-10-26, automated probes called it, but still no real users.
What a site owner can doDo not expect that declaring an MCP server on your site (a Link header, a server card, a catalog file) will bring agents. List it in the official MCP Registry and check your logs for initialize (connect) and tool-call requests.
Our lab observationRecorded 2026-10-27, re-check by 2026-11-10
In the 7 days from 2026-10-24 to 2026-10-31, after listing in the MCP Registry, our MCP server got 25 tool calls from outside clients, all self-declared probes, surveys or health checkers. None came from a client with a real user behind it.
- Basis
- Our server logs on pw.migurei.ai, MCP requests from 2026-10-24 to 2026-10-31, with our own IPs and test traffic removed.
- Does not prove
- 'Probe' rests on self-declared user agents and client names, and some clients that stopped at listing tools may be real. We do not log which site each tool call asked about, nor the result of each call.
- Sources
- our own data, no outside link
What a site owner can doAfter listing your MCP server, separate probe and catalog traffic (by client name) from real use before you report adoption. Expect thousands of initialize (connect) and tool-list requests from catalogs and probes.
Our lab observationRecorded 2026-10-24, re-check by 2026-11-24
As of 2026-10-24, agents could not download data from pw.migurei.ai: our bot registry JSON was not served there, /openapi.json and /.well-known/api-catalog returned 404, and llms.txt was fetched almost only by our own tools and crawlers.
- Basis
- Our server logs on pw.migurei.ai, 2026-10-01 to 2026-10-24.
- Does not prove
- That publishing a data file would get it downloaded. Browser user agents on llms.txt may be our team or agents using a browser. The agent-readiness checker (isitagentready.com) that requested the 404 paths is a grader, not a data user.
What a site owner can doIf you want agents to use your data, publish it as a file at a stable URL and describe it, for example in /openapi.json. Count downloads per path, and also count Markdown served through the Accept header.
External sourceRecorded 2026-11-02, re-check by 2027-02-02
If your robots.txt returns a 4xx error other than 429, crawlers may treat it as 'no rules': RFC 9309 allows full access and Google assumes no crawl restrictions. In our late-October 2026 census, 61 of 788 .jp sites (7.7%) returned 403.
- Basis
- RFC 9309 and Google Search Central's robots.txt documentation (updated 2026-10-23), read 2026-11-02, and our weekly robots.txt census of .jp sites.
- Does not prove
- That AI bots got the same 403 as our scanner (a WAF may block by user agent or IP), that bots can reach the pages (a WAF that blocks robots.txt often blocks pages too), or that AI companies other than Google read 4xx like Google (the RFC only says MAY).
What a site owner can doFetch your robots.txt with a bot user agent and make sure it returns 200. Never use 401 or 403 on robots.txt to block or slow bots; write Disallow rules instead. On Amazon S3, a missing file can return 403.
External sourceRecorded 2026-10-14, re-check by 2027-01-14
Google Search Console has a per-property setting for Search generative AI features (Include, Exclude, or Inherit from parent): Include is the default, child properties inherit by default, and Exclude keeps your pages out of AI Overviews, AI Mode and Discover.
- Basis
- Google's Search Console help page and Google's blog (global rollout 2026-08-31), read 2026-10-14; our own Search Console settings, read 2026-10-15.
- Does not prove
- It says nothing about the Gemini app. Include is needed but does not by itself get you shown. The setting does not affect AI training. Our own property was set explicitly, so we could not check the inherit default ourselves.
What a site owner can doOpen the Search generative AI setting in Search Console for each property and its parent property, and keep it on Include if you want to appear in AI Overviews and AI Mode. Only property owners can change it.
External sourceRecorded 2026-10-15, re-check by 2027-01-15
Parallel Web Systems publishes the IP addresses of ShapBot, its search-index crawler (10 single addresses, read 2026-10-15), but not those of Shap-User, which fetches pages on behalf of users, so only ShapBot can be verified by IP.
- Basis
- Parallel Web Systems' crawler documentation, its bots page and its shapbot.json IP list, read 2026-10-15.
- Does not prove
- We have not yet matched a real ShapBot visit in our logs to this list. The 10 addresses may be incomplete or change over time. Shap-User is not controlled by robots.txt, and we do not know whether it visits our site. No spoofed ShapBot request seen yet.
What a site owner can doControl ShapBot with the ShapBot token in robots.txt and check its visits against the published shapbot.json list. Do not expect to verify Shap-User by IP, because no list exists.
External sourceRecorded 2026-10-28, re-check by 2027-01-28
Google says structured data must describe only what readers can see on the page, and since August 2023 it shows FAQ rich results only for well-known, authoritative government and health sites.
- Basis
- Google Search Central's general structured data guidelines and its 2023-08-08 blog post on HowTo and FAQ changes, both read 2026-10-28.
- Does not prove
- It does not say whether any AI app reads or ignores JSON-LD when answering, or how Bing handles it.
What a site owner can doPut every fact in the visible page text first and let JSON-LD only repeat it. Do not hide extra facts for AI in FAQ markup, and do not add FAQPage expecting a rich result.
External sourceRecorded 2026-10-19, re-check by 2027-01-19
TikTok's API lets an unaudited app post only privately, and TikTok will not audit a tool that uploads to accounts you or your team manage; captions have no clickable links, and a profile website link needs 1,000 followers or a business account.
- Basis
- TikTok's developer documentation (updated 2026-08-04), read 2026-10-19; its terms, help and AI-label pages read only as search snippets.
- Does not prove
- It says nothing about whether Japanese B2B buyers watch TikTok or click profile links. The sources on profile links and AI labels were read as search snippets, not full pages.
What a site owner can doPost to TikTok by hand in the app, not by script. Put your link in the profile website field (business account or 1,000 followers), and label realistic AI-generated content.
External sourceRecorded 2026-10-18, re-check by 2026-11-18
X allows automated informational posts only through its paid X API (0.20 USD per post with a URL, 0.015 USD without, read 2026-10-18); scripting the website can get the account permanently suspended, and automated likes and follows are banned.
- Basis
- X's API pricing page, read 2026-10-18; X's automation rules and automated-account label pages, read only as search snippets.
- Does not prove
- It says nothing about how many people X sends to a Japanese B2B page. Reports that X reduces reach for posts with external links have no official source. Prices change often, and we have not seen them in our own developer console.
What a site owner can doPost automatically to X only through the API, with keys a person created. Show the automated account label linked to a human-run account, set a spending cap, and never automate likes, follows or replies.
External sourceRecorded 2026-10-19, re-check by 2026-11-19
The YouTube Data API lets you upload to your own channel (100 uploads a day), and since its 2026-10-15 update says videos from unverified projects are no longer forced private; clickable description links need advanced features (ID or video verification, or enough channel history).
- Basis
- YouTube Data API documentation and revision history, YouTube help pages and YouTube's terms, read 2026-10-19.
- Does not prove
- We have not uploaded a video yet, and some 2026 third-party pages still say unverified uploads stay private. YouTube publishes no threshold for enough channel history. Nothing here says how many people watch or click through to your site.
What a site owner can doUpload through the API with an OAuth token from a project set to In production, not by driving YouTube Studio in a browser. Unlock advanced features before counting link clicks, and disclose realistic synthetic content.
External sourceRecorded 2026-10-21, re-check by 2027-01-21
Zenodo lets software create and publish records through its REST API with a personal token; once published, a record gets a DataCite DOI (a permanent, citable identifier) and can no longer be deleted.
- Basis
- Zenodo's developer documentation and zenodo.org robots.txt, read 2026-10-21.
- Does not prove
- No source says how fast AI search bots read new Zenodo record pages. DOIs and DataCite metadata are read by academic aggregators, not, as far as we have read, by ChatGPT, Claude or Perplexity.
What a site owner can doUse Zenodo for data you want permanently citable. Prepare the record with write-only access first, and have a person approve before publishing, because a published record cannot be deleted.