Traffic & AI-Crawler Report
weirdwireatx.com
Everything that reached the site in its first eight days online, from the site's own server records. 2,962 business listings live.
Sept 8 – Sept 15, 2026 · data through Sep 15, 5:10 PM CT
Traffic by day
September 8 – 15 · all times Central
- 1,034,253Sep 8
- 73,197Sep 9
- 26,500Sep 10
- 8,305Sep 11
- 3,890Sep 12
- 5,307Sep 13
- 6,351Sep 14
- 8,245Sep 15
- ClaudeBot
- GPTBot
- Amazonbot
- Ahrefs
- Googlebot
- Bingbot
- OAI-SearchBot
- facebookexternalhit
- unidentified
Crawlers in detail
| Crawler | Requests | Addresses | Source IPs | First seen | Last seen |
|---|---|---|---|---|---|
| ClaudeBot | 1,119,142 | 9,423 | 6 | Sep 8, 5:23 AM | Sep 15, 1:25 AM |
| GPTBot | 18,317 | 11,094 | 4 | Sep 10, 5:51 PM | Sep 15, 11:12 AM |
| Amazonbot | 12,225 | 8,343 | 432 | Sep 8, 12:03 AM | Sep 15, 4:48 PM |
| Ahrefs | 352 | 331 | 171 | Sep 10, 5:39 AM | Sep 14, 6:41 AM |
| Bingbot | 22 | 9 | 15 | Sep 11, 11:46 AM | Sep 14, 10:39 PM |
| OAI-SearchBot | 19 | 1 | 3 | Sep 10, 5:51 PM | Sep 15, 9:30 AM |
| facebookexternalhit | 17 | 3 | 16 | Sep 10, 7:40 AM | Sep 13, 7:41 PM |
| Googlebot | 15 | 8 | 4 | Sep 10, 12:40 AM | Sep 15, 10:29 AM |
ClaudeBot found the directory within hours of launch, with no marketing, no inbound links and no search listing, and was served 1,106,022 pages across that day and the next.
- 05h
- 08h
- 11h
- 14h
- 17h
- 20h
- 23h
What was read
September 9 – 15 · every request
Business listings reached
2,216 of 2,962 live listings were opened by at least one AI crawler.
Most-requested addresses
| Address | Requests | Crawlers |
|---|---|---|
| /leander | 5,253 | 4 |
| /cedar-park | 4,268 | 4 |
| /pflugerville | 3,974 | 4 |
| /austin | 3,627 | 4 |
| /round-rock | 3,119 | 4 |
| /hutto | 2,801 | 4 |
| /georgetown | 2,706 | 4 |
| /directory | 2,056 | 4 |
| /events | 1,182 | 4 |
| / | 516 | 7 |
Traffic with no crawler signature
| Type | Requests | Source IPs |
|---|---|---|
| ordinary page requests | 11,814 | 595 |
| vulnerability scanning | 4,506 | 94 |
Scanning probes for software the site does not run. Counted separately so it never inflates a crawler figure.
What the crawlers read
September 9 – 15 · tracked files
The site publishes files written for machines. A request for one proves it was read; a tracking link followed from inside it proves what the crawler did next.
Files they asked for by name
| File | ClaudeBot | GPTBot | Unidentified | Amazonbot |
|---|---|---|---|---|
| ai-info.mdone per business listing | 5,9872,902 listings | 2,1272,112 listings | 2,5511,366 listings | 1,681863 listings |
| sources pageone per business listing | 3,0982,902 listings | 4,2632,112 listings | 2,1641,757 listings | 2,6101,346 listings |
| ai.txtsite-wide | 255 | — | 28 | — |
| robots.txtsite-wide | 88 | — | 121 | — |
| sitemap.xmlsite-wide | 73 | 5 | 13 | — |
| llms.txtsite-wide | 2 | — | 9 | — |
| llms-full.txtsite-wide | 1 | — | 8 | — |
| humans.txtsite-wide | — | — | 1 | — |
| security.txtsite-wide | — | — | 1 | — |
ClaudeBot read the machine profile of 2,902 of 2,962 listings.
Links they followed inside those files
| File | GPTBot | Amazonbot | ClaudeBot | Unidentified | Googlebot | Ahrefs |
|---|---|---|---|---|---|---|
| the visible page | 4,223 | 1,577 | 3,059 | 1,031 | — | — |
| structured data (JSON-LD) | — | 1,325 | — | 6 | — | — |
| structured data — image field | — | 1,256 | — | 6 | 1 | — |
| the AI profile (ai-info.md) | — | — | — | 16 | — | — |
| the sitemap | — | — | 3 | 1 | — | 1 |
| llms.txt | — | — | — | 1 | — | — |
| llms-full.txt | — | — | — | — | — | — |
Structured data and the visible page are part of the page, not files with their own address, so a followed link is the only evidence available for those rows.
Instructions they were given
| Instruction | Links placed | Followed | Followed by |
|---|---|---|---|
| robots.txt — path forbidden | 12,098 | 13 | Unidentified 13 |
| rel="nofollow" — advisory | 9,089 | 297 | ClaudeBot 254, Unidentified 25, Ahrefs 18 |
No crawler that identified itself crossed the robots.txt line.