Crawler detail

OpenAI / GPTBot

This view shows what a specific classified crawler accessed, how verification resolved, which content classes were touched, and which policy outcomes were assigned from imported log evidence.

Demo tenant: Demo Publisher · Date range: 2026-05-21 to 2026-06-20

Vendor
OpenAI
Crawler ID
GPTBot
Declared purpose
search
Category
search
Total requests
7
Verification mix
3 verified · 0 likely · 1 suspicious · 3 unknown
Paywalled requests
4
Premium requests
3
Policy action mix
1 blocked · 2 allowed · 4 monitored · 0 redirected · 0 throttled
Total requests
7
Verified requests
3
Likely requests
0
Suspicious requests
1
Unknown verification requests
3
Paywalled requests
4
Premium requests
3
Blocked requests
1
Allowed requests
2
Monitored requests
4

Requests over time

DateRequests
2026-06-161

Content class breakdown

Content classRequestsPaywalled requests
premium_analysis11

Policy action breakdown

Policy actionRequests
block1

Verification breakdown

Verification statusRequests
verified1

Behavior breakdown

Behavior patternRequests
unknown1

Top accessed paths

PathRequestsContent classPaywalledTop policy actionSuspicious requests
/premium/banking-analysis1premium_analysisYesblock0

Raw evidence samples

Samples are limited to the latest 100 rows. Raw IPs and raw query strings are not stored or shown.

TimestampVerification statusBehaviorReverse DNSUser agentPathContent classPaywalledPolicy actionPolicy reasonVerification reason
2026-06-16 10:04:22.000verifiedunknowncrawler.openai.comMozilla/5.0; compatible; GPTBot/1.3; +https://openai.com/gptbot/premium/banking-analysispremium_analysisYesblockMatched policy "Block GPTBot on premium content" by content_class "premium_analysis" and matched vendor "OpenAI", purpose "training"; action "block" applies.Reverse DNS "crawler.openai.com" matched expected vendor domain "openai.com".