Crawler detail
OpenAI / GPTBot
This view shows what a specific classified crawler accessed, how verification resolved, which content classes were touched, and which policy outcomes were assigned from imported log evidence.
Demo tenant: Demo Publisher · Date range: 2026-05-21 to 2026-06-20
- Total requests
- 7
- Verified requests
- 3
- Likely requests
- 0
- Suspicious requests
- 1
- Unknown verification requests
- 3
- Paywalled requests
- 4
- Premium requests
- 3
- Blocked requests
- 1
- Allowed requests
- 2
- Monitored requests
- 4
Requests over time
| Date | Requests |
|---|---|
| 2026-06-16 | 1 |
Content class breakdown
| Content class | Requests | Paywalled requests |
|---|---|---|
| premium_analysis | 1 | 1 |
Policy action breakdown
| Policy action | Requests |
|---|---|
| block | 1 |
Verification breakdown
| Verification status | Requests |
|---|---|
| verified | 1 |
Behavior breakdown
| Behavior pattern | Requests |
|---|---|
| unknown | 1 |
Top accessed paths
| Path | Requests | Content class | Paywalled | Top policy action | Suspicious requests |
|---|---|---|---|---|---|
| /premium/banking-analysis | 1 | premium_analysis | Yes | block | 0 |
Raw evidence samples
Samples are limited to the latest 100 rows. Raw IPs and raw query strings are not stored or shown.
| Timestamp | Verification status | Behavior | Reverse DNS | User agent | Path | Content class | Paywalled | Policy action | Policy reason | Verification reason |
|---|---|---|---|---|---|---|---|---|---|---|
| 2026-06-16 10:04:22.000 | verified | unknown | crawler.openai.com | Mozilla/5.0; compatible; GPTBot/1.3; +https://openai.com/gptbot | /premium/banking-analysis | premium_analysis | Yes | block | Matched policy "Block GPTBot on premium content" by content_class "premium_analysis" and matched vendor "OpenAI", purpose "training"; action "block" applies. | Reverse DNS "crawler.openai.com" matched expected vendor domain "openai.com". |
