Crawler detail
OpenAI / OAI-SearchBot
This view shows what a specific classified crawler accessed, how verification resolved, which content classes were touched, and which policy outcomes were assigned from imported log evidence.
Demo tenant: Demo Publisher · Date range: 2026-05-21 to 2026-06-20
- Total requests
- 7
- Verified requests
- 3
- Likely requests
- 0
- Suspicious requests
- 1
- Unknown verification requests
- 3
- Paywalled requests
- 4
- Premium requests
- 3
- Blocked requests
- 1
- Allowed requests
- 2
- Monitored requests
- 4
Requests over time
| Date | Requests |
|---|---|
| 2026-06-16 | 1 |
Content class breakdown
| Content class | Requests | Paywalled requests |
|---|---|---|
| public_news | 1 | 0 |
Policy action breakdown
| Policy action | Requests |
|---|---|
| allow | 1 |
Verification breakdown
| Verification status | Requests |
|---|---|
| verified | 1 |
Behavior breakdown
| Behavior pattern | Requests |
|---|---|
| unknown | 1 |
Top accessed paths
| Path | Requests | Content class | Paywalled | Top policy action | Suspicious requests |
|---|---|---|---|---|---|
| /markets/nvidia-earnings | 1 | public_news | No | allow | 0 |
Raw evidence samples
Samples are limited to the latest 100 rows. Raw IPs and raw query strings are not stored or shown.
| Timestamp | Verification status | Behavior | Reverse DNS | User agent | Path | Content class | Paywalled | Policy action | Policy reason | Verification reason |
|---|---|---|---|---|---|---|---|---|---|---|
| 2026-06-16 10:06:04.000 | verified | unknown | search.openai.com | Mozilla/5.0; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot | /markets/nvidia-earnings | public_news | No | allow | Matched policy "Allow OAI-SearchBot on public content" by content_class "public_news" and matched vendor "OpenAI", purpose "search"; action "allow" applies. | Reverse DNS "search.openai.com" matched expected vendor domain "openai.com". |