robotstxt.org
Scanned URL: https://robotstxt.org
31
π SEO Score
4 / 13 checks passed
9
π€ LLM Readiness
1 / 11 checks passed
36
β‘ Performance
4 / 11 checks passed
π Extracted Page Tags
Title Tag
The Web Robots Pages
Meta Description
None found
H1 Heading
None found
Canonical URL
None found
π SEO Audit
31/100β Title Tag
Length: 20 chars (Ideal: 30-60).
β Meta Description
No description found.
β H1 Tag
Found 0 H1 tags. Exactly 1 is recommended.
β Canonical URL
Missing canonical tag.
β Open Graph Tags
Found 0 OG properties (4+ recommended).
β
Indexability
Page allows indexing.
β Mobile Viewport
Missing viewport tag.
β
Image Alt Text
0 of 1 images missing alt.
β Sitemap
No sitemap found in robots.txt.
β Heading Hierarchy
Missing H1 or H2 tags.
β
Internal Links
Found 16 internal links.
β HSTS Security
Missing HSTS header.
β
HTTPS
Loads securely over HTTPS.
π€ LLMO
9/100β Structured Data (JSON-LD)
No JSON-LD found.
β Schema Entities
No schema entities.
β FAQ Schema
Missing FAQ schema.
β Contextual Summary
Description too short for AI context.
β E-E-A-T (Author)
No author meta or schema.
β Organisation Schema
Missing Organization schema.
β Breadcrumb Schema
Missing BreadcrumbList.
β
AI Crawler Access
AI agents not blocked.
β Language Declaration
Missing <html> lang attribute.
β Semantic Structure
No semantic HTML5 wrappers.
β Entity Verification Links
No entity validation links.
β‘ Performance
36/100Network Waterfall (Total: 1298ms)
- DNS: 253ms
- Connect: 336ms
- TTFB: 435ms
- Download: 863ms
β
Time to First Byte (TTFB)
TTFB: 435ms (Target: < 600ms).
β
HTML Payload Size
Raw HTML: 1.5KB (Target: < 150KB).
β
Text Compression
Compression enabled (gzip).
β
Cache Policies
Cache-Control headers set.
β CDN Usage
No CDN headers found.
β Secure Delivery (HTTPS)
Insecure HTTP.
β Modern Protocol
Using HTTP/1.1.
β Native Lazy Loading
No lazy loading detected.
β Minified Assets
No minified assets linked.
β Preload / Preconnect Hints
Missing preload/preconnect hints.
β Character Set
Missing UTF-8 charset.
π‘οΈ Security & Blacklist
Cleanβ
Domain is clean.
β
Spamhaus DBLVerify β
Lookup inconclusive β use the Verify link to check manually.
β
SURBLVerify β
Not listed β no threats detected.
β
URIBLVerify β
Lookup inconclusive β use the Verify link to check manually.
β
Google Safe BrowsingVerify β
No unsafe content found per Google Safe Browsing.
βοΈ Technologies
Advertising
Google Ads
Infrastructure & CDN
Apache
π WHOIS
Registrar
Tucows Domains Inc.
Expires
2026-09-04
Registered
2000-09-04
Last Updated
2026-04-01
Status
active
Name Servers
ns1.mythic-beasts.com, ns2.mythic-beasts.com
π DNS Records
| Type | Value |
|---|---|
| A | 93.93.131.3 |
| MX | mx1.mythic-beasts.com |
| MX | mx2.mythic-beasts.com |
| TXT | google-site-verification=FuTkdKut4zpT5f61O29qfjnWKg3u5iA292tOglYwZuo |
| TXT | v=spf1 include:_spf.mythic-beasts.com ~all |
| NS | ns1.mythic-beasts.com |
| NS | ns2.mythic-beasts.com |