EngineVersion 1crawlClasses

crawl:Page

A scraped web page with markdown content and metadata.

Properties

crawl:markdown (optional, max 1)

The page content converted to markdown.

Page may have at most one markdown body.

crawl:metadata (optional, max 1)

Metadata associated with a scraped page.

Page may have at most one metadata block.

crawl:title (optional, max 1)

The title of a web resource.

Page may have at most one title.

crawl:url (required, max 1)

The URL of a web resource.

Page must have exactly one URL.

On this page