HTTP

Make HTTP requests and crawl pages.

Send HTTP requests with configurable method, headers, body, and authentication. Returns the status code, response headers, and body for use in subsequent steps. Supports template expressions in all fields so URLs, headers, and payloads can be assembled dynamically from prior step outputs.

The crawl component fetches a page and returns its content as markdown, which is the shape an inference step reads best.

Components

Each component links to its own page with its full options and outputs.

NameDescription
http:crawlSearches the web for information via one of the integrated search providers
http:requestPerform HTTP requests using the provided configuration