Module prelude

Module prelude 

Source
Expand description

Common spider-middleware re-exports.

Useful when you depend on this crate directly and want the trait plus the built-in middleware types in one import.

Re-exports§

pub use crate::rate_limit::RateLimitMiddleware;
pub use crate::referer::RefererMiddleware;
pub use crate::retry::RetryMiddleware;
pub use crate::autothrottle::AutoThrottleMiddleware;
pub use crate::user_agent::UserAgentMiddleware;
pub use crate::cookies::CookieMiddleware;
pub use crate::http_cache::HttpCacheMiddleware;
pub use crate::proxy::ProxyMiddleware;
pub use crate::robots::RobotsTxtMiddleware;
pub use crate::middleware::Middleware;
pub use crate::middleware::MiddlewareAction;

Structs§

Request
Outgoing HTTP request used by the crawler runtime.
Response
Represents an HTTP response received from a server.