# WebCrawlerAPI MCP

Vendor: WebCrawlerAPI  
Category: other  
Auth: API_KEY  
Composio slug: `webcrawlerapi`

WebCrawlerAPI provides crawling, page scraping, AI web agents, and monitored website feeds through a unified API.

## Tools

- **Create Crawl** — Start a metered asynchronous crawl over a site and return its job ID. The crawl may visit and charge for up to items_limit pages; use GET_CRAWL_JOB to monitor it.
- **Create Feed** — Create a recurring website-change feed. Creation immediately schedules an initial crawl that may consume metered credits, and future scheduled runs may also consume credits; delete the feed when it is no longer needed.
- **Delete Feed** — Permanently cancel a feed so it cannot be resumed. The feed is removed from feed listings, but retained history may remain directly readable for 30 days.
- **Get Crawl Job** — Get a crawl job's status, configuration, per-page results, content URLs, errors, and observed costs. Respect recommended_pull_delay_ms when polling.
- **Get Feed** — Get one feed's configuration, lifecycle status, and recent run history, including per-run crawl counts and cost. Canceled feeds remain directly readable while retained by the provider.
- **Get Organization Costs** — Return current spendable balance plus request count and USD usage for a date range. The connected API key is used for both organization routes.
- **List Feed Changes** — Return one page of detected feed changes as structured JSON, with an opaque continuation cursor for older pages.
- **List Feeds** — List active and paused feeds for the connected organization, newest first. Logically canceled feeds are omitted.
- **Scrape Page** — Scrape one web page synchronously and return requested content or structured extraction. This consumes metered credits; supplying a prompt adds $0.002 per request.
- **Set Feed State** — Pause an active feed's future scheduled runs or resume a paused feed. Pausing does not stop a run that has already started, and resuming schedules future crawls that may consume metered credits.

## Setup

1. Create or open a Switchy Project.
2. Open Integrations and connect WebCrawlerAPI.
3. Authorise through api_key.
4. Teammates can now @-mention WebCrawlerAPI tools in chat.

---
Last verified: 2026-09-03T02:00:04.194Z  
Canonical URL: https://switchy.build/directory/mcps/webcrawlerapi