Open web & SEO data

• 关键词搜索关键词搜索. Returns listeveryinfra.web.search

• Run a browser agentStart an asynchronous browser agent on a URL and have it work toward a natural-language goal.verifiedtinyfish.web.agent.run

• Cancel a browser-agent runStop a pending or running Agent run; completed steps remain billable upstream.verifiedtinyfish.web.agent.run.cancel

• Check a browser-agent runRead an Agent run's state, step count, result, and captured step metadata.verifiedtinyfish.web.agent.run.get

• Retrieve Agent step HTMLRetrieve the HTML captured for one step of a run that requested HTML capture.tinyfish.web.agent.step.html

• Retrieve an Agent step screenshotRetrieve the JPEG screenshot captured for one step of a run that requested screenshots.tinyfish.web.agent.step.screenshot

Anchor text distribution

• Anchor text distribution of backlinks for a domainAnchor-text distribution — backlink and referring-domain counts per anchorverifieddataforseo.web.anchors.list
• Anchor texts in backlinks by domain or URLAnchor-text distribution of inbound links, with domain and page counts per phraseverifiedmoz.web.anchors.list
• Anchor texts in backlinks by domain or URLAnchor texts across a target's backlink profile, with link and domain countsverifiedseranking.web.anchors.list
• Anchor texts in backlinks by domain or URLAnchor texts pointing at a target, with referring-domain and link counts per phrasemajestic.web.anchors.list
• web.anchors.list — routed: best of 3 providers, own keys firstAnchor texts of backlinks pointing at a domain — provider-native rows in `anchors`; `limit` is the price dialparrot.web.anchors.list
• Anchor texts in backlinks by domain or URLAnchor texts across a target's backlink profile, with domain and link countssemrush.web.anchors.list
• Anchor texts in backlinks by domain or URLAnchor texts pointing at a target, with referring-domain and link counts per phraseserpstat.web.anchors.list
• web.anchors.list — routed: best of 3 providers, own keys firstAnchor texts of backlinks pointing at a domain — provider-native rows in `anchors`; `limit` is the price dialtreg.web.anchors.list

Web answers

• Answer a question from the web, prose or JSONAnswers a question or a whole agent prompt (up to 4,000 characters) from the web's current top results, with the pages it drew on. Ask for JSON in the question, or pass a JSON Schema, and the answer is JSON of that shape. answer.source says whether the text is Google's own answer (google_ai_mode, google_ai_overview) or written from the pages (crawl4ai). answered is false, and free, when the pages hold no answer. Experimental: fields may be added.verifiedcrawl4ai.web.answer
• Answer a question with citationsGet an LLM answer to a question informed by Exa search results. Fully compatible with OpenAI's chat completions endpoint.verifiedexa.web.answer
• Research a web questionStart asynchronous multi-source research with citations.verifiedlinkup.web.answer
• Answer a question with live web researchResearch a task on the live web and return a structured answer with sources.verifiedolostep.web.answer
• Answer a web question quicklyProduce a short cited answer with the fast Agent preset.verifiedperplexity.web.answer.fast
• Research and answer a web questionProduce a cited answer with light multi-step research.verifiedperplexity.web.answer.low
• Answer a sourced questionStream a cited answer grounded in Valyu search results.valyu.web.answer
• Answer a web questionReturn a cited answer with the web results used to synthesize it.you.web.answer

• Cancel background researchRequest cancellation, then poll until the run reaches a terminal state.perplexity.web.research.cancel

Web research

• Start background web researchQueue a multi-step research answer and receive a response id for polling or cancellation.perplexity.web.research.medium
• Research a web questionSynthesize a cited web answer at lite or standard research effort.you.web.research
• Start deep web researchQueue deep, exhaustive or frontier research and return a task handle.you.web.research.background

Research task status

• Check a research taskRead the status and result of a research task started by this team.verifiedlinkup.web.answer.status
• Check background researchRetrieve the current state, output and terminal usage of your research run.perplexity.web.research.status
• Check a research taskRead the status and result of a research task started by this team.you.web.research.status

Backlink competitors

• Domains sharing backlink sources with a domainDomains sharing referring domains with the target, ranked by overlapverifieddataforseo.web.backlinks.competitors
• Backlink competitors by domain — shared referring domainsDomains whose backlink profile overlaps a target's, by shared referring domainssemrush.web.backlinks.competitors

• Competitor link gapsSources that link to the given competitors but not to you — link-gap prospectingverifiedmoz.web.backlinks.intersect

Backlink list

• Backlinks pointing to a domain or URL — anchor, rankIndividual backlinks — source page, anchor, follow status, first seen, page/domain rankverifieddataforseo.web.backlinks.list
• Backlinks by domain or URL — source and target metricsIndividual inbound links, with full URL metrics for both source and targetverifiedmoz.web.backlinks.list
• Backlinks by domain or URL — source page, anchor textsIndividual backlinks to a domain or URL, with source page, anchor and follow statusverifiedseranking.web.backlinks.list
• Backlinks by domain or URL — anchor texts, Trust FlowIndividual backlinks to a URL or domain, with anchor text and both ends' Trust Flowmajestic.web.backlinks.list
• web.backlinks.list — routed: best of 3 providers, own keys firstBacklinks pointing at a domain or page — provider-native backlink rows in `backlinks`; `limit` is the price dialparrot.web.backlinks.list
• Backlinks by domain or URL — source page, anchor textsIndividual backlinks to a domain or URL, with source page, anchor and follow statussemrush.web.backlinks.list
• Active backlinks by domain or URL — anchor textsCurrently active backlinks to a domain or URL, with source page, anchor and link typeserpstat.web.backlinks.list
• web.backlinks.list — routed: best of 3 providers, own keys firstBacklinks pointing at a domain or page — provider-native backlink rows in `backlinks`; `limit` is the price dialtreg.web.backlinks.list

• Check referring sitesCheck whether specific sources link to a target — returns one boolean per sourceverifiedmoz.web.backlinks.status

Backlink summary

• Backlink profile of a domain — counts, rank, spam scoreAggregate backlink profile of a domain or URL — counts, rank, spam score, breakdownsverifieddataforseo.web.backlinks.summary
• Backlinks summary by domain — authority, spam histogramsAggregate backlink profile plus histograms by DA, spam score and root domainsverifiedmoz.web.backlinks.summary
• Backlinks summary by domain or URL — referring domainsAggregate backlink profile — backlinks, referring domains, IPs, subnets, follow splitverifiedseranking.web.backlinks.summary
• Backlinks summary by domain — referring domains, .edu/.govAggregate backlink profile of a domain — external links, referring domains, .edu/.govmajestic.web.backlinks.summary
• web.backlinks.summary — routed: best of 3 providers, own keys firstBacklink profile summary for a domain — counts in `backlinks` / `referring_domains`, the provider's full row in `summary`parrot.web.backlinks.summary
• Backlinks summary by domain or URL — Authority ScoreAggregate backlink profile — Authority Score, links, referring domains, follow splitsemrush.web.backlinks.summary
• Backlinks summary by domain — referring domains, authorityAggregate backlink profile — external links, referring domains, IPs, domain authorityserpstat.web.backlinks.summary
• web.backlinks.summary — routed: best of 3 providers, own keys firstBacklink profile summary for a domain — counts in `backlinks` / `referring_domains`, the provider's full row in `summary`treg.web.backlinks.summary

Website crawl

• Website CrawlCrawl a website and get clean text content from up to 10 pages in one normalized response, ideal for feeding sites into LLMs and search indexes.verifiedanyapi.web.crawl
• Crawl a websiteReturn Markdown from a bounded crawl of linked pages.verifiedbranddev.web.crawl
• Crawl a whole site as a background jobCrawls one site level by level from a start URL, inside the site, through include and exclude filters, cut at max_pages; runs only as a job. Poll it with crawl4ai.web.scrape.job.status and read the pages (url, level, title, status, links, markdown or html) with crawl4ai.web.scrape.job.results.verifiedcrawl4ai.web.crawl
• Crawl a websiteStart a bounded crawl and pay for pages processed.verifiedfirecrawl.web.crawl
• Crawl a websiteStart a bounded asynchronous website crawl and pay only for completed pages.verifiedolostep.web.crawl
• Crawl one web page asynchronouslyStart a bounded one-page Markdown crawl and return its job id.verifiedscrapegraphai.web.crawl
• Crawl a website asynchronouslyStart a site crawl and later retrieve its ZIP URL from task status.verifiedsearch1api.web.deepcrawl
• Crawl a websiteFollow links from a starting URL and return a bounded set of pages.verifiedspidercloud.web.crawl
• Crawl a websiteMap a website and extract clean content from the discovered pages in one request.verifiedtavily.web.crawl

Crawl pages

• Retrieve website crawl pagesList an owned crawl's pages, optionally including Markdown or HTML content.verifiedolostep.web.crawl.results
• Retrieve ScrapeGraphAI crawl pagesFetch owned crawl pages with each page's resolved scrape result.verifiedscrapegraphai.web.crawl.pages

Website crawl status

• Check a website crawlRead an owned crawl's status, result pages and credit usage.verifiedfirecrawl.web.crawl.status
• Check a website crawlRead an owned crawl's progress, completed-page count and terminal credit usage.verifiedolostep.web.crawl.status
• Check a ScrapeGraphAI crawlRead an owned crawl's state and lightweight page metadata.verifiedscrapegraphai.web.crawl.status
• Check a site crawlRead the state and ZIP URL of this team's deepcrawl task.verifiedsearch1api.web.deepcrawl.status

• Check email domain statusDomain → two booleans: whether it is a disposable/throwaway mail host and whether it is a free webmail provider — the cheap pre-filter before signup or lead acceptanceverifiedtomba.web.domain.disposable

Page extraction

• Web ScrapeScrape any web page and get its content back as clean Markdown (or HTML, or raw HTML) plus title and metadata.verifiedanyapi.web.scrape
• Scrape a web pageReturn one page as Markdown, HTML, images or a screenshot.verifiedbranddev.web.scrape
• Scrape or crawl a web page to clean Markdown for LLMsScrape one URL, a web page or a PDF, into clean, LLM-ready Markdown text and/or HTML. Crawl4AI picks the cheapest engine that works (archive, plain fetch, real browser that renders JavaScript), with optional links, media, metadata and tables; proxies for sites that block datacenters.verifiedcrawl4ai.web.scrape
• Get page contents by URLGet the full page contents, summaries, and metadata for a list of URLs.verifiedexa.web.contents.get
• Scrape a web pageFetch one page as Markdown, HTML or links.verifiedfirecrawl.web.scrape
• Fetch page contentFetch an indexed or live webpage as Markdown, optionally reduced by an extraction instruction.verifiedkeenable.web.fetch
• Extract web pagesExtract clean Markdown content, metadata, links, and images from up to ten URLs.verifiedlimadata.web.extract
• Fetch a web pageRetrieve clean Markdown from a public HTML or PDF URL.verifiedlinkup.web.fetch
• Fetch rendered web contentFetch a public HTTP(S) page and return LLM-ready contentverifiedlitescrape.web.fetch
• Scrape a web pageFetch one page as clean Markdown, HTML, text or a hosted screenshot.verifiedolostep.web.scrape
• Extract web pagesReturn focused excerpts or full Markdown content from up to 20 public URLs.verifiedparallel.web.extract
• Extract structured data from one pageFetch one public HTML page and use a natural-language prompt to return structured JSON.verifiedscrapegraphai.web.extract
• Scrape one web page as MarkdownFetch one public HTML page and return clean Markdown.verifiedscrapegraphai.web.scrape
• Read a web pageReturn clean text and metadata from one public URL.verifiedsearch1api.web.crawl
• Extract a web pageFetch one public web page and return clean text plus optional Markdown, links, images, videos, and metadata.verifiedserper.web.extract
• Scrape a web pageFetch a specified page as Markdown, text, or raw HTML.verifiedspidercloud.web.scrape
• Extract web pagesExtract clean content from one to twenty URLs, with optional query-focused chunks and images.verifiedtavily.web.extract
• Fetch clean page contentFetch up to ten URLs as Markdown, HTML, or structured JSON, with optional links, metadata, and selectors.verifiedtinyfish.web.fetch
• Extract page contentRetrieve Markdown, HTML or metadata for up to ten public URLs.verifiedyou.web.contents
• Fetch a web page as MarkdownFetch one page and return its title plus the whole body as Markdown.deepseek.web.fetch
• Extract pages by URL — content and classificationExtract clean content or highlights from up to twenty URLs, with per-URL status and mode.octen.web.extract
• web.extract — routed: best of 15 providers, own keys firstExtract clean content from one web page — provider-native rows in `pages`parrot.web.extract
• web.extract — routed: best of 15 providers, own keys firstExtract clean content from one web page — provider-native rows in `pages`treg.web.extract
• Extract a web pageReturn clean content from one public URL.valyu.web.contents

• Web extraction with browser optionsFetch a public HTTP(S) page and return LLM-ready contentverifiedlitescrape.web.fetch.post

Batch extraction

• Scrape or crawl a list of URLs in one batch, streamedScrape up to 25 URLs in one call; results stream back as NDJSON, one line per URL as it finishes, then one summary line with the batch's total cost.verifiedcrawl4ai.web.extract.batch
• Extract a batch of pagesStart a bounded batch scrape of up to ten URLs.verifiedfirecrawl.web.batch-scrape

• Check a batch scrapeRead an owned batch's status, result pages and credit usage.verifiedfirecrawl.web.batch-scrape.status

• Price a scrape before running itThe credit range a scrape of one URL (or a list) would cost, from Crawl4AI's own effort model. Free.verifiedcrawl4ai.web.extract.estimate

Structured extraction

• Extract structured JSON data from a web page with an LLMScrape a page (crawled for you) or read your own content, and return typed JSON matching a JSON schema and/or a plain-English instruction, extracted by an LLM.verifiedcrawl4ai.web.extract.structured
• Extract structured data from a web pageFetch a page and extract typed JSON with a supplied schema.verifiedlinkup.web.fetch.structured
• Extract structured page dataExtract fields from a public page using a prompt and JSON Schema.verifiedsearch1api.web.extract.structured
• web.extract.structured — routed: best of 3 providers, own keys firstExtract typed JSON from one web page, described by a JSON schema and/or a plain-English instruction — the extracted data in `data`parrot.web.extract.structured
• web.extract.structured — routed: best of 3 providers, own keys firstExtract typed JSON from one web page, described by a JSON schema and/or a plain-English instruction — the extracted data in `data`treg.web.extract.structured

• Any RSS or Atom feedThe items of any RSS 2.0 or Atom feed: title, link, publication time, author, the first 300 characters of the summary, and the item's id. Give the feed's `url`; `limit` caps the rows (up to 200). Columns: title, link, published, author, summary, id.verifiedcrawl4ai.web.feed.read

• Top linked domainsMost-linked root domains on the web, with DA and spam score (index-wide, no target)verifiedmoz.web.global.top_domains

• Top linked pagesMost-linked pages on the web, with full URL metrics (index-wide, takes no target)verifiedmoz.web.global.top_pages

• Moz link index versionWhich Moz link index is serving results — tells you if metrics moved on a refreshverifiedmoz.web.index.metadata

Linking domains

• Referring domains for a domain or URL — counts, rankReferring domains linking to a target, with backlink counts, rank and first/last seenverifieddataforseo.web.linking_domains.list
• Referring domains by domain or URL — authority, spamRoot domains linking to a target, with each source's DA, spam score and link countsverifiedmoz.web.linking_domains.list
• Referring domains by domain or URL — authority, link countsReferring domains linking to a target, with each source's link count and authorityverifiedseranking.web.linking_domains.list
• Referring domains by domain — Trust Flow, country, IPReferring domains linking to a target, with Trust Flow, country, IP and link countmajestic.web.linking_domains.list
• Referring domains by domain or URL — Authority ScoreReferring domains linking to a target, with Authority Score, country and link countsemrush.web.linking_domains.list
• Referring domains by domain — authority, link countsReferring domains linking to a target, with each source's link count and authorityserpstat.web.linking_domains.list

Site URL map

• Web MapMap an entire website into a clean list of its URLs (with titles and descriptions) in a single call.verifiedanyapi.web.map
• Map a websiteDiscover bounded lists of URLs on a domain without fetching page bodies.verifiedbranddev.web.map
• List every URL of a site without crawling itA site's URLs from the sources that already know them: its sitemaps, the links on its home page and the newest Common Crawl indexes (mode full adds the Wayback Machine). One call, 1 to 3 seconds for most sites. Each row: url, sources, last_seen, depth.verifiedcrawl4ai.web.map
• Map a websiteDiscover URLs on a website without scraping their content.verifiedfirecrawl.web.map
• Find relevant URLs on a websiteMap a site and return at most 1,000 URLs ranked for a search query.verifiedolostep.web.map.search
• Discover site URLsList URLs from a site's sitemap or discovered links.verifiedsearch1api.web.sitemap
• Discover website linksFind URLs on a website without returning full page bodies.verifiedspidercloud.web.links
• Map a websiteDiscover URLs from a website with depth, breadth, path and domain controls.verifiedtavily.web.map
• web.map — routed: best of 6 providers, own keys firstDiscover the URLs on a website — provider-native map rows in `results`parrot.web.map
• web.map — routed: best of 6 providers, own keys firstDiscover the URLs on a website — provider-native map rows in `results`treg.web.map

web.monitor.activity

• Read page-monitor activityRead recent ticks, completion states and per-format change diffs.verifiedscrapegraphai.web.monitor.activity
• A page monitor's timelineEvery change one monitor saw, matched or not (matched: [] shows why you got no alert), and its health events, oldest first. Marks nothing read.crawl4ai.watch.events

• Buy a watch budget for your team's monitorsAdd Crawl4AI credits to your team's watch budget. You choose the amount; it is charged once, now, and your monitors run until it is used, then pause by themselves. Send your own purchase id as ref: a retry with the same ref adds nothing and charges nothing.crawl4ai.watch.budget.add

• Watch budget left for your teamYour team's watch budget: credit_limit (all you bought), spent, and state (running, or paused when the budget is used up).crawl4ai.watch.budget.get

• Read your watched changesNew changes from all your team's monitors, oldest first, each with a one-line summary and typed facts (before and after values, with links to both page versions). Reading marks them read. wait (up to 60 s) holds the call open until a change arrives.crawl4ai.watch.changes

web.monitor.create

• Create a scheduled page monitorSchedule recurring page captures and change detection on the connected account.verifiedscrapegraphai.web.monitor.create
• Watch a page: describe the change to reportSay in plain words what you care about, for example "tell me when a plan gets more expensive", "a new job in Berlin" or "back in stock". The monitor turns your sentence into conditions, ignores every change that does not match (layout, dates, banners), and reports only matching changes as facts: what changed, from what, to what, with both versions of the page. Numbers work too: "the Business plan costs more than $250". On treg's key it runs from your team's watch budget (crawl4ai.watch.budget.add).crawl4ai.watch.create

web.monitor.delete

• Delete a page monitorPermanently remove a monitor and its stored tick history.verifiedscrapegraphai.web.monitor.delete
• Stop watching a pageRemove one of your monitors and its history. To keep it for later, pause it with crawl4ai.watch.update instead.crawl4ai.watch.delete

web.monitor.get

• Get one page monitorRead one monitor's status, schedule and capture configuration.verifiedscrapegraphai.web.monitor.get
• One page monitorOne of your monitors: its conditions, health, baseline, last check, and who paused it (you, its expiry, or the budget).crawl4ai.watch.get

web.monitor.list

• List page monitorsList every scheduled monitor on the connected account.verifiedscrapegraphai.web.monitor.list
• Your team's page monitorsAll of your team's monitors, newest first, with each one's sentence as Crawl4AI understood it (conditions), health and last check.crawl4ai.watch.list

• Pause a page monitorStop future ticks while preserving the monitor and its activity.verifiedscrapegraphai.web.monitor.pause

• Resume a page monitorPut a paused monitor back on its saved schedule.verifiedscrapegraphai.web.monitor.resume

web.monitor.update

• Update a page monitorChange a monitor's URL, name, schedule, formats, webhook or fetch configuration.verifiedscrapegraphai.web.monitor.update
• Change a page monitorChange one of your monitors: its sentence (read again into new conditions), every, notify (replaced whole), schema, name, expires_at, or paused true/false.crawl4ai.watch.update

• A page as a monitor saw itOne version of a watched page as Markdown: the evidence behind a change (its before and after links point here).crawl4ai.watch.version

• On-page auditCrawl one URL on demand — status code, load timings, on-page score, meta and contentverifieddataforseo.web.page.audit

• Research the webRetrieve and synthesize web context for a natural-language question.verifiedlimadata.web.research

Download scrape results

• Download an Apify run's results by dataset idDownload the results of a finished scraper runverifiedapify.web.scrape.job.results
• Download scraped records by snapshot idDownload the records produced by a finished scraping jobverifiedbrightdata.web.scrape.job.results
• Read a scrape job's resultsAn owned job's results as NDJSON, one line per URL, 500 per page.verifiedcrawl4ai.web.scrape.job.results
• Download a bulk extract job's results as JSON or CSVDownloads the extracted results of a bulk job as JSON or CSV, or a diagnostic URL reportdiffbot.x.bulk-data
• Download a crawl job's results as JSON or CSVDownloads the extracted results of a crawl job as JSON or CSV, or a diagnostic URL reportdiffbot.x.crawl-data

Start scrape job

• Start an Apify actor run in the backgroundStart a scraper run in the background and get back its run idverifiedapify.web.scrape.job.start
• Start a batch scrapeStart an asynchronous scraping job over a batch of URLs and get a snapshot id backverifiedbrightdata.web.scrape.job.start
• Crawl many URLs as a background scrape jobSubmit up to 500 URLs as a background job; poll its status, then read the results. Nothing waits on a slow page.verifiedcrawl4ai.web.scrape.job.start
• Start a bulk extract job from a list of URLsSends a large, explicit list of URLs through an Extract API asynchronously and compiles the results into one collection — unlike Crawl, it does not discover linksdiffbot.x.bulk-create
• Start a site crawl job from seed URLsSpiders a site for links and pages, running each discovered page through an Extract API and compiling results into a searchable collectiondiffbot.x.crawl-create

Scrape job status

• Check an Apify actor run by run idCheck whether a background scraper run has finishedverifiedapify.web.scrape.job.status
• Check an async scrape job by snapshot idCheck whether an asynchronous scraping job has finishedverifiedbrightdata.web.scrape.job.status
• Check a scrape jobAn owned job's status, per-status counts and credit usage.verifiedcrawl4ai.web.scrape.job.status
• Manage a crawl jobOne endpoint for status, pause/resume, restart and delete of one or more crawl jobsverifieddiffbot.x.crawl-manage

Structured scraping

• Scrape URLs into structured records in one callScrape one or more URLs into structured records and get them back in the same callverifiedbrightdata.web.scrape.structured
• Auto-detect a page type and extract it by URLAutomatically identifies the type of page being processed and routes it through the relevant Diffbot APIverifieddiffbot.x.extract-analyze

Page screenshots

• Website ScreenshotCapture a real-browser screenshot of any web page URL.verifiedanyapi.web.screenshot
• Capture a web page screenshotCapture a public HTTP(S) page as a PNGverifiedlitescrape.web.screenshot
• Capture a web page screenshotRender a page and return a base64 PNG screenshot.verifiedspidercloud.web.screenshot
• Full-page screenshot of any URLUsing this endpoint, you can capture a full high-quality screenshot of any webpage.dataforseo.x.on-page-page-screenshot
• Capture a web pageRender one public URL as PNG, JPEG or WebP binary image data.search1api.web.screenshot

• Screenshot with browser optionsCapture a public HTTP(S) page as a PNGverifiedlitescrape.web.screenshot.post

• Download a captured screenshotDownload the PNG referenced by screenshot_url using the connected keylitescrape.web.screenshot.download

Web search

• Search the open webFind ranked web pages by query, with optional domain filters.verifiedbranddev.web.search
• Search the web: live ranked results with title, URL, snippetLive web search across several engines, ranked and cleaned: each result has a title, URL and snippet. When the live web returns fewer than 10 results, results from the Crawl4AI index fill the list. For follow-up questions, related queries and an entity card, use crawl4ai.web.search.rich.verifiedcrawl4ai.web.search
• Search the web with rich resultsWeb search plus a rich block: follow-up questions, related queries, an entity card, videos, news and discussions.verifiedcrawl4ai.web.search.rich
• Web search shaped for an LLM context windowSearch the web and return results shaped for feeding into an LLM context windowverifieddiffbot.x.web-search
• Search the webThe search endpoint lets you intelligently search the web and extract contents from the results.verifiedexa.web.search
• Search the open webFind up to ten web results without scraping their full pages.verifiedfirecrawl.web.search
• Search the open webSearch Keenable's web index with site, publication, acquisition and point-in-time filters.verifiedkeenable.web.search
• Search the open webReturn ranked sources, a sourced answer, or structured JSON from a web query.verifiedlinkup.web.search
• Search the web by query — ranked pages and highlightsSearch the live web for ranked pages, highlights, and optional full page content.verifiedocten.web.search
• Search the open webSearch the web with a natural-language query and domain filters.verifiedolostep.web.search
• Search the web fastReturn ranked pages with query-focused excerpts in turbo or fast mode.verifiedparallel.web.search
• Search the web in depthReturn ranked pages with query-focused excerpts in basic or advanced mode.verifiedparallel.web.search.advanced
• Search the webReturn ranked web pages and extracted snippets for one query.verifiedperplexity.web.search
• Search the web quicklyReturn lower-latency web results for everyday lookup and agent workflows.verifiedperplexity.web.search.fast
• Search the web with fetched page contentSearch the web and return the top HTML pages with Markdown content inline.verifiedscrapegraphai.web.search
• Search the web and extract a structured answerSearch HTML pages, return their Markdown, and run one AI extraction across the results.verifiedscrapegraphai.web.search.extract
• Search the live webReturn ranked web results from one or more search engines.verifiedsearch1api.web.search
• Search the open web with GoogleSearch Google and return organic results plus answer boxes, knowledge panels, related questions, and related searches when present.verifiedserper.web.search
• Search the open webReturn ranked web results without fetching their full pages.verifiedspidercloud.web.search
• Search the open webSearch the web with semantic ranking, optional answers, domain and date filters, images, and page content.verifiedtavily.web.search
• Search the open webSearch the web by keyword or meaning, with domain, language, location, and date filters.verifiedtinyfish.web.search
• Search the web and newsReturn ranked web and news results with snippets and metadata.verifiedyou.web.search
• Search the webSearch the live web with DeepSeek's own search engine — ranked results carrying a rerank score, a summary for the model, an optional page body, publish date and site authority.deepseek.web.search
• web.search — routed: best of 19 providers, own keys firstSearch the open web — provider-native result rows in `results`parrot.web.search
• Search with full page contentSearch the web and crawl selected result pages.search1api.web.search.crawl
• web.search — routed: best of 19 providers, own keys firstSearch the open web — provider-native result rows in `results`treg.web.search
• Search the open webReturn ranked live web results.valyu.web.search
• Search with cached page textReturn full-page content from You.com's cache when available.you.web.search.full_page.cache
• Search with live page textReturn full-page content, fetching live pages when requested.you.web.search.full_page.live
• Search with page highlightsReturn query-focused passages alongside ranked web and news results.you.web.search.highlights

• Multi-angle web searchGenerate subqueries from a question and return ranked web results grouped by subquery.octen.web.search.broad

• Deep web searchThe search endpoint lets you intelligently search the web and extract contents from the results.verifiedexa.web.search.deep

News search

• Search news by topicThe search endpoint lets you intelligently search the web and extract contents from the results.verifiedexa.web.search.news
• Search recent newsReturn ranked news coverage from one or more sources.verifiedsearch1api.web.news
• Search recent newsSearch news articles with Tavily's news topic.verifiedtavily.web.search.news
• Search recent newsSearch TinyFish's news index with optional recency, date, domain, language, and location filters.verifiedtinyfish.web.search.news
• Search news by query — articles and subjectsSearch recent news articles and related subject groups.octen.web.search.news
• web.search.news — routed: best of 4 providers, own keys firstSearch recent news — provider-native article rows in `results`parrot.web.search.news
• Search news with full page contentFind news and crawl selected result pages.search1api.web.news.crawl
• web.search.news — routed: best of 4 providers, own keys firstSearch recent news — provider-native article rows in `results`treg.web.search.news

web.search.publications

• Search research publicationsThe search endpoint lets you intelligently search the web and extract contents from the results.verifiedexa.web.search.publications
• Search research publicationsSearch research papers by topic, publication year, domain, language, and date.verifiedtinyfish.web.search.publications
• web.search.publications — routed: best of 2 providers, own keys firstSearch research publications by topic — provider-native paper rows in `results`parrot.web.search.publications
• web.search.publications — routed: best of 2 providers, own keys firstSearch research publications by topic — provider-native paper rows in `results`treg.web.search.publications

• Find pages similar to a URLFind similar links to the link provided and optionally return the contents of the pages.verifiedexa.web.similar

Top pages

• Highest-authority pages by domain, with URL metricsHighest-authority pages of a domain, with full URL metrics per pageverifiedmoz.web.site.top_pages
• Most-linked pages by domain — backlinks, Trust FlowA site's most-linked pages, with Trust Flow, Citation Flow and backlink countsmajestic.web.site.top_pages
• Most-linked pages by domain — backlinks, referring domainsList a site's most-linked-to pages, ranked by backlinks and referring domainsserpstat.web.site.top_pages

• Find trending developer topicsRead current GitHub or Hacker News trends.verifiedsearch1api.web.trending

• Unblock and fetch a pageFetch content from a page that resists ordinary scraping.verifiedspidercloud.web.unblock

URL authority metrics

• Backlink authority rank for up to 1000 domains or URLsBacklink-derived authority rank (0-1000) for up to 1000 domains or pages per callverifieddataforseo.web.url.metrics
• Domain Authority, Page Authority and Spam Score by URLDomain Authority, Page Authority, Spam Score and link counts for up to 50 URLsverifiedmoz.web.url.metrics
• Page and domain authority scores by domain or URLGet SE Ranking's page and domain authority scores for a URL or domainverifiedseranking.web.url.metrics
• Trust Flow and Citation Flow by domain or URLTrust Flow, Citation Flow and link counts for up to 100 URLs or domains per callmajestic.web.url.metrics
• web.url.metrics — routed: best of 3 providers, own keys firstAuthority / link metrics for one URL or domain — the provider's own metrics row in `metrics`parrot.web.url.metrics
• web.url.metrics — routed: best of 3 providers, own keys firstAuthority / link metrics for one URL or domain — the provider's own metrics row in `metrics`treg.web.url.metrics

Account and utility endpoints

• Available Lighthouse checksThe OnPage Lighthouse API is based on Google’s open-source Lighthouse project and provides data on the quality of web pages.dataforseo.x.on-page-lighthouse-audits
• Backlink changes over timeThis endpoint will provide you with the number of new and lost backlinks and referring domains for the domain specified in the target field.verifieddataforseo.x.backlinks-timeseries-new-lost-summary-live
• Backlink historyThis endpoint will provide you with historical backlinks data back to the beginning of 2019.verifieddataforseo.x.backlinks-history-live
• Backlink index totalsThis endpoint will provide you with the total number of backlinks, domains, and pages our database contains for the moment when you make a request.dataforseo.x.backlinks-index
• Backlink totals by dateThis endpoint will provide you with an overview of backlink data for the target domain available during a period between the two indicated dates.verifieddataforseo.x.backlinks-timeseries-summary-live
• Bulk backlink changesThis endpoint will provide you with the number of new and lost backlinks for the domains, subdomains, and pages specified in the targets array.verifieddataforseo.x.backlinks-bulk-new-lost-backlinks-live
• Bulk backlink countsThis endpoint will provide you with the number of backlinks pointing to domains, subdomains, and pages specified in the targets array.verifieddataforseo.x.backlinks-bulk-backlinks-live
• Bulk backlink spam scoresThis endpoint will provide you with spam scores of the domains, subdomains, and pages you specified in the targets array.verifieddataforseo.x.backlinks-bulk-spam-score-live
• Bulk backlink summariesThis endpoint will provide you with a comprehensive overview of backlinks and related data for a bulk of up to 1000 pages, domains, or subdomains.verifieddataforseo.x.backlinks-bulk-pages-summary-live
• Bulk clickstream volumeThe Bulk Clickstream Search Volume endpoint of DataForSEO Keywords Data API is designed to provide clickstream-based search volume data for up to 1000 keywords in a single Live request.verifieddataforseo.x.keywords-data-clickstream-data-bulk-search-volume-live
• Bulk referring-domain changesThis endpoint will provide you with the number of referring domains pointing to the domains, subdomains and pages specified in the targets array.verifieddataforseo.x.backlinks-bulk-new-lost-referring-domains-live
• Bulk referring-domain countsThis endpoint will provide you with the number of referring domains pointing to domains, subdomains, and pages specified in the targets array.verifieddataforseo.x.backlinks-bulk-referring-domains-live
• Business listings by categoryBusiness Listings Categories Aggregation endpoint provides results containing information about groups of related categories along with the number of entities in each category.verifieddataforseo.x.business-data-business-listings-categories-aggregation-live
• Citation ratings by keywordThis endpoint will provide you with rating distribution data for the keyword and other parameters specified in the request.verifieddataforseo.x.content-analysis-rating-distribution-live
• Citation sentiment by keywordThis endpoint will provide you with sentiment analysis data for the citations available for the target keyword.verifieddataforseo.x.content-analysis-sentiment-analysis-live
• Citation trends by categoryThis endpoint will provide you with data on all citations in the target category for the indicated date range.verifieddataforseo.x.content-analysis-category-trends-live
• Citation trends by keywordThis endpoint will provide you with data on all citations of the target keyword for the indicated date range.verifieddataforseo.x.content-analysis-phrase-trends-live
• Combined keyword trendsThis endpoint will provide you with the keyword popularity data from DataForSEO Trends.verifieddataforseo.x.keywords-data-dataforseo-trends-merged-data-live
• Crawl linksThis endpoint will provide you with a list of internal and external links detected on a target website.dataforseo.x.on-page-links
• Crawl resourcesThis endpoint will provide you with a list of resources, including images, scripts, stylesheets, and broken elements.dataforseo.x.on-page-resources
• Crawled page HTMLThis endpoint returns the HTML of a page you indicate in the request.dataforseo.x.on-page-raw-html
• Crawled page checksThis endpoint returns a list of crawled pages with on-page check-ups and other metrics related to the page performance.dataforseo.x.on-page-pages
• Diffbot plan and usageRetrieves account plan tier, monthly credit allowance, token status, child tokens and a daily usage breakdown by APIverifieddiffbot.x.account
• Duplicate page contentThis endpoint returns a list of pages that have content similar to the page specified in the request.dataforseo.x.on-page-duplicate-content
• Duplicate title or meta tagsThis endpoint returns a list of pages that contain duplicate title or description tags.dataforseo.x.on-page-duplicate-tags
• Extract article textExtracts clean article text, author, date, images, tags, sentiment and NLP facts from a news or blog pageverifieddiffbot.x.extract-article
• Extract entities and sentimentRuns a pre-trained classifier, named-entity recognizer, sentence tokenizer and sentiment analyzer over submitted text or a URLverifieddiffbot.x.nl-process
• Extract event detailsExtracts event name, date, venue, price and organizer from an event listing pageverifieddiffbot.x.extract-event
• Extract forum discussionExtracts individual posts, authors, dates and sentiment from a forum thread or comment sectionverifieddiffbot.x.extract-discussion
• Extract index-page linksExtracts the list of linked items (with titles, dates, images) from an index or category pageverifieddiffbot.x.extract-list
• Extract job postingExtracts job title, employer, location, salary and description from a job posting pageverifieddiffbot.x.extract-job
• Extract page imagesExtracts the primary and secondary images from a page, with dimensions and metadataverifieddiffbot.x.extract-image
• Extract product detailsExtracts product name, price, SKU, images, specs and reviews from an e-commerce pageverifieddiffbot.x.extract-product
• Extract video page detailsExtracts title, embed/player URL, duration, thumbnail and metadata from a video pageverifieddiffbot.x.extract-video
• Find domains by HTML termsThis endpoint provides domains based on the HTML terms they use on their homepage.verifieddataforseo.x.domain-analytics-technologies-domains-by-html-terms-live
• Find domains by technologyThis endpoint provides domains based on the technology they use.verifieddataforseo.x.domain-analytics-technologies-domains-by-technology-live
• Global clickstream volumeThe Clickstream Global Search Volume endpoint of DataForSEO Keywords Data API is designed to provide clickstream-based search volume data for up to 1000 keywords in a single Live request.verifieddataforseo.x.keywords-data-clickstream-data-global-search-volume-live
• IP location and companyEnrich data on an IP by performing a one-to-one match of this IP with the nearly 2 Billion IPs hosted in our dataset, returning location, company, and metadataverifiedpdl.x.ip-enrich
• Keyword citation overviewThis endpoint will provide you with an overview of citation data available for the target keyword.verifieddataforseo.x.content-analysis-summary-live
• Keyword search volumeClickstreamDataDataforseoSearchVolumeLiveverifieddataforseo.x.keywords-data-clickstream-data-dataforseo-search-volume-live
• Keyword trend location codesYou will receive the list of DataForSEO Trends locations by calling this API.dataforseo.x.keywords-data-dataforseo-trends-locations-country
• Keyword trends by age and genderThis endpoint will provide you with the demographic breakdown (by age and gender) of keyword popularity per each specified term based on DataForSEO Trends data.verifieddataforseo.x.keywords-data-dataforseo-trends-demography-live
• Keyword trends by regionThis endpoint will provide you with location-specific keyword popularity data from DataForSEO Trends.verifieddataforseo.x.keywords-data-dataforseo-trends-subregion-interests-live
• Lighthouse page auditThe OnPage Lighthouse API is based on Google’s open-source Lighthouse project for measuring the quality of web pages and web apps.dataforseo.x.on-page-lighthouse-live-json
• Non-indexable pagesThis endpoint returns a list of pages that are blocked from being indexed by Google and other search engines through robots.txt, HTTP headers, or meta tags settings.dataforseo.x.on-page-non-indexable
• Page backlink summariesThis endpoint will provide you with detailed summary data on all backlinks and related metrics for each page of the target domain or subdomain you specify.verifieddataforseo.x.backlinks-domain-pages-summary-live
• Page keyword densityThis endpoint will provide you with keyword density and keyword frequency data for terms appearing on the specified website or web page.dataforseo.x.on-page-keyword-density
• Page load waterfallThis endpoint is designed to provide you with the page speed insights.dataforseo.x.on-page-waterfall
• Pages using a resourceThis endpoint will return the list of pages where a specific resource is located.dataforseo.x.on-page-pages-by-resource
• Pages with backlinksThis endpoint will provide you with a detailed overview of domain pages with backlink data for each page.verifieddataforseo.x.backlinks-domain-pages-live
• Parse a shared video URLHybrid: video dataverifiedtikhub.x.hybrid-video-data
• Parse crawled page contentThis endpoint allows parsing the content on any page you specify and will return the structured content of the target page, including link URLs, anchors, headings, and textual content.verifieddataforseo.x.on-page-content-parsing
• Parse live page contentThis endpoint allows parsing the content on any page you specify and will return the structured content of the target page, including link URLs, anchors, headings, and textual content.dataforseo.x.on-page-content-parsing-live
• Redirect chainsRedirect chains occur when there are at least two redirects between the initial URL and the destination URL.dataforseo.x.on-page-redirect-chains
• Referring IPs and networksThis endpoint will provide you with a detailed overview of referring IPs and subnets pointing to the target you specify.verifieddataforseo.x.backlinks-referring-networks-live
• Related website technologiesThe Aggregation Technologies endpoint will provide you with a list of the most popular technologies websites use alongside the technologies you specify.verifieddataforseo.x.domain-analytics-technologies-aggregation-technologies-live
• Search Chinese news and socialSearches recent content across news, Weibo, WeChat, Zhihu, Douyin, Xiaohongshu, Bilibili, and Kuaishou with source and time filters.justoneapi.x.search-v1
• Search Google Maps businessesBusiness Listings Search API provides results containing information about business entities listed on Google Maps in the specified categories.verifieddataforseo.x.business-data-business-listings-search-live
• Search keyword citationsThis endpoint will provide you with detailed citation data available for the target keyword.verifieddataforseo.x.content-analysis-search-live
• Shared referring domainsThis endpoint will provide you with the list of domains pointing to the specified websites.verifieddataforseo.x.backlinks-domain-intersection-live
• Shared referring pagesThis endpoint will provide you with the list of referring pages pointing to the specified targets.verifieddataforseo.x.backlinks-page-intersection-live
• Site audit summaryUsing this function, you can get the overall information on a website as well as drill down into exact on-page issues of a website that has been scanned.dataforseo.x.on-page-summary-id
• Start a site audit crawlOnPage API checks websites for 60+ customizable on-page parameters defines and displays all found flaws and opportunities for optimization so that you can easily fix them.verifieddataforseo.x.on-page-task-post
• Technology counts by regionThe Technologies Summary endpoint will provide you with the number of domains across different countries and languages that use the specified technology names, technology groups, or technology categories.verifieddataforseo.x.domain-analytics-technologies-technologies-summary-live
• Technology domain counts over timeThe Technology Stats endpoint will provide you with historical data on the number of domains across different countries and languages that use the specified technology.verifieddataforseo.x.domain-analytics-technologies-technology-stats-live
• Uncrawlable resourcesThis endpoint returns a list of resources detected on the target website that could not be crawled due to a content type inconsistency.dataforseo.x.on-page-uncrawlable-resources
• Validate page structured dataThis endpoint is designed to validate structured JSON-LD data and Microdata.dataforseo.x.on-page-microdata
• Website technologiesUsing this endpoint you will get a list of technologies used in a particular domain.verifieddataforseo.x.domain-analytics-technologies-domain-technologies-live
• Website technology listThis endpoint will provide you with the full list of available technologies structured by technology groups and categories each particular technology belongs to.dataforseo.x.domain-analytics-technologies-technologies
• Whois and site metricsThis endpoint will provide you with Whois data enriched with backlink stats, and ranking and traffic info from organic and paid search results.verifieddataforseo.x.domain-analytics-whois-overview-live

These endpoints are callable but not part of the catalog's browse surface.