Web Scraping API

About Web Scraping API

Web Scraping API is a GET-based service that accepts a URL as a query parameter and returns the page's captured content and metadata in a structured JSON response. The response echoes the requested URL, includes a UTC timestamp of the scrape, and provides a scraped_data object containing extracted page information.

The scraped_data can include the page title, document-level headers, standard meta tags, Open Graph values, Twitter Card values, content in HTML and markdown formats, structured content, content lists, a content keywords index, detected language, and extracted links separated into internal and external arrays.

The API is intended for developers building tools that need page retrieval and structured page analysis without maintaining their own crawler, with stated use cases including page monitoring, content indexing, SEO checks, competitive analysis, and lightweight data collection. It is published by SharpAPI, is at version 1.0, and exposes a single endpoint.

Key features

• Scrapes a URL and returns structured content and metadata in one request
• Extracts title, meta tags, Open Graph, and Twitter Card data
• Returns page content as HTML, Markdown, and structured/list formats
• Detects page language and builds a content keyword index
• Extracts internal and external links as separate arrays

Frequently asked questions