Sonar

About Sonar

SonarSearch is a toolset and API for querying the Project Sonar dataset, providing fast lookups of subdomains for a given domain and reverse lookups of domains that resolve to a given IP address. It includes a command-line client called Crobat for performing these queries, supporting both single values and files or quoted lists as input, along with a REST API offering endpoints for subdomains, TLDs, all results across TLDs, and reverse DNS lookups on IP addresses or CIDR ranges. A gRPC API is also available for streaming results, recommended for large queries due to lower execution time and server load, and no authentication is required to use either API.

The repository also provides full instructions for self-hosting an instance of the API, since the previously available public instance (Crobat, hosted at sonar.omnisint.io) was taken offline after Rapid7 revoked public access to its datasets and licensing changes ended sponsor support. Self-hosting requires 150-200GB of disk space to store datasets and indexes, and a choice between Redis (faster, requiring around 20GB of RAM) or Postgres (lower memory footprint, slower indexing and lookups) as the index backend. Setup involves compiling the provided binaries, running Postgres or Redis (locally or via Docker), converting a Project Sonar dataset into the tool's custom format, and building sorted indexes.

The project is aimed at developers and security researchers who need programmatic subdomain enumeration and reverse DNS lookup capabilities, either through the command-line client or by running their own instance of the indexing and query infrastructure. A third-party Crystal SDK and CLI tool with Docker images is also referenced, and the maintainer welcomes contributions of SDKs in other languages.

Key features

• Fast subdomain lookup for a given domain via the Crobat API
• Reverse DNS lookup on an IP address or CIDR range
• REST API with endpoints for subdomains, TLDs, and reverse lookups
• gRPC API for streaming large query results over HTTP/2
• Command line client (crobat) supporting file and list input for bulk queries
• Self-hostable using the Project Sonar dataset with Redis or Postgres indexing

Frequently asked questions