TeraCrawl

Overview

TeraCrawl is a high-performance web crawler API optimized for large language models, allowing users to convert any search or website into clean Markdown format. It is designed for developers and data scientists looking to automate web data extraction and enhance their AI applications.