Docs Extractor - AI-Powered Documentation Generator

An intelligent documentation extraction tool powered by Zypher Agent and Firecrawl. This tool automatically crawls documentation websites and generates comprehensive guides based on your needs.

Demo

Watch a quick demo of the tool in action:

🎥 View Demo Video

Setup

Prerequisites

Deno installed
Node.js and npm installed (for frontend)
API Keys:
- Anthropic API key (for Claude AI)
- Firecrawl API key (for web crawling)

Installation

Set up environment variables:

Create a .env file in the docs-extractor directory:
```
ANTHROPIC_API_KEY=your_anthropic_api_key_here
FIRECRAWL_API_KEY=your_firecrawl_api_key_here
```
Get your API keys:
- Anthropic: https://console.anthropic.com/
- Firecrawl: https://firecrawl.dev/
Install frontend dependencies:
```
cd frontend
npm install
```

Usage

Option 1: With UI (Recommended)

Start the backend server:
```
deno task server
```
The API server will start on http://localhost:8000
Start the frontend (in a new terminal):
```
cd frontend
npm run dev
```
The UI will be available at http://localhost:5173
Use the web interface:
- Enter a documentation URL (e.g., https://react.dev/docs)
- Specify what you want to extract (e.g., "Quickstart guide with installation and examples")
- Click "Extract Documentation"
- Wait for the AI to process and generate the documentation
- View and download the generated markdown file