How to Use Firecrawl to Turn Sites Into Clean Data (2026)

Quick Start

This guide covers every Firecrawl feature:

• Getting Started — Create a firecrawl account and set your api key
• How to Use Scrape — Pull llm ready data from single web pages
• How to Use Crawl — Crawl entire websites and follow every link
• How to Use Search — Search the web for real time web data
• How to Use Map — Run url discovery across individual pages
• How to Use Extract — Extract structured data with natural language prompts

Time needed: 5 minutes per feature

Also in this guide: Pro Tips | Common Mistakes | Troubleshooting | Pricing | Alternatives

Why Trust This Guide

I have used Firecrawl for over a year and tested every feature covered here.

This tutorial on how to use Firecrawl comes from real hands-on web scraping work.

Firecrawl is an ai powered web crawler that turns websites into clean, llm ready data.

But most users only scratch the surface of what this versatile tool can do.

This guide shows you how to use every major feature, step by step, with screenshots.

Firecrawl Tutorial

This complete Firecrawl tutorial walks you through every feature, from your first api key to advanced batch operations that make you a power user.

Firecrawl

Turn any website into clean, structured data with a single api. Firecrawl handles javascript rendering, rate limits, and url discovery so you get llm ready data fast. Start on the free plan — no credit card needed.

TRY FIRECRAWL NOW →

READ FULL REVIEW →

FIRECRAWL ALTERNATIVES →

Getting Started with Firecrawl

Before using any feature, complete this one-time setup.

It takes about 3 minutes.

Watch this quick overview first:

Now let’s walk through each step.

Step 1: Create Your Account

Go to the Firecrawl website at https://www.firecrawl.dev.

Click “Sign Up” to open a firecrawl account on the free plan.

Enter your email and create a password.

✓ Checkpoint: Check your inbox for a confirmation email.

Step 2: Install and Set Your API Key

Run pip install firecrawl-py to add the api service to your project.

Copy your api key, then save it as an environment variable for security.

Here’s what the dashboard looks like:

✓ Checkpoint: You should see the main dashboard with your usage and api key.

Step 3: Make Your First Call

Import the FirecrawlApp class and create a firecrawl instance with your key.

Every request hits the base endpoint at https://api.firecrawl.dev/v2.

How to Use Firecrawl Scraper

Scrape lets you pull clean, llm ready data from a single page with one single api call.

Scrape mode targets individual pages and is ideal for extracting specific details fast.

Here’s how to use it step by step.

Now let’s break down each step.

Step 1: Get Your API Key

Create a firecrawl account, then copy your api key from the dashboard.

Store it as an environment variable so your api key stays out of your raw code.

Step 2: Call the Scrape Endpoint

Pass a single url to the .scrape_url() method on your firecrawl instance.

You can request markdown format, raw html, or structured json as the output.

Here’s what this looks like:

✓ Checkpoint: You should see clean markdown for the current page, ready for ai applications.

Step 3: Read the Clean Output

Firecrawl returns clean data with readable text, stripped of junk html tags.

How to Use Firecrawl Crawler

Crawl lets you crawl entire websites and follow links automatically without a sitemap.

Crawl mode lets you crawl websites across multiple pages and collect every reachable page.

Here’s how to use it step by step.

Now let’s break down each step.

Step 1: Point at a Root URL

Give the crawl endpoint a starting url such as https://example.com.

Firecrawl handles web crawling through links and follows pages on its own.

Step 2: Start the Crawl Job

Launch the crawl job and grab the returned job id to track progress.

Use the job id to poll status and pull crawled data as each page finishes.

Here’s what this looks like:

✓ Checkpoint: You should see scraped pages from across the site building into web data.

Step 3: Export the Results

Collect every page as markdown or structured json for your data pipelines.

How to Use Firecrawl Search Engine

Search lets you search the web and return clean results you can feed straight into ai agents.

Search lets you query the web and pull back real time web data as readable text.

Here’s how to use it step by step.

Now let’s break down each step.

Step 1: Send a Query

Call the search endpoint with a plain natural language query.

Firecrawl can search the web across news websites, job boards, and review sites.

Step 2: Choose Output Format

Ask for markdown format or structured json for each result.

Every result arrives as clean data, not noisy raw html.

Here’s what this looks like:

✓ Checkpoint: You should see ranked web pages returned as structured web data.

Step 3: Pipe Into Your App

Feed the structured data into ai assistants or ai workflows.

How to Use Firecrawl Advanced Map

Map lets you run url discovery and turn one domain into a full map of individual pages.

Map mode retrieves every url on a site quickly for fast url discovery.

Here’s how to use it step by step.

Now let’s break down each step.

Step 1: Submit the Domain

Pass a single root url to the map endpoint.

Firecrawl returns every link without needing a sitemap.

Step 2: Review the URL List

Scan the returned individual pages before you scrape them.

Save the list to a csv file to plan your data extraction.

Here’s what this looks like:

✓ Checkpoint: You should see a full sitemap of web pages from one single url.

Step 3: Select What to Scrape

Pick the pages you want, then send them to scrape or crawl.

How to Use Firecrawl Extractor

Extract lets you extract structured data from any page using natural language prompts.

Extract uses ai powered parsing to pull exactly the fields you describe.

Here’s how to use it step by step.

Now let’s break down each step.

Step 1: Define a Schema

Write a Pydantic model with: from pydantic import BaseModel.

Schema based extraction tells Firecrawl which fields to return as structured json.

Step 2: Describe the Data

Add natural language prompts for fields a schema cannot capture.

This is how you extract data from web pages without writing parsing rules.

Here’s what this looks like:

✓ Checkpoint: You should see tidy structured data instead of messy html tags.

Step 3: Receive Structured JSON

Firecrawl returns clean structured json ready for training data.

Firecrawl Pro Tips and Shortcuts

After testing Firecrawl for over a year, here are my best tips for cleaner data extraction.

Keyboard Shortcuts

Hidden Features Most People Miss

• max_age caching: Reuse recent crawled data for faster, cheaper repeat scraping.
• Browser actions: Click, scroll, and type to reach content behind javascript rendering.
• Async batching: Process thousands of urls with batch processing without blocking your web apps.

Firecrawl Common Mistakes to Avoid

Mistake #1: Hardcoding your API key

Mistake #2: Crawling before mapping

Mistake #3: Parsing raw html yourself

Firecrawl Troubleshooting

Problem: 401 unauthorized errors

Cause: Your api key is missing or not loaded from the environment variable.

Fix: Re-export the key, then recreate your firecrawl instance and retry.

Problem: Timeout errors on complex websites

Cause: Heavy javascript rendering or dynamic content takes longer to load.

Fix: Add a wait action so the current page finishes loading before capture.

Problem: Hitting rate limits

Cause: Too many requests at once on the free plan or a lower tier.

Fix: Slow batch operations or upgrade for more concurrent browsers.

📌 Note: If none of these fix your issue, contact Firecrawl support.

What is Firecrawl?

Firecrawl is an ai powered web scraping tool that turns websites into clean, structured data.

Think of it as a web crawler that hands ai agents readable text instead of messy raw html.

Firecrawl was developed by Mendable.ai to reduce token waste for ai applications.

Watch this quick overview:

It includes these key features:

• Scrape: Extract data from single web pages as markdown format or structured json.
• Crawl: Crawl entire websites and follow links without a sitemap.
• Search: Search the web and return clean data from news websites and review sites.
• Map: Fast url discovery that turns one domain into a full sitemap.
• Extract: Pull structured web data using natural language prompts and Pydantic schemas.

Firecrawl beats traditional web scraping by handling proxies, rate limits, and javascript rendering for you.

Unlike traditional tools that need Selenium, it serves data scientists and developers through one api service.

For a full review, see our Firecrawl review.

Firecrawl Pricing

Here’s what Firecrawl costs in 2026:

Free trial: Yes — the free plan lets you scrape a limited number of pages.

Money-back guarantee: No formal guarantee, but you can downgrade anytime.

💰 Best Value: Standard — best balance of credits and concurrent browsers for most teams.

Firecrawl vs Alternatives

How does Firecrawl compare? Here’s the competitive landscape:

Quick picks:

• Best overall: Firecrawl — cleanest llm ready data from a single api.
• Best budget: Crawl4AI — free and open source for hands-on data scientists.
• Best for beginners: Firecrawl — natural language prompts hide the hard parts.
• Best for proxy scale: Bright Data — huge proxy pool for complex websites.

🎯 Firecrawl Alternatives

Looking for Firecrawl alternatives? Here are the top options:

• 🚀 Apify: Marketplace of prebuilt actors for web scraping, good when you want ready-made scrapers over a single api.
• 🏢 Bright Data: Enterprise proxy network for huge crawl jobs and content monitoring at scale across dynamic websites.
• 💰 Crawl4AI: Free, open source crawler that outputs llm ready data, ideal for budget ai workflows and local runs.
• 🔧 Scrapy: Battle-tested Python framework giving developers full control over crawling, parsing, and data pipelines.
• 🧠 ScrapeGraphAI: Graph-based, ai powered extraction that maps page structure for schema based extraction of structured data.

For the full list, see our Firecrawl alternatives guide.

⚔️ Firecrawl Compared

Here’s how Firecrawl stacks up against each competitor:

• Firecrawl vs Apify: Firecrawl wins on clean, llm ready output; Apify wins on its library of prebuilt scrapers.
• Firecrawl vs Bright Data: Bright Data wins on proxy scale; Firecrawl wins on simpler structured data extraction.
• Firecrawl vs Crawl4AI: Crawl4AI wins on price and self-hosting; Firecrawl wins on managed rate limits and reliability.
• Firecrawl vs Scrapy: Scrapy wins on low-level control; Firecrawl wins on speed and zero proxy setup.
• Firecrawl vs ScrapeGraphAI: Both are ai powered; Firecrawl wins on crawl coverage, ScrapeGraphAI on graph logic.

Start Using Firecrawl Now

You learned how to use every major Firecrawl feature:

• ✅ Scrape
• ✅ Crawl
• ✅ Search
• ✅ Map
• ✅ Extract

Next step: Pick one feature and try it now.

Most people start with Scrape.

It takes less than 5 minutes.

Frequently Asked Questions

What is Firecrawl used for?

Firecrawl is an ai powered web scraping tool. It turns web pages into clean, llm ready data for ai agents, rag systems, market research, and price monitoring.

Can you use Firecrawl for free?

Yes. The free plan lets you scrape a limited number of pages with your api key, so you can test scrape, crawl, and extract before paying.

How do I install Firecrawl?

Run pip install firecrawl-py, then set your api key as an environment variable and create a firecrawl instance to start your first single api call.

How is Firecrawl different from traditional scraping?

Traditional web scraping needs Selenium and manual proxy setup. Firecrawl handles javascript rendering, rate limits, and clean data automatically through one api service.

Can Firecrawl extract structured data?

Yes. Use natural language prompts or a Pydantic schema for schema based extraction, and Firecrawl returns structured json instead of raw html.