快速入门
This guide on how to use ScrapingBee covers every feature:
- 入门 — Create your account and get your api key
- How to Use AI Web Scraping — pull complex structured information from web pages using plain English
- How to Use Google Search API — scrape Google search results without managing proxy ips yourself
- How to Use Google Shopping Scraper — collect product listings and the extracted price for any search term
- How to Use JavaScript Web Scraping — handle javascript rendering on web pages built with React or Vue
- How to Use ChatGPT Scraper — capture responses and page source from dynamic AI chat pages
- How to Use Google News Scraper API — pull headlines and full articles through simple api requests
- How to Use Fast Data Scraping — run fast data scraping while ScrapingBee rotates proxies for you
- How to Use Programmatic Screenshot API — capture a full page screenshot of any url programmatically
- How to Use Scrape Google Jobs — gather job listings as complex structured information
所需时间： 每部影片 5 分钟
本指南还包含以下内容： 专业提示 | 常见错误 | 故障排除 | 定价 | 替代方案
为什么信任本指南
I have used ScrapingBee for over a year and tested every feature here. This tutorial comes from real hands-on scraping, not vendor screenshots.
ScrapingBee is a cloud based 刮削工具 that handles the hard parts of web scraping.
It manages headless browsers and rotates proxies for you.
本指南将逐步向您展示如何使用每个主要功能。
With screenshots, a simple example, and pro tips throughout.
ScrapingBee Tutorial
This complete ScrapingBee tutorial walks you through every feature, from your first api request to advanced javascript scenario tricks.
ScrapingBee
Scrape any website without managing proxy ips or headless browsers. ScrapingBee handles javascript rendering through one simple rest api. Get 1000 free api calls to start — no credit card needed.
Getting Started with ScrapingBee
使用任何功能之前，请先完成此一次性设置。
It takes about three minutes.
Here is a quick look at the workflow:
现在让我们一步一步来。
第一步：创建您的帐户
Go to the ScrapingBee website and click “Sign Up”.
Enter promo code ADNAN through the referral link for extra api credit.
✓ 检查点： Your dashboard shows your unique api key.
Step 2: Set Up Your Code
In Python, run pip install scrapingbee or just import requests.
The requests library lets you call the api from any programming language.
✓ 检查点： Your environment is ready to send api requests.
Step 3: Make Your First Call
Send a request to the https://app.scrapingbee.com/api/v1/ endpoint with your api key and url.
This simple example lets you scrape web pages with a few lines of complete code.
✅ 完成： 您已准备好使用以下任何功能。
How to Use ScrapingBee AI Web Scraping
人工智能网络爬虫 lets you pull complex structured information from web pages using plain English.
以下是使用步骤详解。
步骤 1：获取您的 API 密钥
Sign up and copy your api key from the dashboard.
Step 2: Describe the Data
Add the target url and write a plain-English query.
这就是它的样子：
✓ 检查点： A clean JSON object appears with your fields.
Step 3: Set Extraction Rules
Adjust your extraction rules to capture each field exactly.
✅ 结果： Structured JSON without writing css selectors by hand.
💡 专业提示： Pair AI extraction with css selectors when you need precise control.
How to Use ScrapingBee Google Search API
Google 搜索 API lets you scrape Google search results without managing proxy ips yourself.
以下是使用步骤详解。
Step 1: Choose the Endpoint
Point your request at the Google Search API.
Step 2: Set the Query
Add your keyword and a random country for local results.
这就是它的样子：
✓ 检查点： Ranked results return as structured data.
Step 3: Read the JSON
Parse the response with the requests library in Python.
✅ 结果： Search data through one simple rest api call.
💡 专业提示： Use country_code for premium proxy geolocation on every query.
How to Use ScrapingBee Google Shopping Scraper
Google Shopping Scraper lets you collect product listings and the extracted price for any search term.
以下是使用步骤详解。
Step 1: Send a Shopping Request
Call the shopping endpoint with your product query.
Step 2: Parse the Response
Map each listing to title, link, and extracted price.
这就是它的样子：
✓ 检查点： Product rows return as clean JSON.
步骤 3：导出结果
Save the data to CSV for further analysis.
✅ 结果： Live pricing data ready for any spreadsheet.
💡 专业提示： Schedule runs to track the extracted price over time.
How to Use ScrapingBee JavaScript Web Scraping
JavaScript Web Scraping lets you handle javascript rendering on web pages built with React or Vue.
以下是使用步骤详解。
Step 1: Enable render_js
Set render_js=true so ScrapingBee uses headless browsers.
Step 2: Wait for an Element
Tell it to wait for a particular element to load.
这就是它的样子：
✓ 检查点： The full page renders before extraction.
Step 3: Capture the HTML
Return the original html or raw page source after rendering.
✅ 结果： Fully rendered web pages without web drivers to manage.
💡 专业提示： Add a javascript scenario for clicking, scrolling, or form filling.
How to Use ScrapingBee ChatGPT Scraper
ChatGPT 刮刀 lets you capture responses and page source from dynamic AI chat pages.
以下是使用步骤详解。
Step 1: Target the Page
Send the page url with render_js switched on.
Step 2: Render and Extract
Let headless scraping load the reply, then grab the 文本.
这就是它的样子：
✓ 检查点： The rendered answer returns in the page source.
Step 3: Save the Output
Store the parsed html for later processing.
✅ 结果： Clean text pulled from a fully dynamic page.
💡 专业提示： Chain a javascript scenario to walk through multi-step prompts.
How to Use ScrapingBee Google News Scraper API
Google News Scraper API lets you pull headlines and full articles through simple api requests.
以下是使用步骤详解。
Step 1: Set the News Endpoint
Aim your request at the Google News API.
Step 2: Add Filters
Filter by topic, language, or random country.
这就是它的样子：
✓ 检查点： Matching headlines return as structured data.
Step 3: Collect Articles
Loop through results to gather each story.
✅ 结果： Fresh news data straight from the scrapingbee api.
💡 专业提示： Rotate the country code to compare regional coverage.
How to Use ScrapingBee Fast Data Scraping
Fast Data Scraping lets you run fast data scraping while ScrapingBee rotates proxies for you.
以下是使用步骤详解。
Step 1: Build Your Request
Assemble the url, api key, and parameters once.
Step 2: Run Concurrent Calls
Fire many api requests at the same time.
这就是它的样子：
✓ 检查点： Responses stream back in parallel.
Step 3: Check Status Codes
Confirm a 200 http code on every status code returned.
✅ 结果： High-volume scraping handled on remote machines.
💡 专业提示： ThreadPoolExecutor speeds up scraping web pages dramatically.
How to Use ScrapingBee Programmatic Screenshot API
Programmatic Screenshot API lets you capture a full page screenshot of any url programmatically.
以下是使用步骤详解。
Step 1: Add the Screenshot Flag
Append screenshot=true to your api request.
Step 2: Choose Full Page
Set full_page=true to capture the entire layout.
这就是它的样子：
✓ 检查点： A full page image renders edge to edge.
Step 3: Download the Image
Save the returned file to disk.
✅ 结果： Pixel-perfect captures generated on demand.
💡 专业提示： The full_page parameter ensures the whole page renders first.
How to Use ScrapingBee Scrape Google Jobs
Scrape Google Jobs lets you gather job listings as complex structured information.
以下是使用步骤详解。
Step 1: Call the Jobs Endpoint
Send your role and location to the jobs API.
Step 2: Filter Listings
Narrow results by title, company, or city.
这就是它的样子：
✓ 检查点： Job rows return as clean JSON.
Step 3: Structure the Data
Parse html fields into a tidy table.
✅ 结果： Job data ready to parse and store.
💡 专业提示： Pair with css selectors to pull custom fields.
ScrapingBee Pro Tips and Shortcuts
After testing ScrapingBee for over a year, here are my best tips for scraping websites.
Key API Parameters
| Parameter | 它的功能 |
|---|---|
| render_js | Renders javascript in headless browsers |
| premium_proxy | Switches to residential proxy ips |
| country_code | Sets premium proxy geolocation by random country |
| block_ads | Lets you block ads to speed up requests |
大多数人错过的隐藏功能
- session_id: Routes api requests through the same ip address for five minutes, so you keep the same http code and session.
- return_page_source: Returns the original html and full page source before any javascript runs.
- Custom headers and cookies: Send your own custom headers and custom cookies, or fall back to the default headers ScrapingBee generates.
- Header control: Swap an existing header for a new header, display headers generated automatically, then keep only particular headers and drop the other headers.
ScrapingBee Common Mistakes to Avoid
Mistake #1: Ignoring robots.txt before you scrape
❌ 错误： Firing requests at any site you want to scrape without checking the rules first.
✅ 右图： Check the robots.txt file and terms of service before scraping web pages.
Mistake #2: Forgetting to enable JavaScript rendering
❌ 错误： Expecting dynamic content but getting an empty page source every time.
✅ 右图： Set render_js=true so headless browsers load the full page first.
Mistake #3: Sending only the default headers
❌ 错误： Relying on default headers alone, which some sites flag and block.
✅ 右图： Send your own custom headers and a real user agent parameter when you want to scrape.
ScrapingBee Troubleshooting
Problem: Empty or partial page source
原因： The javascript on the page never rendered, so the html came back blank.
使固定： Set render_js=true and wait for a particular element to load the full page.
Problem: Requests keep getting blocked
原因： The default datacenter proxy ips were flagged by the target site.
使固定： Enable premium proxies to rotate in a new ip address from a random country.
Problem: You see a 401 or 403 http code
原因： Your api key is wrong, or you are out of api credit.
使固定： Confirm the api key, check your status code, and top up credits if needed.
📌 笔记： If none of these fix your issue, contact ScrapingBee support.
ScrapingBee是什么？
ScrapingBee is a cloud based scraping tool that handles headless browsers and rotates proxies for you.
Think of it as a hosted browser you control through a rest api.
观看这段快速概览：
它包含以下主要特点：
- AI Web Scraping: Lets you pull complex structured information from web pages using plain English.
- Google Search API: Lets you scrape Google search results without managing proxy ips yourself.
- Google Shopping Scraper: Lets you collect product listings and the extracted price for any search term.
- JavaScript Web Scraping: Lets you handle javascript rendering on web pages built with React or Vue.
- ChatGPT Scraper: Lets you capture responses and page source from dynamic AI chat pages.
- Google News Scraper API: Lets you pull headlines and full articles through simple api requests.
- Fast Data Scraping: Lets you run fast data scraping while ScrapingBee rotates proxies for you.
- Programmatic Screenshot API: Lets you capture a full page screenshot of any url programmatically.
- Scrape Google Jobs: Lets you gather job listings as complex structured information.
如需完整评测，请参阅我们的 ScrapingBee review.
ScrapingBee 定价
Here is what ScrapingBee costs in 2026:
| 计划 | 价格 | 最适合 |
|---|---|---|
| 自由职业者 | 每月 49 美元 | 独立开发者和小项目 |
| 创业公司 | 每月99美元 | Growing teams scaling api requests |
| 商业 | 每月 249 美元 | High-volume web scraping workloads |
| 商务+ | 每月 599 美元 | Enterprise teams on remote machines |
免费试用： Yes — 1000 free api calls, no credit card required.
退款保证： Cancel anytime; billing is monthly with no lock-in.
💰 性价比最高： Startup — the best balance of api credit and price for most teams.
ScrapingBee 与其他方案的比较
How does ScrapingBee compare? Here is the competitive landscape:
观看这段对比视频：
| 工具 | 最适合 | 价格 | 等级 |
|---|---|---|---|
| ScrapingBee | JavaScript rendering via one rest api | 每月 49 美元 | ⭐ 4.5 |
| Apify | Ready-made scraper actors | 因情况而异 | ⭐ — |
| ScrapeGraphAI | AI-driven extraction rules | 因情况而异 | ⭐ — |
| 明亮数据 | Enterprise proxy ips | 因情况而异 | ⭐ — |
| 浏览 人工智能 | No-code point and click | 因情况而异 | ⭐ — |
| 奥克西拉布斯 | Premium enterprise proxies | 因情况而异 | ⭐ — |
| ThorData | Budget proxy network | 因情况而异 | ⭐ — |
| 泽特 | Developer scraping api | 因情况而异 | ⭐ — |
| 网络爬虫.io | Browser extension capture | 因情况而异 | ⭐ — |
| 氦气刮刀 | Desktop site mapping | 因情况而异 | ⭐ — |
| 火行者 | LLM-ready markdown | 因情况而异 | ⭐ — |
快速精选：
- 综合最佳： ScrapingBee — one rest api for rendering, search, and screenshots.
- 最佳预算： ThorData — cheap proxy ips for simple scraping purposes.
- 最适合初学者： Browse AI — no code and no programming language needed.
- 最适合企业使用： Bright Data — built for huge, compliant scraping operations.
🎯 ScrapingBee Alternatives
正在寻找 ScrapingBee 的替代方案？以下是一些最佳选择：
- 🚀 Apify： A full scraping platform with ready-made actors and a generous free tier for testing ideas fast.
- 🧠 ScrapeGraphAI： An AI-first scraper that turns plain prompts into extraction rules for complex structured information.
- 🏢 亮数据： Enterprise-grade proxy ips and datasets built for very large scraping operations and strict compliance.
- 👶 浏览人工智能： A no-code tool that records your clicks to build scrapers without writing any code.
- 🔒 Oxylabs： A premium proxy and scraper API provider with strong reliability for demanding enterprise workloads.
- 💰 ThorData： A budget-friendly proxy network covering residential and datacenter proxy ips for everyday scraping jobs.
- 🔧 Zyte： A developer-focused scraping API, formerly Scrapinghub, with smart bans handling and clean page source.
- 🎨 Webscraper.io: A browser-extension scraper that builds sitemaps visually inside Chrome for point-and-click data capture.
- 💼 Helium Scraper: A desktop scraping app for Windows that maps complex sites without any cloud dependency.
- ⚡ 火行者： An AI crawler that converts whole sites into clean markdown for feeding large language models.
完整列表请参见我们的 ScrapingBee 的替代方案 指导。
⚔️ ScrapingBee 对比
Here is how ScrapingBee stacks up against each competitor:
- ScrapingBee 对比 Apify： Apify offers a marketplace of scrapers; ScrapingBee wins on simple rest api access and faster setup.
- ScrapingBee 对比 ScrapeGraphAI： ScrapeGraphAI leans fully on AI; ScrapingBee gives you both AI extraction and raw css selectors.
- ScrapingBee 对比 Bright Data： Bright Data scales to enterprise; ScrapingBee is cheaper and simpler for small to mid teams.
- ScrapingBee 对比 Browse AI： Browse AI suits non-coders; ScrapingBee fits developers who want a rest api and full control.
- ScrapingBee 对比 Oxylabs： Oxylabs targets large enterprises; ScrapingBee offers lower entry pricing and an easier learning curve.
- ScrapingBee 对比 ThorData： ThorData competes on proxy price; ScrapingBee bundles rendering, screenshots, and AI into one api.
- ScrapingBee 对比 Zyte： Zyte has deep developer roots; ScrapingBee is friendlier for quick projects and small teams.
- ScrapingBee 与 Webscraper.io： Webscraper.io runs in the browser; ScrapingBee handles javascript rendering server-side at real scale.
- ScrapingBee 对比 Helium Scraper： Helium Scraper is desktop-only; ScrapingBee runs in the cloud so you skip web drivers entirely.
- ScrapingBee 对阵 Firecrawl： Firecrawl targets LLM pipelines; ScrapingBee covers broader scraping with screenshots and search APIs.
Start Using ScrapingBee Now
You learned how to use every major ScrapingBee feature:
- ✅ AI Web Scraping
- ✅ Google Search API
- ✅ Google Shopping Scraper
- ✅ JavaScript Web Scraping
- ✅ ChatGPT Scraper
- ✅ Google News Scraper API
- ✅ Fast Data Scraping
- ✅ Programmatic Screenshot API
- ✅ Scrape Google Jobs
下一步： 选择一项功能，立即试用。
Most people start with AI Web Scraping.
A popular first project is creating an OLX scraper to pull listings.
During development ScrapingBee runs the browser on remote machines for you.
Explore further features once your first OLX scraper works.
It takes less than five minutes to scrape your first page.
常见问题解答
ScrapingBee 的工作原理是什么？
ScrapingBee is a cloud based scraping tool. You send a request with your api key and a url, and it returns the page using headless browsers while it rotates proxies for you.
ScrapingBee 的价格是多少？
Plans start at $49/month for Freelance, then $99 Startup, $249 Business, and $599 Business+. A free trial gives you 1000 api calls to test scraping purposes.
网络爬虫违法吗？
Scraping public web pages is generally legal. Always check a site’s robots.txt and terms first, avoid personal data, and respect rate limits to stay on the safe side.
Does ScrapingBee support JavaScript rendering?
Yes. Set render_js=true and ScrapingBee loads web pages in headless browsers. This javascript rendering works on sites built with React or Vue out of the box.
Which programming language does ScrapingBee support?
Any. ScrapingBee is a rest api, so you call it from Python, Node, PHP, or any language. In Python just import requests and send your api requests.
English 
Spanish 
Chinese 
German 
French 
Arabic 
Russian 
Portuguese 
Japanese 
Korean 
Italian 
Turkish 
Dutch 
Polish 
Indonesian 
Thai 
Vietnamese 