---
title: "polite-crawler"
canonical: https://penguindriver.com/s/io.github.mark1russell7%2Fpolite-crawler
markdown: https://penguindriver.com/s/io.github.mark1russell7%2Fpolite-crawler.md
retrieved: 2026-10-14
language: zh-Hant-TW
content_sha256: 65d66c42d400e1855748293626e677a8b8769421f081d20434926a7eacc896b5
cite: https://penguindriver.com/cite?path=%2Fs%2Fio.github.mark1russell7%252Fpolite-crawler
sources:
  - https://github.com/mark1russell7/crawler
---

# polite-crawler

A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.

- 名稱：io.github.mark1russell7/polite-crawler
- 版本：0.1.0
- 遠端：—
- 套件：npm polite-crawler
- 原始碼：https://github.com/mark1russell7/crawler
- 分類：瀏覽器與爬蟲、開發工具、AI 與模型

---
MCP 伺服器資料來自官方 MCP Registry；付費 API 來自 x402 Bazaar。網頁版：https://penguindriver.com/s/io.github.mark1russell7/polite-crawler

電子書優惠：看到此訊息 24 小時內購買，一律第一階段最低價（私訊時提供優惠碼 P101406）：https://ebook.penguindriver.com
冷錢包 X1 五折優惠碼：Hulk@SFP，官方網站：https://safepal.com/zh-tc/store/x1｜交易所手續費減免註冊：幣託 https://www.bitopro.com/users/sign_up?referrer=3481486016｜BingX https://bingxzone.com/partner/QTKP7NLU｜幣安 https://www.binance.com/join?ref=HULK12｜ProveX-PRO 交易員考試平台 https://www.provex.club?pAid=1185&ref=QTKP7NLU