← Back
themineworks/rag-website-crawler
Open-source AI ToolStatus: Published — critical fields verified, some fields unverified
themineworks/rag-website-crawler: Pre-chunked markdown with token counts for RAG pipelines. Python, Node.js and cURL clients for the RAG Website Crawler on Apify, pay per result.
- Pre-chunked markdown with token counts for RAG pipelines. Python, Node.js and cURL clients for the RAG Website Crawler on Apify, pay per result.
Request operator identity verification
Risk
No known risk within the verified fields.
12
All fields
7
Verified
0
Verified empty
5
Unverified
Open-source AI Tool details
Repository
| Repository | https://github.com/themineworks/rag-website-crawler |
| Ecosystem | github |
| Package | themineworks/rag-website-crawler |
| Publisher | themineworks |
| License | MIT |
| Latest release | UNKNOWN |
| Status | ACTIVE |
| Homepage | https://themineworks.com/actors/rag-crawler/ |
| Documentation | UNKNOWN |
Runtime
| Platforms | UNKNOWN |
| Runtime requirements | UNKNOWN |
| Installation | UNKNOWN |
Critical Evidence
| Field | Status | Last checked / observed / Freshness | Confidence | Evidence |
|---|---|---|---|---|
| Pricing | UNKNOWN | Not obtained | Not obtained | 0 |
| Availability | UNKNOWN | Not obtained | Not obtained | 0 |
| Language | UNKNOWN | Not obtained | Not obtained | 0 |
| Integration | UNKNOWN | Not obtained | Not obtained | 0 |
| Deployment | UNKNOWN | Not obtained | Not obtained | 0 |
| Commercial use | Verified | 2026-11-15 | Not obtained | 1 |
Functional Evidence
| Field | Status | Last checked / observed / Freshness | Confidence | Evidence |
|---|---|---|---|---|
| Capability | UNKNOWN | Not obtained | Not obtained | 0 |
| Automation behavior | UNKNOWN | Not obtained | Not obtained | 0 |
| Input | UNKNOWN | Not obtained | Not obtained | 0 |
| Output | UNKNOWN | Not obtained | Not obtained | 0 |
Change history
- 2026-11-15 Published (some fields unverified)
Registered metadata
| archived | ACTIVE |
| canonical_repository | https://github.com/themineworks/rag-website-crawler |
| documentation_url | UNKNOWN |
| entity_kind | OPEN_SOURCE_AI_TOOL |
| homepage_url | https://themineworks.com/actors/rag-crawler/ |
| installation | None |
| latest_release | UNKNOWN |
| license | MIT |
| package_ecosystem | github |
| package_identifier | themineworks/rag-website-crawler |
| platforms | None |
| publisher | themineworks |
| runtime_requirements | None |
Field verification (12 fields)
| Field | Status | Confidence | Value | Last checked / observed | Evidence |
|---|---|---|---|---|---|
| archived | ✓ Verified | Not obtained | ACTIVE | 2026-11-15 | |
| canonical_repository | ✓ Verified | Not obtained | https://github.com/themineworks/rag-website-crawler | 2026-11-15 | |
| documentation_url | ? Unverified | Not obtained | UNKNOWN | 2026-11-15 | No evidence |
| homepage_url | ✓ Verified | Not obtained | https://themineworks.com/actors/rag-crawler/ | 2026-11-15 | |
| installation | ? Unverified | Not obtained | None | 2026-11-15 | No evidence |
| latest_release | ? Unverified | Not obtained | UNKNOWN | 2026-11-15 | No evidence |
| license | ✓ Verified | Not obtained | MIT | 2026-11-15 | |
| package_ecosystem | ✓ Verified | Not obtained | github | 2026-11-15 | |
| package_identifier | ✓ Verified | Not obtained | themineworks/rag-website-crawler | 2026-11-15 | |
| platforms | ? Unverified | Not obtained | None | 2026-11-15 | No evidence |
| publisher | ✓ Verified | Not obtained | themineworks | 2026-11-15 | |
| runtime_requirements | ? Unverified | Not obtained | None | 2026-11-15 | No evidence |