Back to Topics Directory
Topic Hub

#crawlers (4 Repositories)

Ranked open-source repositories tagged with #crawlers, scored by pull request acceptance likelihood and maintainer engagement velocity.

Topic Avg Merge Rate

24.0%

Avg Review Latency

1.1h

Filter by language

4 repositories tagged #crawlers

S TierPython 4.1k 4 GFIs

ai-robots-txt/ai.robots.txt

A list of AI agents and robots to block.

96.0%
Merge Rate
4h
First Review
100%
1st-Timers
3
Maintainers
D TierLua 181

SiENcE/astray

Astray is a lua based maze, room and dungeon generation library for dungeon crawlers and rougelike video games

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierJava 204

Norconex/crawler

Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or filesystem to various data repositories such as search engines.

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierR 362

salimk/Rcrawler

An R web crawler and scraper

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
Best Crawlers Open Source Repositories & C-Rank™ | GetMerged