robotstxt

robots parser

A CoffeeScript library to parse and obey robots.txt rules

robots.txt parser coffeescript

GitHub

21 stars
3 watching
7 forks
Language: CoffeeScript
last commit: about 12 years ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
folyd/robotstxt A Rust port of Google's robots.txt parser and matcher C++ library 88
mstroecker/zig-robotstxt A lightweight HTTP server serving a disallow robots.txt file in the Zig programming language. 2
pest-parser/pest-fmt A tool to format and standardize Pest grammar files. 25
rustadopt/jzon-rs A JSON parsing and serialization library in Rust 8
flamingchickens1540/rooster A common library of useful classes and systems for robot control 12
brettstimmerman/mensch A CSS parsing library with an abstract syntax tree (AST) data structure 113
ros/urdf Provides tools and data structures for working with 3D models in robotics 63
mattfbacon/typst-bot Discord bot that renders Typst code using Rust and Poise framework 64
mengzhuo/cookiestxt Parser for a specific text-based format used in cookie management. 17
nogizhopaboroda/f_context A CoffeeScript library providing a simple and easy-to-use way to implement functional programming concepts using pattern matching. 34
jazzband/django-robots A Django app for managing robots exclusion protocol files 459
frozolotl/tree-sitter-typst A tree-sitter grammar for the TypSt typesetting language with a focus on correctness and intended to be used as a parser. 76
devongovett/coffeepack An implementation of MessagePack serialization format in CoffeeScript for Node.js and the browser. 50
ruricolist/fxml A secure-by-default XML parser and serializer library 32
ros/urdfdom_headers Provides core data structure headers for describing robot models and interactions 27