robotstxt
robots parser
A Rust port of Google's robots.txt parser and matcher C++ library
A native Rust port of Google's robots.txt parser and matcher C++ library.
89 stars
6 watching
13 forks
Language: Rust
last commit: almost 4 years ago
Linked from 1 awesome list
google-robots-parserrobotstxtrust
rust-unofficial/awesome-rustRelated projects:
| Repository | Description | Stars |
|---|---|---|
 franzenzenhofer/robotstxt | A CoffeeScript library to parse and obey robots.txt rules | 21 |
 opa-oz/tree-sitter-robots-txt | A Tree-sitter parser grammar for the robots.txt file format | 2 |
 octaltree/playwright-rust | A Rust port of Playwright, allowing browser automation and testing on multiple platforms. | 335 |
 softdevteam/grmtools | A suite of libraries and binaries for parsing text in Rust. | 523 |
 rust-transit/gtfs-structure | A Rust crate providing structures and helpers to read General Transit Feed Specification (GTFS) data | 61 |
 cualbondi/osmptparser | An OpenStreetMap public transport parser written in Rust. | 5 |
 pest-parser/pest-fmt | A tool to format and standardize Pest grammar files. | 25 |
 mattnenterprise/rust-ftp | An FTP client library written in Rust | 181 |
 toml-rs/toml | Tools and utilities for parsing and editing TOML configuration files in Rust | 739 |
 ros/urdf | Provides tools and data structures for working with 3D models in robotics | 63 |
 its-the-shrimp/yew-fmt | Tools for formatting Yew web applications written in Rust. | 21 |
 florob/rustyxml | An XML parser written in Rust | 103 |
 fltk-rs/fltk-rs | Rust bindings for a cross-platform GUI library | 1,646 |
 federicobruzzone/tdlib-rs | A Rust wrapper around the Telegram Database Library | 42 |
 marwes/combine | A Rust library implementing parser combinators for building efficient and flexible parsers | 1,307 |