Function robots_body_allows 

fn robots_body_allows(path: &str, body: &str) -> bool

Evaluates bounded literal robots rules; unsupported encoded or wildcard policies fail closed. This intentionally supports a narrower public-source policy than a general web crawler.