Sup?

crwlr is (will be) a collection of open source PHP packages that provide the necessary tools for crawling and scraping tasks.

Packages

Url

The Swiss Army knife for urls. Parses urls to components (scheme, host, domain, path,...). You can access and modify url components, compare components of different urls and resolve relative to absolute urls. Also supports internationalized domain names.

Latest Blog Posts

This is just a short introduction to what crwlr.software is and will become in the future and why you may like it.