Isoxya

Scalable web crawling and scraping.

Available on-premises or in the cloud.

Isoxya is an extensible data processing system for crawling and scraping the internet. It is written in a compiled, statically typed language for speed and reliability. Isoxya is free, open-source, and packaged as a container. The API can be used by CLI scripts or called by another project. Various plugins are available, many also open-source.

Download Free Source

Isoxya Pro adds high availability, error recovery, and horizontal scaling. It is available on-premises for installation on your servers, or in the cloud via SaaS subscription. Isoxya Pro is available via commercial licence. The API is able to scale crawlers, processors, and streamers. Support or custom development is available from Isoxya's creator.

Request Quote

  Isoxya Isoxya Pro
Intended audience Home · Hobbyist · R&D Business · Agency
API
CLI scripts
Extensible via plugins
Web crawls
External database ❌  SQLite ✅  PostgreSQL
Cache ✅  Redis
Message broker ✅  RabbitMQ
High availability
Error recovery
Horizontal scaling
Concurrent crawls ❌   ✅  
Multi-process
Custom user agents
Custom rate limits
Robots.txt compliance
Cancellable crawls
Limitable max pages
Limitable max depth
External links validation
List crawls
Resource management
Scalable crawlers
Scalable processors
Scalable streamers
Support Community Email
Licence BSD-3-Clause Commercial
Price Free Custom
  Download Free Request Quote