Welcome to the Slurpy documentation

Slurpy allows you to build data ingestion pipeline. Data comes from various sources, are transformed by arbitrary user code, stored as a collection in a NoSQL database used as a cache, and consumed from JSON endpoints.

Administration

1. User define a Datasource
2. User implement a Slurper consuming this Datasource
3. User schedule an Async job running this Slurper at chosen frequency
4. User define an Endpoint exposing ingested data
5. Pipelines
6. Debugging

Consuming Slurpy

1. Consuming endpoints