GitHub

When you run moose-cli dev, Moose creates a complete development environment that combines your code with pre-configured infrastructure:

Moose organizes your data pipeline into five distinct infrastructure modules:

Module	Moose Code	Infrastructure	Default
Ingestion	Ingest APIs, Ingestion Pipeline	HTTP POST endpoints	Rust
Streaming	Streams	Streaming topics & consumers	Redpanda
Database	Tables, Views	OLAP tables & views	ClickHouse
Orchestration	Workflows	Task queue & workers	Temporal
Consumption	Analytics APIs	HTTP GET endpoints	Rust

Moose is designed to be highly customizable. You can control which modules are included in your deployment using moose.config.toml:

moose.config.toml

[features]
streaming_engine = true  # Include Redpanda for streaming
workflows = true        # Enable Temporal for orchestration

Warning:

By default, both streaming_engine and workflows are enabled. You must set the respective features to false to disable them.

moose.config.toml

[features]
streaming_engine = false  # Disable Redpanda for streaming

moose.config.toml

[features]
workflows = false        # Disable Temporal for orchestration

Component	Purpose	Access
Web Server	Handles HTTP requests for data ingestion and APIs	localhost:4000
ClickHouse	Analytical database for data storage and querying	localhost:18123
Redpanda	Kafka-compatible message broker for streaming	localhost:19092
Temporal	Workflow orchestration engine	localhost:7233 (Server) / localhost:8080 (UI)
Redis	Caching and temporary storage	Internal only

All these components are automatically configured to work together, creating a complete development environment that mirrors a production deployment.

Project Structure

Data Modeling