DEV
2.-data-controller v2.4.1-stable
Configure ingestion rules, sync intervals, and retention policies. Monitor active streams and manage dataset lifecycles in real-time.
Sync Mode
Auto-Partitioning
Splits large payloads into optimized shards for parallel processing.
Retention Window
7 days
90 days
365 days
Error Handling
Active Streams
14
▲ +2 from last hour
Throughput
2.4M evt/min
▲ +12% optimized
Storage Used
847 GB
▼ -5.2% compressed
Error Rate
0.02%
▲ Within SLA
Active Datasets & Sync Jobs
| Dataset ID | Source | Status | Size | Last Sync | Actions |
|---|---|---|---|---|---|
| dat_us_east_prod_01 | PostgreSQL Replica | Active | 241.5 GB | 2 mins ago | |
| dat_eu_west_prod_03 | Kafka Topic: events.raw | Syncing | 89.2 GB | In progress... | |
| dat_api_staging_07 | REST API Endpoint | Active | 12.8 GB | 14 mins ago | |
| dat_legacy_backup_00 | S3 Bucket: cold-storage | Failed | 1.2 TB | 2 hrs ago |
◉ Controller Output
[14:02:11] ℹ Initializing data controller v2.4.1...
[14:02:12] ✔ Connected to primary ingress node (us-east-1)
[14:02:12] ✔ Configuration loaded from /etc/.git/controller.yaml
[14:02:14] ⚠ Legacy backup job pending retry (attempt 3/5)
[14:02:18] ℹ Auto-partitioning enabled for payloads > 50MB