CloudNexus Data Sources

🐘

Supported

PostgreSQL

Full WAL replication, logical decoding, and zero-impact CDC for Postgres 11+.

🍃

Supported

MongoDB

Change stream integration with automatic schema evolution and type mapping.

🔌

Supported

REST API

Generic HTTP connector with OAuth2, mTLS, pagination, and webhook fallback.

🪣

Supported

S3 / Blob Storage

Event-driven ingestion from AWS S3, Azure Blob, and GCS with schema inference.

💼

Beta

Salesforce

Sync Leads, Opportunities, and Accounts via REST API with incremental polling.

📊

Enterprise

Snowflake

High-throughput staging and direct table sync with materialized view support.

How Data Sources Work

Four simple steps to connect any system and start streaming data into your cloud infrastructure.

Select Connector

Choose from 50+ pre-built connectors or configure a custom HTTP/Webhook endpoint.

Authenticate

Securely store credentials using our encrypted vault. Support for IAM, OAuth, API keys, and certs.

Map & Transform

Define schema mappings, apply filters, and transform payloads using our visual editor or SQL.

Deploy & Monitor

Activate the source and track latency, throughput, and error rates in real-time dashboards.

Manage via CLI or API

Automate your data source configuration with our SDKs and REST API. Integrate into CI/CD pipelines, Terraform, or infrastructure-as-code workflows.

Read API Reference →

curl / REST API

# Create a new PostgreSQL CDC source
curl -X POST https://api.cloudnexus.io/v1/sources \\
  -H "Authorization: Bearer $CLOUDNEXUS_API_KEY" \\
  -H "Content-Type: application/json" \\
  -d '{
    "name": "prod-postgres-primary",
    "type": "postgres_cdc",
    "connection": {
      "host": "db.internal.cloudnexus.io",
      "port": 5432,
      "ssl_mode": "verify-full",
      "credentials_ref": "vault://creds/pg-prod"
    },
    "schema": {
      "mode": "auto_infer",
      "tables": ["orders", "customers", "events"]
    },
    "options": {
      "batch_size": 5000,
      "reconnect_delay": "exponential"
    }
  }'

Data Source Quotas & Limits

Scalable tiers designed for every stage of your data pipeline.

Plan	Active Sources	Ingest Throughput	Retention	Advanced Transform
Free	2 sources	10 MB/min	7 days	Basic Filters
Professional	25 sources	500 MB/min	30 days	SQL + JSONPath
Enterprise	Unlimited	Custom (up to 10 GB/min)	Unlimited	Full ETL + UDF

Frequently Asked Questions

Everything you need to know about configuring and scaling data sources.

Do you support custom protocols or legacy systems? +

Yes. Our generic REST and WebSocket connectors support any HTTP-based API. For legacy TCP/UDP or binary protocols, use our Custom Connector SDK to wrap your parser and deploy it as a managed service.

How is data encrypted in transit and at rest? +

All data is encrypted using TLS 1.3 in transit and AES-256 at rest. Credentials are never stored in plaintext; they're rotated and managed via our FIPS 140-2 compliant secrets vault.

Can I pause or schedule a data source? +

Absolutely. Use the dashboard to pause/resume instantly, or configure cron schedules via the API. Scheduling is free on all plans and includes automatic recovery on network blips.

What happens if a source goes down or returns errors? +

We implement exponential backoff with configurable jitter. Dead-letter queues capture failed records automatically. You'll receive alerts via Slack, PagerDuty, or webhook when thresholds are breached.