AEREO SYNC FEATURE LIST

A comprehensive capability catalog with technical depth in a clear product language

This page brings together product capabilities across security, data movement, privacy, validation, backup, performance, observability and topology.

Synchronization Core

Synchronization Core

Resumable, metadata-driven and safe data movement.

14 capabilities

Metadata-driven catalog discovery

Discovers source tables from catalog metadata instead of hard-coding a Java table list.

Non-destructive BOOTSTRAP

Initial-loads a new target with full source read + idempotent UPSERT without truncating it.

DELTA synchronization

Moves only the changed data window using watermarks and checkpoints.

FULL table mode

Reads tables without a reliable watermark through PK-based pagination.

Signed opaque cursor

Keeps cursor internals opaque and protects scope/integrity with HMAC.

Fixed snapshot window

Uses a stable sync_until boundary during a cycle for a consistent moving-source window.

LIMIT+1 pagination

Determines has_more without a separate count query.

Atomic checkpoint

Couples target writes with cursor/checkpoint progression transactionally.

Restart / resume

Continues from the last safe cursor/checkpoint after interruption.

Completion-based scheduling

Does not pile up jobs; the next cycle starts after the previous one completes plus the configured delay.

Parallel client isolation

Runs multiple source/client flows in parallel with isolated workers and target connections.

No-overlap protection

Uses process locking and source leases to prevent duplicate concurrent flows.

Idempotent UPSERT

Makes page retries safe without creating duplicate target rows.

Client enable / disable

Enables or disables integrations through configuration rather than code changes.

Security & Transfer Policy

Security & Transfer Policy

Combines identity, environment, data classification and endpoint controls.

13 capabilities

Transfer purpose policy

Separates business intent such as backup, PROD→TEST, TEST→TEST, DR and replication from execution mode.

Environment policy

Evaluates PROD, PREPROD, TEST, DEV, BACKUP and DR direction rules explicitly.

M2M authentication

Uses the API key only for login and short-lived Bearer/refresh tokens for runtime calls.

Scoped tokens

Binds tokens to source instance, profile, platform, action and consumer context.

TLS transport

Moves source data over HTTPS/TLS.

Rate limiting

Applies action-based DB-backed throttling to limit abuse and bursts.

Explicit column metadata

Exports only allowlisted metadata columns instead of SELECT *.

SQL identifier allowlist

Validates dynamic table and column identifiers against metadata.

Sanitized errors

Avoids exposing internal paths, secrets, payloads and stack traces in API errors.

Secret redaction

Masks keys, tokens, cursors and secret values in log/audit paths.

Sensitive backup opt-in

Allows sensitive backup columns only through explicit metadata plus local configuration approval.

Canonical public endpoint

Separates the public sync endpoint from internal PHP API files.

Security audit stream

Records auth, rate-limit, cursor and access events with a controlled event taxonomy.

Privacy & Test Environment Data

Privacy & Test Environment Data

Protects sensitive data when production data is delivered to non-production environments.

9 capabilities

PROD → TEST / PREPROD refresh

Refreshes non-prod environments under explicit purpose and environment policy.

Source-side masking

Transforms sensitive values before they leave the source process boundary.

Deterministic HMAC masking

Produces repeatable fictitious identities for the same business identity.

Masking rule set

Supports DROP, NULL, CONSTANT, HMAC_HASH, EMAIL_FAKE, PHONE_FAKE, ID_FAKE and DATE_SHIFT.

Consistency groups

Keeps related parent/child and business-key identities consistent after masking.

Unique collision guard

Checks generated values for collisions on unique columns.

Secret-field default deny

Treats password, token, secret, API-key and salt fields as deny/drop by default.

TEST → TEST alignment

Replicates data between test environments to build a common integration baseline.

New TEST bootstrap

Bootstraps a newly created test database from an approved source or backup.

Validation, Drift & Repair

Validation, Drift & Repair

Checks source-target consistency in addition to transfer completion.

9 capabilities

Row-count reconciliation

Compares source and target row counts within the transfer window.

PK bucket validation

Splits large tables into PK ranges for count + digest validation.

Bounded copy verification

Binds validation to the same snapshot/watermark boundary.

Drift localization

Localizes mismatches to the affected bucket/range instead of the entire table.

Target-extra report-only

Reports extra target rows rather than automatically hard-deleting them.

Targeted resync

Plans controlled UPSERT repair only for mismatched buckets/ranges.

Post-repair revalidation

Recalculates count/digest values after repair.

Post-restore validation

Reuses the validation model after a backup restore.

Validation history

Persists validation runs and bucket evidence as operational records.

Schema, Metadata & Compatibility

Schema, Metadata & Compatibility

Validates source/target shape before data writes and narrows the dynamic SQL surface.

9 capabilities

Primary key requirement

Fails closed instead of silently falling back when keyset pagination has no PK.

Composite PK support

Preserves ordered multi-column primary/sync keys from metadata.

Schema alignment preflight

Checks type, nullability, length, precision/scale and signed/unsigned compatibility.

Target extra-column guard

Detects required target columns that are absent from the source payload before transfer.

SAFE_ALIGN approach

Designed for controlled, non-destructive schema widening where explicitly allowed.

Target catalog guard

Verifies configured target schema against the active JDBC catalog before writes.

Profile-driven metadata

Lets multiple customer/instance profiles reuse the same runtime with different metadata.

Parent watermark strategy

Allows child-table delta windows to be defined through parent metadata.

Case / naming safety

Surfaces platform and production naming/case differences during preflight.

Backup, Recovery & DR

Backup, Recovery & DR

Protects the operation chain from backup creation to recovery readiness.

10 capabilities

Production backup snapshot

Moves PROD or PREPROD data to a controlled backup target.

Safe mysqldump credentials

Passes DB credentials through an option file rather than the process command line.

Backup readiness checks

Validates the executable and backup directory before starting.

GZIP integrity

Verifies that compressed backup artifacts are readable.

SHA-256 sidecar checksum

Tracks backup artifact integrity with a checksum sidecar.

Retention policies

Supports daily, weekly and monthly retention cycles.

FULL_REBUILD protection

Requires explicit enablement, confirmation and a successful backup before destructive rebuild.

Exclusive backup/rebuild lock

Prevents backup and full-rebuild operations from overlapping.

Last-success metadata

Tracks the last successful backup point for operations.

DR target flow

Supports production-to-recovery/DR transfers without masking.

Performance & Large-Volume Architecture

Performance & Large-Volume Architecture

Controls network, memory, database and concurrency pressure at scale.

11 capabilities

GZIP response negotiation

Compresses HTTP payloads for network efficiency.

Compressed/uncompressed size guard

Bounds both wire and decoded response sizes.

Batch UPSERT

Writes rows in bounded transactional batches.

Reusable HttpClient

Uses one configured HTTP client instead of creating a new one per request.

Connection pooling

Uses isolated Hikari target pools per client.

Retry + exponential backoff

Retries transient HTTP/transport failures with bounded backoff.

Client-scoped circuit protection

Stops further source calls after repeated exhausted transport failures.

PK range partitioning

Architecture for splitting very large tables into independently tracked PK ranges.

Adaptive batch

Architecture for adjusting batch size to DB commit, connection and memory pressure.

Backpressure

Slows source read/write flow when the target database becomes the bottleneck.

Memory-bounded streaming

Keeps memory proportional to page/batch size rather than total dataset size.

Observability & Operations

Observability & Operations

Correlates run, request, table and page layers in one operational model.

12 capabilities

RUN_ID correlation

Links Java worker cycles and source logs through a common run identity.

REQUEST_ID correlation

Traces the same data-page request across source LOG_SYNC and target transfer metrics.

Typed run results

Carries typed terminal run outcomes together with operational counters.

Per-table metrics

Records rows, duration and terminal result per table.

Page transfer metrics

Tracks rows, compressed/uncompressed bytes, DB write, HTTP and retry data per page.

Throughput visibility

Measures rows/sec and bytes/sec.

Layered preflight / health

Checks config, connectivity, auth, metadata, target, schema, backup and runtime safety.

Validate-only execution

Checks config/policy/schema/readiness without moving data.

Admin log filtering

Searches source logs by instance, platform, run and request identity.

XSS-safe log UI

Renders dynamic log content as safe text rather than executable HTML.

Telemetry retention

Applies bounded retention to operational and validation records.

Secret-free operations view

Keeps credentials, tokens, raw payloads and stack traces out of operations views.

Topology, Deployment & Licensing

Topology, Deployment & Licensing

Supports multiple environments and target models rather than assuming a single source.

8 capabilities

Multiple sources → shared target

Manages multiple PROD/TEST sources against one backup target with client/source-instance isolation.

Multiple sources → dedicated targets

Routes sources to separate TEST, DR, standby or backup targets.

Source-instance isolation

Scopes flow identity by source instance, client, run and profile.

Self-Hosted license

Runs the runtime and target DB in your own server, data center or cloud account.

Aereo Managed Cloud Backup

Allows the backup target and operations to be managed in Aereo infrastructure under the service scope.

On-prem / cloud hybrid topology

Supports source and target systems across different network/cloud boundaries over HTTPS.

Profile-based configuration

Handles customer/instance differences through profiles and configuration rather than runtime forks.

Independent backup schedule

Schedules backup jobs independently from the fixed-delay data-sync worker.

ECOSYSTEM ROADMAP

Planned directions that expand the product ecosystem

Roadmap items describe the product expansion direction and targeted connector ecosystem.

Database Connector Roadmap

TODAYMySQL / MariaDB
  • PostgreSQL · Priority 1
  • Microsoft SQL Server · Priority 2
  • Oracle Database · Priority 3
Prioritized to cover PostgreSQL developer demand plus the broad enterprise footprint of SQL Server and Oracle.

Source Connector / API Language Roadmap

TODAYPHP 8.x
  • Node.js / TypeScript · Priority 1
  • Python · Priority 2
  • Java Source Connector / SDK · Priority 3
  • C# / .NET · Priority 4
Node.js/TypeScript, Python, Java and C#/.NET cover major backend/API ecosystems.

Product Capability Roadmap

  • Controlled Test Data
    bounded subset · relation closure · deterministic seed · safety hooks
  • Safe Mapping & Lineage
    rename · safe cast · defaults · mapping manifest · lineage
  • AEREO Replicate / CDC
    log-based change capture · lag/RPO · standby role
  • Advanced Recovery
    restore drill · promote/failback UX · tamper-evident audit
  • Data History
    SCD2 · append-only change archive · point-in-time workflows

Roadmap Principle

New connectors should plug into the existing policy, checkpoint, validation, masking and observability contracts through a common connector framework, avoiding a rewrite of the security core for each database or language.

Let’s identify the right capability package for your use case.

We can shape the architecture around backup, PROD-to-TEST, TEST alignment, DR or Managed Cloud Backup.