Short answer
Scheduled synchronization runs a job at fixed intervals to find and transfer everything that changed since the previous run. It is simple, predictable, and efficient for large volumes, especially with bulk APIs, but data is only as fresh as the interval. Good scheduled jobs use checkpoints, overlap windows, idempotent writes, and monitoring of run success.
Scheduled synchronization (also called batch sync) transfers data on a timetable — every five minutes, every hour, every night — rather than in response to individual events.
How it works
- A scheduler starts the job.
- The job reads its checkpoint: the point up to which the previous run succeeded.
- It queries the source for records changed after the checkpoint (minus a small overlap window).
- It processes or enqueues each record, writing to the target idempotently.
- Only when everything succeeds does it advance the checkpoint.
Advantages
- Simplicity: one job, clear start and end, easy to rerun.
- Predictable load: you choose when it runs, including off-peak.
- Bulk efficiency: many APIs offer bulk or batch endpoints suited to scheduled jobs.
- No public endpoint required.
- Natural reconciliation: a full comparison run is just another scheduled job.
Disadvantages
- Staleness: data can be up to one interval old.
- Wasted runs: jobs run even when nothing changed.
- Burst load: a large backlog can produce heavy bursts.
Design rules
- Never advance the checkpoint before processing completes.
- Use overlap windows and idempotent writes.
- Prevent overlapping runs with a lock, or a slow run can collide with the next one.
- Monitor last success time, duration, and records processed; alert when a run has not succeeded for longer than expected.
- Request minimal data in change queries; fetch details only for changed records.
Where it fits
Scheduled sync is ideal for catalog updates, price lists, nightly inventory reconciliation, financial postings, and ERPs that import in batches. For time-sensitive data, combine it with event-driven updates — see real-time vs. scheduled synchronization.
Summary
Scheduled synchronization moves changed data at fixed intervals using checkpoints. It is simple, predictable, and efficient, at the cost of freshness. Implement it with careful checkpoints, overlap windows, idempotent writes, and run monitoring.
Frequently asked questions
What is a checkpoint?
A stored marker — usually a timestamp or sequence number — recording how far the last successful run got. The next run queries changes after the checkpoint.
Why use an overlap window?
Clocks differ between systems, and records can be written during a run. Re-querying a few minutes before the checkpoint ensures nothing is skipped. Idempotent processing makes the resulting duplicates harmless.
Is scheduled sync outdated?
No. It remains the best option for bulk data, batch-oriented ERPs, and reconciliation, and it is often combined with event-driven processing.
Sources and further reading
Platform-specific statements on this page were checked against these sources on . Vendor APIs change; confirm details in the current documentation before you build.
- [1] Shopify bulk operations — Shopify
- [2] Shopify orders query (updated_at filter) — Shopify
Related reading
- Comparisons Real-Time vs. Scheduled Synchronization When ecommerce-ERP data should sync in real time and when a schedule is better — compared by workflow, cost, complexity, rate limits, and failure behavior.
- Comparisons Webhooks vs. Polling: Choosing How Your Integration Detects Changes Compare webhooks and polling for detecting changes in integrations — latency, completeness, cost, infrastructure, and failure modes — and learn when to combine them.
- Guides Shopify Webhooks vs. Polling for ERP Integrations When to use Shopify webhooks, when to poll the GraphQL Admin API, and how to implement the hybrid pattern Shopify itself recommends for ERP integrations.
- Concepts What Is Inventory Reconciliation? What inventory reconciliation is, why stock drifts between an online store and an ERP, how to compare and correct quantities safely, and how often to reconcile.