Data ingestion patterns and times for ERPx
Initial batch
When a subscription is created, a full data ingestion is performed. The time varies depending on data volume. The process is the following:
- A subscription is created in Data Hub Portal.
- The Data Hub API requests the ERP API.
- The ERP API queues the ingestion request in an ERPx database.
- ERPx executes full data ingestion.
- Data Hub processes the data to make it available via the Delta Sharing connector.
ℹ️ Data Hub ingestion process:
Update data load
First layer of data
Processing depends on the data product type.
| Data product type | Processing schedule |
|---|---|
| Supporting Message Hub | Updated on change in ERPx |
| Other products | Incrementally updated daily at 02:00 UTC |
Subsequent layers of data
Processing for Bronze, Silver and Gold depends on subscription.
| Subscription frequency | Processing schedule |
|---|---|
| Daily | At 04:00 UTC every day |
| Weekly | At 04:00 UTC on Sunday |
| Monthly | At 04:00 UTC on the first day of the month |
ℹ️ Data ingestion layers and times:
