Data Mediation › Data Import › Data Import Frequency

Data Import Frequency

You must decide the frequency of data imports. To determine the frequency you must consider your reporting requirements.

For example, consider the following:

• If an invoice, an SLA report, a metric report, or a custom report is run daily, then the Data Mediation feed frequency must also be daily.
• If the data is required for a monthly bill run, then a monthly feed may be appropriate.
• The volume of data being imported. For example, if millions of records are to be loaded monthly, it may make sense to import subsets daily to spread the processing and minimize the end-of-month window. Another benefit of this granular approach is to avoid having to unload and reload larger data sets if changes are necessary. The size of the data set does not affect the commit size in the database tables. The best practice is to perform commits in small batches, rather than after the entire data set. This approach minimizes lock contention and log file growth.