Previous Topic: Loading Pending RecordsNext Topic: Adapter Time Formats


Event Management

The Event Viewer is used to search and view raw data events. The Event Viewer enables viewing, printing and exporting the events retrieved from adapters, “received” business logic events (retrieved from committed metrics), “sent” business logic events (sent to metrics) and corrected events.

The Event Viewer can also be used from the Business Logic Scope to show received and sent events.

The Event Viewer is used to quickly find data gaps and check the data integrity. It is also used when customers require the documentation of all information flowing into the system. Using the Event Viewer, a report based on the events can be created.

Overview

Insight’s Event management feature enables manipulation of raw data events. Users can select and view business data using a number of different report filters. Sometimes however, the raw data will lead to a seemingly incorrect result or problem. Event Management enables editing data in order to correct seemingly erroneous data reporting errors.

Consider for example, the following situation:

The table below lists the Raw Data events available in Insight, the states available to each, possible sources and an explanation.

Note: Each event type can be in one or more states:

Event Types

Event State

Explanation

Raw data

(Original)

Sources:

  • Text Adapter
  • SQL Adapter
  • Data Loading Forms
  • Manual

Original

Original raw data event (e.g., from adapters). Added via File/SQL Adapter and the Data Loading Form.

Exclude

An original raw data event that was logically deleted (rather than physically purged).

Raw Data

(Corrected)

Source:

  • Correction

Corrected

A raw data correction event. This may be caused by:

  • Replacement of an original record due to editing.
  • Addition of a new manually added correction event that replaces an original record due to editing.

Overridden

An original raw data event that was edited and is replaced by another event record.

Business Logic

Source:

Metric

Business

Business Logic event "received" (from a committed metric) or “sent” (to a metric).

Event Management Screen

The Event Management window enables searching for raw data events and viewing them. In addition, you can print and export events retrieved from adapters, “received” business logic events (retrieved from committed metrics), “sent” business logic events (sent to metrics) and corrected events (i.e., events that have been replaced, added or deleted manually via corrections and update and delete individual raw data records, i.e., the following:

Permissions / Access Control

The following table and figure show the permissions required to use the Event Management functions.

Functionality

Required Permission

Raw Data Audit Trail (View)

Event Management - View

Event Management - View

Event Management - View

Event Management (Add, Update, Delete, Revert)

Event Management - Update

Report Raw Data (Edit, Delete)

Event Management - Update

Report Raw Data (View)

Report View Raw Data

Viewing Events

Searching for events is a two-part process. The first part is to select the search criteria. The second is to sort and group the events.

You can search for an event by Timestamp, Event Type, Resource and Destination Metric.

  1. To open the Event Management window click Design, Data Acquisition, Event Management. The Event Management windows opens.
  2. Select the desired filter parameters and click the Search button. The window displays a list of Events corresponding to the search criteria.
  3. Follow the instructions below to search for events.

To search for events:

  1. In the Event Management page, expand the search form and select the search option/s:
    1. In Timestamp, select:
    1. In Event Type, select the event type from the Available list and move to the Included list.
    2. In Resource:

    -OR-

    1. In Destination Metric:

    -OR-

  2. Click Search. The results are displayed below the search area. For more information on the search results grid, see Using Search Results Grids.

The search results include the following information about each event:

Event Parameters

The Event Management window includes the Details column (see subsection following) in addition to the following attributes:

ID

Event Type

Source Name Resource

Resource

Timestamp

State

The Insight ID number assigned to the Raw Data or Business Event ID.

The event type.

The name of the source adapter or data loading form or "Correction" or source metric.

Lists the Resource Name.

Lists the date/time (or corrected date/time) if the event in the user's time zone.

Shows the state of each event. This can be any of the following:

  • Original
  • Overridden
  • Excluded
  • Correction
  • Business

Event States

Each Event exists in a specific state. The table below lists possible Event states and an explanation of each.

Event State

Explanation

Original
(+pending)

Original raw data event (e.g. from adapter). Added via File/SQL Adapter and the Data Loading Form.

Overridden
(+pending)

Original raw data event that was edited and is replaced by another event record.

Reverted
(+pending)

Original raw data event that was logically deleted (rather than physically purged).

Correction
(+pending)

A raw data event replacing an original record due to editing.

Business Logic

Business Logic event "received" (from a committed metric) or “sent” (to a metric)

Event Management: Details

In addition to the parameters listed above, the Event Management Window lists Details of events. The Details column shows a compacted description of the event fields and their values.

A full version of Event Details is shown in the Details pane (on the far right).

Editing Events

Events can be edited from within the Details pane when:

The following event attributes can be edited:

Note: The Event Type cannot be changed.

Event Operations

The following operations can be performed on Insight events.

Notes:

To Edit an Event

  1. Click the event to be edited. The Details panel opens.
  2. Click the Edit button. The parameters that can be edited appear as entries in a text entry field.
  3. Edit the parameter/s as required and click the Correct button to correct (i.e., save, the new value/s in memory only).

Editing Constraints

The following restrictions/constraints apply when editing an Event:

Committing Changes

To commit changes, Follow these steps::

  1. Press the “Correct” button.
  2. To commit changes (if any) press the “Commit” button.
  3. The tree in the left side panel is not immediately updated (even the totals) until a Commit is done.
  4. The changes are committed and appear in all new calculations using this data.

Event States After Editing

The table below lists the changes to an Event’s state following editing.

Event State

Edited Event State

Explanation

Original

Pending Overridden

Pending Correction

An original event that is edited becomes marked as "Pending Overridden" and a new event record is created. The new event is marked as a "Pending Correction" event. The source of the new Correction event is "Correction." The original event is retained as "Overridden" and it is never erased.

Corrected

Pending Deleted Correction

Pending Correction

A Corrected Event is called "CE(i). The "i" represents the number of times an event has been edited.

In Event Management, the "i" can be incremented by editing the current version, but it can never be decremented. You can revert from any edited version back to the original version.

Pending

Click "Commit" to change a "Pending" event to "Corrected."

Editing an event state (Correct, Delete, Revert) causes the event to be marked as "pending." To change "Pending" to Corrected", commit the pending event.

Note: Corrections are stored in memory; they are not saved to the database. To save to the database, click Commit; a recalculation will be performed as well.

Corrections and Event Singularity

A singular event is one that occurs exactly one time. Instead of adding a new event to an existing set of events, new information replaces the current information and a single event remains.

Example: President of the USA. There is only one. A different person eventually occupies the office (new information, new date, etc.) but there is only one at any given time.

Loading a singular event after a correction has been defined

Corrections take precedence over event singularity, even if the adapter with "update" event singularity was run with the original data after the correction was done.

Corrections take precedence over an automatically changed action (event singularity).

When an event is in state "Original", and the event must be updated due to event singularity, it is updated and keeps the state "Original"

When an event is in state "Excluded", and the event is updated due to event singularity, the event is updated and the state "Excluded" is maintained.

For corrected events, two events exist: "Overridden", and "Correction". When running a corresponding adapter, the "Overridden" event may have its details updated (and remain "Overridden"): the "Correction" remains as is.

The Event Singularity mechanism only checks in the database for events inserted by the current adapter (i.e., state Original/Overridden/Excluded). It does not look at events whose source is "Correction", or events inserted by other adapters.

To correct events with an event singularity defined on the adapter

No checking is done for Event Singularity performing a Correction. The Correction mechanism does not provide Event Singularities with "Add". This means that it is possible to correct two separate events to have the same data. The event singularity defined on the original adapter is not referenced.

Additional Editing Information

The controls shown during Edit correspond to the field structure of the Event Type that you have selected.

The Resource name of the event being edited is displayed next to “Resources” parameter name.

  1. Click the button next to it (see figure below) to display the “Select Resources” popup. You can select any Resource within the system.

    Note: The resource name shown is the actual resource name (i.e. after translation). Therefore within the Edit Details pane, a preexisting resource is required.

    Note: When the Event type structure has more fields than are defined in the raw data event, those fields are shown as “null” in view mode. In edit mode these edit boxes are empty (see figure above).

    Note: When the Event type structure has fewer fields than are defined in the raw data event, the additional fields are shown in view mode (as type “unknown”), but disappear within edit mode.

When correcting an event, its structure will corresponding to the latest Event Type structure.

Default Data Structure

The Event type individual fields are optional. If a user presses the “Correct” button, without first entering a value for optional fields, the value of the optional fields will be set automatically using the following conventions:

Field Type

Default Value

Strings

Empty String

Integer/Real

0

Date

1970/01/01

Event Comparison

Event Comparison enables the user to view “Overridden” events and their corresponding “Correction” events.

To compare an event

  1. Locate and click any event that is not is it Original state.
  2. Expand the Details pane.
  3. Click the Compare button; the Event Comparison window appears. You can view the compared events side-by-side. Differences are highlighted.
Reports: Editing Event Data

Insight enables editing Event data within a Reports’s Analysis tab. This enables modifying data “on the fly” in order to correct errors when viewing a report.

To edit data

  1. Generate a report (or open an existing one).
  2. Right click on the chart and drill down to the data to be changed.
  3. Right click on the chart and select “View Raw Data”.

OR

  1. Generate a report (or open an existing one).
  2. Click the Analysis tab. The screen displays the Reports parameters.
  3. Select the desired parameter (more than one may be present – see figure below: parameters are outlined in red).
  4. Click the arrow next to the corresponding “View Raw Data and Root-Cause Comments”. The Raw Data is displayed.
  5. An “Open Event Management” icon is displayed on each row corresponding to a raw data event (as opposed to intermediate data). The state of these events is shown.
  6. Click an Event’s “Open Event Management” icon. The “Event Management” window opens to the same Raw Data result set displayed in the current Report. The Event selected above is the one selected in the “Event Management” environment that is now open.
  7. Edit, Correct and Commit the data as required (see Committing Changes, below)

Calculation Status

The calculation status of a report is given by the Calculation Status icon located at the top the Report (in all tabs).

The Calculation Status can be any of the following:

Calculation Status

Icon

Description

Complete

Calculation is complete and up to date for the report (and all its composite reports.)

Not Calculated

The ACE calculation engine has started calculating the data contained in the report.

Partially Calculated

The ACE calculation engine recalculated some of the data in the report.

Unknown

Unknown calculation status.

Calculation Delay

After the “Commit” button is pressed (or after Data is loaded via an Adapter or DLF), there is a period during which the information shown in the Data and the Chart tabs is different than the data displayed in the Analysis tab.

During this period, the Report status may initially be shown as “Complete”, instead of “Not Calculated”. This is because the ACE engine has not yet processed the changes.

Note: If the last calculation date is earlier than the date/time of an Event Management “Commit”, but the status is still “Complete”, the ACE engine has not yet started processing these changes.

Note: Following this, the calculation status is shown as “Not Calculated”, “” or “”. Once the recalculation is completed the status becomes “Complete”; information in the Data and Chart tabs then matched the data in the Analysis tab.

The Commit message box therefore includes a warning to the user that “Reports dependant on this data may not be immediately updated”.

Committing Changes

Changes that have been made to data must be committed in order for them to take effect.

  1. Go to the Event Management main window; select the data to be committed. This is all data that is in the state: Pending.
  2. Click the Commit button to commit the corrected entry to the database. The Commit Corrections dialog opens.
  3. Enter the justification for making the change and click “Commit”. The change will be committed and will appear in all new calculations using this data.

    Note: All pending data changes in the current user session are committed.

    Note: In the event of an error, no data will be committed

    Note: Data is committed in the order in which it was modified.

    Note: Changes are logged in the Audit Trail.

    Note: The Calculation Engines (ACE 1 and ACE2) are notified that they can do a recalculation for each change.

  4. If you do not "Commit" button all changes are lost if any of the following occur:
Audit Trail

The Audit Trail contains a description of all changes made to Event Management data. This includes the Create Date of the changes, the User who made them, the Justification and an automatically generated Description of the actual changes made to each EventID involved.

To View the Audit Trail