Previous Topic: 9. PROCESSING

Next Topic: 9.2 Daily Update Processing Flow

9.1 Processing Overview


The CA MICS Web Analyzer makes use of the standard database
update and summarization facilities of CA MICS to maintain
its data in the online and offline databases.  The SMF data
and log data is supplied to CA MICS in the DAY052 step of the
DAILY database update job.

The daily update step:

o  Reads and formats the raw data
o  Maintains data integrity by eliminating duplicate data
o  Summarizes activity
o  Adds new cycles to the DETAIL and DAYS timespans
o  Updates the week-to-date and month-to-date cycles

A more detailed description of DAY052 processing is presented
in the next section.

Weekly processing is performed by the WEEK052 and WEEK300
steps.  The WEEK052 step splits the week-to-date files into a
new week-to-date and a new weekly '01' cycle.  The WEEK300
step creates the weekly offline database files.

Monthly processing is performed by the MONTH052 and MONTH300
steps.  The MONTH052 step splits the month-to-date file into
a new month-to-date and a new monthly '01' cycle.  It also
appends the data to the year-to-date file.  The MONTH300 step
creates the monthly offline database files.

The optional yearly processing is performed by the YEAR052
step which splits the year-to-date files into a new year-to-
date and a new yearly '01' cycle.

/---------------\ START | +-------------------+ \ | | | | DERIVE COMMON | PREPARATION | | DATA ELEMENTS | +------------------+ PHASE | | PHASE | | | +---------------+ | +---------------+ | | | | | | Invoke macros | | +---------------+ | Delete old | | | to derive | | | Invoke "input | | copies of | | | common fields | | | history log" | | WEBfff00 | | +---------------+ | | macro | | | | | | +---------------+ +-------+-------+ | | | | | | | | | | | | | +---------------+ +---------------+ | | | | Sort work | | DATA statement| | | | | files | | defines all | | | | | Eliminate | | output files | | PROCESS | | | duplicates | +-------+-------+ | INDIVIDUAL | | | Create DAYS | | | RECORDS | | | files | | | PHASE | | +---------------+ +---------------+ | +---------------+ | | | Define and set| | | Process | | | | constants | | | SMF/WLE | | +---------------+ | Define and set| | | Utility | | | Delete work | | control data | | | Records | | | files | | elements | | |_______________| | +---------------+ +-------+-------+ | | | | | | DELETE DETAIL | | UPDATE DATA- | INPUT PHASE | | AND DAYS HIGH | | BASE PHASE | +---------------+ | CYCLE +---------------+ | +---------------+ | Read data | | | | | | Update | | record | | | Delete old | | | Week-to-date | +-------+-------+ | | copies of | | | and | | | | WEBfff00 | | | Month-to-date | | | | | | | cycle | +---------------+ | +-------+-------+ | +---------------+ | Check record | | | | | | length | | | | AGE DATABASE | +-------+-------+ | MANIPULATE | | FILES PHASE | | | CREATE DETAIL | | +----------------+ | | FILES PHASE | | | Delete | +---------------+ | ----------------- | | oldest | | Checkpoint 1 | | | Report dropped| | | cycles | | | | | observations | | +----------------+ +-------+-------+ | | by file | | | | | | | | +----------------+ | | ----------------- | | Age cycles | +---------------+ | | | +----------------+ | Invoke USRSEL | | | | | | macro | | +---------------------------+ /----------------\ +-------+-------+ | | END | | | \ +---------------+


Figure 9-1. Processing Flow Diagram