Difference between revisions of "Cleaning Up Old QVD Files"

From Vital Soft Wiki
Jump to: navigation, search
>Jeremyb
>Kevint
 
(3 intermediate revisions by 2 users not shown)
Line 1: Line 1:
  
−
Vital Signs creates binary qvd files housing all of the extracted data which are stored in the c:\vitalsigns\cu-name\data\qvd directory.
+
Vital Signs creates binary qvd files containing the extracted data from the core.  These files are stored in the c:\vitalsigns\cu-name\data\qvd directory.
  
 
''Note: The vitalsigns directory may be located on a different drive than c:\ .''
 
''Note: The vitalsigns directory may be located on a different drive than c:\ .''
  
−
Vital Signs, as of version 1.5, does not attempt to clean up older qvd files. In subsequent versions this may become a feature that can be enabled.
+
Starting with Version 1.7 of Vital Signs, released Fall 2015, Vital Signs includes a '''cleanup''' job that deletes old QVD files.
  
−
The current recommendations for cleaning up this directory to save on disk space are shown here :
+
Users must '''explicitly enable''' the QVD cleanup feature and configure the number of days (and month-ends) of data that Vital Signs should keep.
  
−
''Note : The names listed are the first part of the file names, there will be date stamps appended to them in the qvd directory.''
+
The QVD cleanup is enabled and configured in the [[vsigns_srv.ini]] file. The relevant keywords are repeated here for convenience:
  
 +
{| class="wikitable"
 +
| '''INI Keyword'''
 +
| '''Default Value'''
 +
| '''Purpose'''
 +
|-
 +
| QVD_DELETE_OK
 +
| N
 +
| Set this to "Y" to enable deletion of old QVD files.
 +
|-
 +
| HIST_QVD_NDAYS
 +
| 750
 +
| Number of days of raw HIST QVDs to retain.  Minimum is 400 days (roughly 13 months).
 +
|-
 +
| MBR_QVD_NDAYS
 +
| 750
 +
| Number of days of raw MBRSHLN QVDs to retain.  Minimum is 400 days (roughly 13 months).
 +
|-
 +
| MBR_QVD_NMTHENDS
 +
| 60
 +
| Number of monthend days of raw MBRSHLN QVDs to retain.  Minimum is 25 monthend days.
 +
|}
  
−
'''Daily Member, Share and Loan File extracts'''
+
* By default, approximately 25 months (750 days) of HIST and MBR (member, share, loan) daily extracts is retained.  Increasing HIST_QVD_NDAYS and MBR_QVD_NDAYS will save more of the daily extracts.
 +
* By default, 5 years (60 month-ends) of MBR (member, share, loan) month-end data is retained.  Increasing MBR_QVD_NMTHENDS will save additional month-end extracts.
 +
* Once QVD cleanup has been enabled in the vsigns_srv INI file, the actual cleanup can be performed by launching the cleanup job.
  
−
These files contain the daily extracted information for members used by the Analysis_by_Account, Summary and Loan Application documents.
+
== JVSCLEANUP ==
  
−
It is recommended that you keep 24 months of daily files and only retain the EOM dated files older than 24 months.
+
The actual cleanup is started by launching a job from HPUX:
−
<pre>
 
−
ATTRDESC
 
−
COLLFILE
 
−
LNADDM
 
−
LNAP_APP
 
−
LNAP_BOASST
 
−
LNAP_BOSCOR
 
−
LNAP_TERMS
 
−
LNFILE
 
−
LNTBCL
 
−
MBRATTR
 
−
MBRFILE
 
−
MBRPROD
 
−
SHCHGOFF
 
−
SHFILE
 
−
SHTBCL
 
−
VEHCINFO
 
−
VISAINFO
 
−
</pre>
 
  
 +
  /VSJOBS/JVSCLEANUP [PRINT=YES|NO] [DELETE=YES|NO]"
  
−
'''Data Change Files'''
+
Where:
  
−
These files contain the data for the Spectrum Data Change document.
+
{| class="wikitable"
 +
| '''Job Parm (Note)'''
 +
| '''Default Value'''
 +
| '''Purpose'''
 +
|-
 +
| PRINT
 +
| Yes
 +
| When set to YES, the job will print a detailed list of all QVD files deleted.
 +
|-
 +
| DELETE
 +
| No
 +
| When set to Yes, QVD files will be deleted.  When set to No, no files are deleted.
 +
|}
  
−
It is recommended that you keep 12 months of these files.
+
We '''strongly recommend''' that you run the job in preview mode before actually deleting any QVD files.
−
<pre>
 
−
DTACHGLN
 
−
DTACHGSH
 
−
</pre>
 
  
 +
For example, running:
 +
:/VSJOBS/JVSCLEANUP DELETE=NO
 +
will print a detailed list of files that qualify for deletion, but no delete will be performed. 
  
−
'''Transaction Files'''
+
When you are confident that the list of qualified files is correct, you can proceed to delete the files as follows:
−
 
+
:/VSJOBS/JVSCLEANUP DELETE=YES 
−
These files are used by the older Transaction_Activity and newer Transaction_Analysis documents.
+
* Remember, use the vsigns_srv INI variables HIST_QVD_NDAYS, MBR_QVD_NDAYS and MBR_QVD_NMTHENDS to configure how much history to retain in Vital Signs.
−
 
+
* If space allows, we recommend setting MBR_QVD_NMTHENDS at 60 or higher, so that you retain at least 5 years worth of month-end data.
−
It is recommended that you keep 25 months of these files.
+
* Once you are confident with your setup, schedule the JVSCLEANUP job to run monthly via UC4.
−
<pre>
 
−
TLRHIST (only used by the deprecated Transaction_Activity document)
 
−
HIST
 
−
CL
 
−
TLRHRS
 
−
</pre>
 

Latest revision as of 21:01, 15 May 2019

Vital Signs creates binary qvd files containing the extracted data from the core. These files are stored in the c:\vitalsigns\cu-name\data\qvd directory.

Note: The vitalsigns directory may be located on a different drive than c:\ .

Starting with Version 1.7 of Vital Signs, released Fall 2015, Vital Signs includes a cleanup job that deletes old QVD files.

Users must explicitly enable the QVD cleanup feature and configure the number of days (and month-ends) of data that Vital Signs should keep.

The QVD cleanup is enabled and configured in the vsigns_srv.ini file. The relevant keywords are repeated here for convenience:

INI Keyword Default Value Purpose
QVD_DELETE_OK N Set this to "Y" to enable deletion of old QVD files.
HIST_QVD_NDAYS 750 Number of days of raw HIST QVDs to retain. Minimum is 400 days (roughly 13 months).
MBR_QVD_NDAYS 750 Number of days of raw MBRSHLN QVDs to retain. Minimum is 400 days (roughly 13 months).
MBR_QVD_NMTHENDS 60 Number of monthend days of raw MBRSHLN QVDs to retain. Minimum is 25 monthend days.
  • By default, approximately 25 months (750 days) of HIST and MBR (member, share, loan) daily extracts is retained. Increasing HIST_QVD_NDAYS and MBR_QVD_NDAYS will save more of the daily extracts.
  • By default, 5 years (60 month-ends) of MBR (member, share, loan) month-end data is retained. Increasing MBR_QVD_NMTHENDS will save additional month-end extracts.
  • Once QVD cleanup has been enabled in the vsigns_srv INI file, the actual cleanup can be performed by launching the cleanup job.

JVSCLEANUP

The actual cleanup is started by launching a job from HPUX: 

 /VSJOBS/JVSCLEANUP [PRINT=YES|NO] [DELETE=YES|NO]"

Where:

Job Parm (Note) Default Value Purpose
PRINT Yes When set to YES, the job will print a detailed list of all QVD files deleted.
DELETE No When set to Yes, QVD files will be deleted. When set to No, no files are deleted.

We strongly recommend that you run the job in preview mode before actually deleting any QVD files.

For example, running:

/VSJOBS/JVSCLEANUP DELETE=NO

will print a detailed list of files that qualify for deletion, but no delete will be performed.

When you are confident that the list of qualified files is correct, you can proceed to delete the files as follows:

/VSJOBS/JVSCLEANUP DELETE=YES
  • Remember, use the vsigns_srv INI variables HIST_QVD_NDAYS, MBR_QVD_NDAYS and MBR_QVD_NMTHENDS to configure how much history to retain in Vital Signs.
  • If space allows, we recommend setting MBR_QVD_NMTHENDS at 60 or higher, so that you retain at least 5 years worth of month-end data.
  • Once you are confident with your setup, schedule the JVSCLEANUP job to run monthly via UC4.
Retrieved from "https://wiki.vital-soft.com/index.php?title=Cleaning_Up_Old_QVD_Files&oldid=1279"