Updates to the MSSL IDFS Archive

This page lists major updates to the MSSL IDFS Archive, including new pidfs, new VIDFS and reprocessed data. Normal daily processing is not listed here of course.

2008-03-01

New inter-anode calibrations v5.2 have been released. CLUSTERII 3DF, 3DR, 3DX1, 3DX2, PAD, SPINPAD and LER VIDFs have been replaced.

2007-08-31

DOUBLESTAR TC-2 FGM DFUNIT data has been replaced. New files were made used a new version of cleaned files from FGM.

2007-08-09

DOUBLESTAR 3DF VIDFs have been replaced with daily VIDFs with improved inter-anode calibration. These VIDFs are labelled as Calibration Version 2.0.

2007-08-08

CLUSTERII 3DR, 3DX1 and 3DX2 VIDFs have been replaced. These VIDFs are labelled as Calibration Version 5.1.

2007-08-06

All 2004-2006 DOUBLESTAR TC-2 RPAD data replaced with newly-regenerated data (spin information now included correctly)
CLUSTERII PAD, SPINPAD, LER and 3DF VIDFs have been replaced. These VIDFs are labelled as Calibration Version 5.1.
CLUSTERII MOMS_L2 now available to 2006-12-31.

2007-07-17

All 2004-2006 DOUBLESTAR RPAD data replaced with newly-regenerated data.

2007-06-19

All 2004-2005 DOUBLESTAR RPAD data replaced with newly-regenerated data.

2007-06-11

All 2006 DOUBLESTAR RPAD data replaced with newly-regenerated data.

2007-06-06

All CLUSTERII VIDFs for PAD, SPINPAD, LER, 3DR, 3DF, 3DX1 and 3DX2 replaced with new versions. New VIDFs contain the calibration version number in a machine-readable way, and gaps between some consecutive VIDFs have been corrected.

2007-05-23

All DFUNIT replaced with newly-regenerated data to correct a timing problem.

2007-04-02

All CFUNIT replaced with newly-regenerated data to correct a timing problem.

2007-03-08

CLUSTERII PAD, SPINPAD, LER, 3DR, 3DF, 3DX1 & 3DX2 VIDFs have been replaced. The new VIDFs use Calibration Version 5. 3DR, 3DX1P and 3DX2P have improved geometric factors as well as improved inter-anode calibration. PAD, SPINPAD, LER, 3DF and the remaining 3DX products have improved geometric factors only.

2006-11-27

CLUSTERII PAD, SPINPAD, LER, 3DR, 3DF, 3DX1 & 3DX2 VIDFs have been replaced. The azimuthal offset angle defined in CONSTANT 01 is now correct for all VIDFs. NOTE 2 in the comments has also been replaced.

2006-11-09

CLUSTERII PAD, SPINPAD, LER, 3DR, 3DF, 3DX1 & 3DX2 VIDFs have been replaced. They are the same as the previous update, but the generation date of the VIDF is now included in the comments.

2006-11-07

DOUBLESTAR PEACE 3DF, 3DR, PAD, RPAD VIDFs updated. Comments adjusted properly for Double Star.

2006-11-02

DOUBLESTAR FGM DFUNIT D/H files updated.

2006-10-20

CLUSTERII PAD, SPINPAD, LER, 3DR, 3DF, 3DX1 & 3DX2 VIDFs have been replaced. Daily VIDFs are now available to May 2005

2006-10-16

CLUSTERII PAD deleted and replaced with newly reprocessed data. Problems with PAD in LAR and HAR sweep modes have been fixed.

2006-09-27

Double Star TC-1 PEACE 3DF VIDFs modified. There are now 3 VIDFs covering different time ranges. The azimuthal zero degree position defined in CONSTANT 01 is now correct for TC-1.

2006-08-07

all CLUSTERII CPXP1L, CPXP1H, CPXP2L, & CPXP2H VIDFs replaced with new versions. The energy efficiency and energy level tables now depend on Mode[0] instead of Mode[3].

2006-08-07

DOUBLESTAR 3DR VIDFs replaced with new versions - CONSTANT 06 and 07 swapped. Pitch angles should now be correct.

2006-07-31

DOUBLESTAR 3DF VIDFs replaced with new versions - CONSTANT 06 and 07 swapped. Pitch angles should now be correct.

2006-07-14

all DOUBLESTAR 3DF, GENERAL, 3DR, PAD deleted and replaced with newly reprocessed data

2006-06-20

3DFXR PIDFs replaced with new versions due to inclusion of a data origin status byte in the latest version of the IDFS header files.

2006-04-25

Energy tables, energy efficiencies tables & geometric factor replaced in TC-2 3DR VIDF.

2006-04-24

CLUSTERII AUXILIARY OA regenerated. Original MySQL entries have been deleted and replaced.

2006-04-24

CLUSTERII WHISPER PULSE regenerated. Original MySQL entries have been deleted and replaced.

2006-04-12

CLUSTERII & DOUBLESTAR PRIME regenerated. Original MySQL entries have been deleted and replaced. Timing is now correct - the begin & end times correspond to the spin begin & end times. Previously the timestamps corresponded (incorrectly) to interval-centred times. Other timing inaccuracies and problems have been corrected.

2006-04-11

CLUSTERII & DOUBLESTAR SUMMARY & JP regenerated. Original MySQL entries have been deleted and replaced.

2006-04-06

new CLUSTERII products - 3DR/CP3DFXRL and 3DR/CP3DFXRH. These consist of 3DF/3DX data reduced to 3DR. Currently 2001-2002 available.

2006-03-30

CFUNIT for 2004-May was missing. Entire month was processed and put in to IDFS

2006-03-22

replaced Double Star 3DR VIDFs & pidfs. All usual units are now available (previously only counts could be used).

2006-03-10

replaced PIDF & VIDF for DOUBLESTAR/PEACE/HSKP/DSPOT. Units are now only in eV.

2006-01-24

VIDFs for CLUSTERII/CLUSTER-?/WHISPER/CNRS/* have been added to the MySQL database

2005-11-24

ALL CLUSTERII/CLUSTER-?/PEACE/MOMENTS have been deleted.
This was a ground product from CPCMOMH and CPCMONF, which is still found in PEACE/CORE.
CLUSTERII/CLUSTER-?/JSOC/JP and CLUSTERII/CLUSTER_SP/JSOC/JP have been regenerated to correct EOF problem BUT...
This is a temporary fix - for a few days - will need to regenerate again once we've establish Data_ACC can be 0ms.

2005-11-22

ALL Cluster Summary Parameters (all instruments) reprocessed, just like Aux on 2005-11-21, below.

2005-11-21

Cluster Auxilary Summary Parameters reprocessed to:
a) Shift timestamps (that is remove 30s from timestamps and set record duration to 60.000s)
b) Insert the first record of the day (previously missing)
c) Avoid rounding issues in time stamps (11:24:00.000 rather than 11:23:59.999)
d) Correct the End of File tag at the end of the IDFS files
e) Reprocess SP AUX CDFs from 2000-2005, place in archive and update MySQL entries

2005-11-01

TC-1 & TC-2 PEACE DPGENIP, DPGENSP, & DP3DF IDFS H & D files replaced with newly regenerated files. Old MySQL entries deleted, replaced with new ones.

2005-10-06

MSSL's SDDAS Webserver is now open access from all IP addresses!
(i.e. you no longer have to inform MSSL of your IP addresses in order to promote data.)

2005-09-22

CLUSTER FGM CFUNIT processed from Dec2004 to July2005 inclusive (i.e. latest FGM cal files available).
This is the first time CFUNIT has been processed by LINUX rather than Solaris.
Double Star DFUNIT for TC-1 updated until 17 Sept 2005 (uses default FGM cal file).

2005-09-20

CLUSTER PEACE PRIME & SUMMARY IDFS H & D files replaced with newly regenerated files (fill values handled correctly : IFF fill values of -1 are in the cdf files available at the Data Centres)

2005-09-19

fill values in TC-1 & TC-2 JSOC JP VIDFs replaced with new value
TC-1 & TC-2 FGM PRIME & SUMMARY IDFS H & D files replaced with newly regenerated files (fill values handled correctly). Old MySQL entries deleted, replaced with new ones.
TC-1 ASPOC PRIME & SUMMARY IDFS H & D files replaced with newly regenerated files (fill values handled correctly). Old MySQL entries deleted, replaced with new ones.
TC-1 HIA PRIME & SUMMARY IDFS H & D files replaced with newly regenerated files (fill values handled correctly). Old MySQL entries deleted, replaced with new ones.
TC-1 & TC-2 PEACE PRIME IDFS H & D files replaced with newly regenerated files (fill values handled corrected). Old MySQL entries deleted, replaced with new ones.
TC-1 & TC-2 JSOC IDFS H & D files replaced with newly regenerated files (fill values handled correctly). Old MySQL entries deleted, replaced with new ones.
TC-1 & TC-2 AUXILIARY IDFS H & D files replaced with newly regenerated files (fill values handled correctly). New MySQL entries.

2005-09-18

CLUSTER PAD 2001 IDFS H & D files deleted and replaced with newly regenerated files

2005-09-15

TC-1 & TC-2 PEACE Prime Parameters added (DPPRIME)

2005-09-10

All MySQL entries have been checked to ensure they point to files that exist.
Any false entries have been removed. (used Joey's MissingFinder.pl script)

2005-09-07

WHISPER PN_CAL sensor & sensor group names have been changed in the pidfs

2005-08-24

CLUSTER HSPADNR & LSPADNR daily VIDFs from mid-2003 onwards added to the database

2005-08-14

Removed all PENRAD data from the database. HSPADNR & LSPADNR are more reliable codes so use them instead.
New SDDAS server at MSSL open to the world: IP of 128.40.70.117 ( http://www.mssl.ucl.ac.uk )
Old SDDAS server 128.40.71.151 (http://msslhx.mssl.ucl.ac.uk) currently still works, but will be shut down in November.

2005-07-27

all WHISPER PN_CAL regenerated and updated

2005-07-19

all DOUBLE STAR Housekeeping (HSKP) data has been re-ingested with latest software and archive/MySQL tidied.

2005-07-18

all MOMS_L3, both Cluster and Double Star, has been deleted. Please use PRIME instead, as the previously-available MOMS_L3 was the same as the PEACE prime parameters.

2005-07-13

all CLUSTER AUXILIARY OA replaced with newly regenerated IDFS H & D files for 2001-2005. All old MySQL entries deleted.

2005-07-09

all DOUBLESTAR PEACE TC-2 SCI (3DF, DPGENIP, DPGENSP, DPSTAT) replaced with newly regenerated files using r_net_2 v2.1. This includes high-energy "red"-spike correction. All old MySQL entries deleted.

2005-07-06

updated DOUBLESTAR PEACE MOMS_L3 with v4 prime parameters. All old MySQL entries deleted.

2005-07-04

all DOUBLESTAR PEACE SCI (3DF, DPGENIP, DPGENSP, DPSTAT) replaced with newly regenerated files using r_net_2 v2.0. All old MySQL entries deleted.

2005-06-24

regenerated CLUSTERII PEACE (CORE, MODE, HSKP, PAD, SPINPAD, 3DR, 3DF, 3DX1, 3DX2, LER, NOI, MOMENTS) IDFS H & D files for Apr-May 2005 put into the archive. This should fix an intermittent problem with Linux-generated CPCGP header files. (All PEACE regenerated for safety).

2005-06-23

regenerated CLUSTERII PEACE (CORE, MODE, HSKP, PAD, SPINPAD, 3DR, 3DF, 3DX1, 3DX2, LER, NOI, MOMENTS) IDFS H & D files for Feb-Mar 2005 put into the archive. This should fix an intermittent problem with Linux-generated CPCGP header files. (All PEACE regenerated for safety).

2005-06-22

negenerated CLUSTERII PEACE (CORE, MODE, HSKP, PAD, SPINPAD, 3DR, 3DF, 3DX1, 3DX2, LER, NOI, MOMENTS) IDFS H & D files for Jan 2005 put into the archive. This should fix an intermittent problem with Linux-generated CPCGP header files. (All PEACE regenerated for safety).

2005-06-17

new CLUSTERII PAD IDFS D & H files for 2001-2004 put into the archive (PAD HAR now works)
new CLUSTERII SPINPAD IDFS D & H files for 2001-2004 put into the archive
all CLUSTERII PAD MySQL entries removed and replaced for 2001-2004
all CLUSTERII SPINPAD MySQL entries removed and replaced for 2001-2004

2005-06-16

corrected CLUSTERII/CLUSTER-3/MOMS_L2 H1H2 PIDF

2005-06-09

Changed DOUBLE STAR ingestion code (p_to_idfs) from v1.42 to v1.9 today for all new data which allows 3DR and PAD.
(Old data not re-processed as yet - but old data has no 3DR or PAD anyway)

2005-05-24

2000-2004 CLUSTERII WHISPER PULSE MySQL entries removed and replaced
2000-2004 CLUSTERII WHISPER PULSE IDFS D & H files replaced with newly re-generated files

2005-05-17

all DOUBLESTAR HSKP MySQL entries removed and replaced
all DOUBLESTAR HSKP IDFS D & H files replaced with newly re-generated files using our h_to_idfs code version 1.4. (previously v 1.3)

2005-05-16

new VIDFs and PIDFs for CLUSTERII PRIME & SUMMARY DWP put into the archive
new CLUSTERII PRIME & SUMMARY DWP put into the archive

2005-05-15

all CLUSTERII PRIME MySQL entries removed and replaced
new CLUSTERII PRIME IDFS D & H files put into the archive

2005-05-13

all CLUSTERII SUMMARY MySQL entries removed and replaced
new CLUSTERII SUMMARY IDFS D & H files put into the archive

2005-05-12

new VIDFs for all CLUSTERII PRIME, SUMMARY and JP put into the archive (fill value changed)
new VIDFs for all DOUBLESTAR PRIME and SUMMARY put into the archive (fill value changed)

2005-05-05

new VIDF for DOUBLESTAR DP3DF for TC-1 put into the archive (Energy Table, Response Surface and Geometric Factor of CL-1 HEEA, previously was different)

Last Updated: 31 August 2007