SAM Versions and Features - updated September 19, 1999

(obsolete milestone list is here)

   done    in progress     to do 
 Version  Description Major Features List  Date  Actual Date delivered
  -- Demonstration Prototype database,skeletons of all servers except station master, data delivery via projects Nov, 1998 Jan, 1999
 V0 Working Prototype V0 Database, User Command line interface, Admin tools April 15, 1999 June 15, 1999
 V1 For Users
(Integration with D0 framework, easier to use scripts and project definition/startup tools)
  • SAM manager integrated in D0 Framework, with RCP and input options passed on command line
  • V0 of Event catalog and primitive web browser for Raw data entries
  • Support for RIP/online data logger
  • File Storage Server for RAW, MC and reconstructed data files
  • Preferred locations to fetch files
  • Restrictions on number of parallel file transfers per buffer
  • Python scripts for launching user applications
  • sam 'project' tools with GUI on web
  • User Guide and internal docs
  • d0test multiple i/o pipes and multi-project tests with enstore
October 1, 1999  October 15, 1999
   mini-REVIEW - Oct 26      
 V1.5  Use of Station disk management + integrate with Calibration in Reco
  • fixes for early users and for online data logger+urgent missing features
  • Station with disk cache management
  • enhance sam 'project' tools
    • verify, delta,union &differ
    • project restart and continuous projects
  • use of multi-threaded framework to work with d0omCORBA (for calib)
  • enhanced test harness
  • enhanced system monitoring and administrative tools
  • start of full system stress tests
  • full MC meta-data creation mechanisms
  • simplified luminosity - MC only
  • MC import facility and server with documented process
  • Tape injest/sync with SAM database
  • start of Batch system integration and Resource Management design
December 1999  
   REVIEW January 2000      
 V2 Enable Cosmic Ray commissioning
  • fixes to V1.5 + urgent features
  • Farms/File merge (i/o node integration)
  • Station with Batch system interface and i/o resource management
  • Multi-connection robust database server
  • Error and robustness features
  • Full scale system tests and simulated database size and performance tests
  • network interface balancing (with Enstore)
  • design of luminosity manager/db/processes
  • design of pickevents subsystem and full event catalog(s)
March 2000  
 V3  
  • fixes to V2 + urgent missing features
  • implementation of luminosity
  • start of thumbnail data design and access
  • other features TBD
April/May 2000  
 V4 Ready for Data Taking - almost ? TBD June/July 2000  
 V5 Pickevents and Thumbnail data services TBD Aug/Sept. 2000  
 V6 Full Support for remote institutions TBD Oct/Nov. 2000  

Missing Features, Unfinished Designs, System testing - not yet fully assigned to a Version

Feature/Design/Test Description In/during Version  
Use of Logical Streams in db and project definitions and interface with trigger lists  V3 or V4  
File staging algorithms for sample across logical stream V4 +  
PickEvent access mode (involves D0 framework i/o packages)  V4 or V5  
Event catalog for PickEvents support and all data tiers (not just RAW)  V4 or V5  
PickEvents Server  V4  
Luminosity data in database and D0 framework  V3?  
Export of physics data to remote institutions - server  V5 or V6  
Export of meta-data to remote institutions + synch of remote meta-data  V5  
SAM running at remote institutions, including database extract and synch  V6  
Thumbnail data design, file format, and access strategy  V3,V4,V5  
Import of Run I metadata and access to Run I data via SAM    
Prompt (and on-demand) Reconstruction Pipeline    
Summary reports and informational tools for Physics use    
Network interfaces balancing, in conjunction with Enstore  V2 +  
ROOT objects and file format - - implications    
Online databases upload  and synch of data (with help from Support Databases Project)    
Database monitoring tools (with help from Support Databases Project)    
??? things we forgot