| 1 | | | SAM Infrastructure and Project Management | June 1998 to March 2001 0.25 FTE average+reviews | 13 FTEweeks to March + 6 FTE weeks to Nov 01
| - |
1 | 1 | | Project Management | Tasklists and WBS
| - | - |
1 | 2 | tasklist | Web pages
| - | - | - |
1 | 3 | | Product installation and builds | Orbacus, Fnorb, Jclass, Java and Python, Oracledb
| - | - |
1 | 4 | | Database Insfrastructure | initial tests and setup -> support databases
| - | - |
1 | 5 | tasklist | Project standards and code organization | and version cutting methodology
| - | - |
1 | 6 | | Training and Education of Team members | e.g. Python, Softreltools, CORBA, Java Servlets
| - | - |
1 | 7 | tasklist | Demos, Reviews and Talks
| - | - | - |
1 | 8 | tasklist | Code Reviews
| - | - | - |
1 | 9 | tasklist | User documentation and help facilities | - | - |
|
| 2 | | | Requirements and Conceptual Designs | October 1997 to June 1999(extended) | 1 FTEweek | 1 EXPweek
|
2 | 1 | | Initial Requirements Specification | - | - | - | 100%
|
2 | 2 | | Glossary of Terms | needs updating in December | 2 FTEdays | - | 90%
|
2 | 3 | | Architecture and conceptual design | - | - | - | 100%
|
2 | 4 | | Revised Requirements Specs ?? | wasnt done after V0 - limited opportunities now needs Expt input | - | ? EXPdays | 0%
|
| 3 | | | Designs and Interfaces to other systems and Products | June 1998 to November 15 1999 (extended and further extended) | 17 FTEweeks (to March) + 20 FTEdays after March
| - |
3 | 1 | | Enstore Interface | ? verification, control of shelf tape | 2 FTEdays | - | 95% |
|
3 | 2 | | SAM Servers Design | | - | - | 100%
|
3 | 3 | tasklist | Farm System Interface | file merge and Output node remains | 5 FTEdays | 5 Expdays | 85%
|
3 | 4 | | RIP and Online System interface (re-opened) | - | - | - | 100%
|
3 | 5 | | User Interface C++ V0 | now only in context of framework | - | - | 100%
|
3 | 6 | | User Interface command line V0 | - | - | - | 100%
|
3 | 7 | | User Interface C++ V1 | all in context of framework | - | - | 100% |
|
3 | 8 | | User Interface command line V1 | - | - | - | 100% |
|
3 | 9 | | D0 Framework interface, input package and RCP design | - | - | - | 100% |
|
3 | 10 | | Database Schema V0 | including minimal server state persistency | - | - | 100%
|
3 | 11 | | Database Schema V1 | including minimal Triggers and limited browsing capability and reports | - | - | 100% |
|
3 | 12 | | Database Schema V2 | final full database design and design of browsing capability and reports, including Luminosity, Triggers, System config | 10 FTEdays | - |
|
3 | 13 | | File Catalog Meta-data design | - | - | - | 100%
|
3 | 14 | | Tape format and Tape Import | via Enstore direct tape import and sync with SAM | - | - | 100%
|
3 | 15 | | Monte Carlo import facility | - | 1 FTEday | 10EXPdays | 50% |
|
3 | 16 | | Optimizer | initial algorithm for control by access mode | 12 FTEdays | - | 5%
|
3 | 17 | | Batch system interface | and other Resource Management | 15 FTEdays | - | 35%
|
3 | 18 | | Event Catalogs | and full indexes | 5 FTEdays | - | 50%
|
3 | 19 | | File Delivery and Storage | Project-Servers-User interaction for files read and write + File Merging | - | - | 100% |
|
3 | 20 | | Event Delivery and Storage | Project-Servers-User interaction for Events (Pick Events) | 5 FTEdays | - |
|
3 | 21 | | Log file specification V0 | - | - | - | 100%
|
3 | 22 | | Log file specification V1 | - | - | - | 100%
|
3 | 23 | | System Statistics and views V0 | - | - | - | 100%
|
3 | 24 | | System Statistics, Information and views V1 | integration with Netlogger? Ops? | 5 FTEdays | - | 50%
|
3 | 25 | | Archival of system state and statistics | extracts of log files? (after March) | 5 FTEdays | - |
|
3 | 26 | | Data Export | Data export facility and exportable SAM system and database (after March) | 15 FTEdays | - | 10% |
|
3 | 27 | | Error Handling, Robustness and Redundancy study | - | - | - | 100%
|
3 | 28 | | Database server -multi-connection/multi-thread design | - | 3 FTEdays | - | 70%
|
3 | 29 | | Project definition extensions | - | 2 FTEdays | - | 90%
|
3 | 30 | | System Design Document | join of all above- for a review | 10 FTEdays | - | 0%
|
3 | 32 | | Database Schema V2.5 | coordinated with online database schema | 5 FTEdays | - | 5%
|
| 4 | | | Data Organization and Content | October 1997 to December 1999 | 1 FTEweek | ? 17+ Expweeks
|
4 | 1 | | Streaming Model | | | 2+ EPW | 20%
|
4 | 2 | | Farm Input and Output Files and Streams Specification | -> merge/split design | - | ? FTEdays | 50%
|
4 | 3 | | Data Tiers size and content | | | ? FTEdays | 30%
|
4 | 4 | | Data Export to remote institutions - strategies | | 5 FTEdays | 10 EPW
|
| 5 | | | Demonstration Prototype of SAM | June 1998 to December 1998 | --COMPLETED--December 1999
| - |
5 | 1 | | CORBA Infrastructure | use of IDL and Name service | - | - | 100%
|
5 | 2 | | Data Delivery (User) | example C++ consumer with waits, timeouts and errors | - | - | 100%
|
5 | 3 | | Project and snapshot definition | prototype GUI and scripts | - | - | 100%
|
5 | 4 | | Database | - | - | - | 100%
|
5 | 5 | | Log Server | - | - | - | 100%
|
5 | 6 | | Database Server | for Consumer registration and File Consumption | - | - | 100%
|
5 | 7 | | Optimizer | dummy version with random wait | - | - | 100%
|
5 | 8 | | Project Master | implementing Freight Train and Farm mode with few 10s of consumers for each project | - | - | 100%
|
5 | 9 | | Administrative Console | for system exploration and statistics and graphs of latency and throughput | - | - | 100%
|
| 6 | | | V0 Working Prototype of SAM | December 1998 to May 15, 1999 | --COMPLETED-- July 15 1999
| - |
6 | 1 | | Operate prototype and monitor database as real data added/used | - | - | - | 100%
|
6 | 2 | tasklist | Database V0 production database on d0ora2 | - | - | - | 100%
|
6 | 3 | tasklist | Database Server | Python with generated code and more persistency and retrieval services + full exception handling and error reporting | - | SW,MV | 100%
|
6 | 4 | | Log Server | additional events as determined by running stress tests and viewing statistics | - | - | 100% |
|
6 | 5 | | Administrative Tool/Web viewable system status and graphs | Build on standalone Java program | - | - | 100%
|
6 | 6 | | Command line project and snapshot definition and investigation | allow saving of simple queries and auxiliary file containing file list | - | - | 100%
|
6 | 7 | tasklist | Database Browsing/Web based queries and static pages | Specific Pages for MC | - | - |
|
6 | 8 | tasklist | Project Master/scalable to several hundred clients - data delivery | remove thread restrictions | ?? | IT | 100%
|
6 | 9 | tasklist | Data Storage (User) | command line interface and meta-data verification | - | IT | 100%
|
6 | 10 | | Data Storage (System) | Station servers and Enstore interaction | - | IT | 100%
|
6 | 11 | | Data Delivery (User) | command line interface - defer V0 C++ package | - | IT | 100%
|
6 | 12 | | Project Master w/o real SM | minimal Cache management, real SM deferred to V1 | - | - | 100%
|
6 | 13 | | Optimizer deferred to V1 | - | - |
|
6 | 14 | tasklist | Support Tables Maintenance | - | - | - | 100%
|
6 | 15 | | Overview of SAM and User's Guide V0 | partially done - rest deferred to V1 | - | - |
|
| 7 | | | V1 Limited Functional SAM System - for Users | June 15, 1999 to October 1, 1999 | --COMPLETED-- Oct 15,1999 |
|
7 | 1 | | SAM Manager integrated in D0 framework | including RCP,metadata,cmd line options | - | - | 100% |
|
7 | 2 | | V1 of Database Schema on d0ora2 | need cutover scripts | - | - | 100% |
|
7 | 3 | | First Event Catalog in db | with primitive web browser | - | - | 100% |
|
7 | 4 | | DB Server with support for data logger | first version - not extensively tested, needs upgrades to event catalog loading | - | - | 100% |
|
7 | 5 | | File Storage Server | for RAW, MC and reconstructed data files | - | - | 100%
|
7 | 6 | | Improved Project Master | with preferred location and // fetch control | - | - | 100% |
|
7 | 7 | | User python scripts | for launching applications | - | - | 100% |
|
7 | 8 | | Admin/Statistics tools available on web | - | - | - | 100% |
|
7 | 9 | | V1 of Project Tools | with project editor GUI | - | - | 100% |
|
7 | 10 | | Test harness to exercise system continuously | sam cluster and d02ka, only simple.py used | - | - | 100%
|
7 | 11 | | Special support for RIP/Data Logger | ? verification, batch updates? will need more | - | - | 100%
|
7 | 12 | | Initial User Guide | - | - | - | 100%
|
| 8 | | | V1.5 SAM System - with Station and Disk Cache | Target date December 15, 1999 | --COMPLETED Mar 22, 2000--
| - |
8 | 1 | | Bug fixes and urgent extensions | - | - | - | 100%
|
8 | 2 | tasklist | Project Master extra features | restart, run on failed files, subset of files | - | - | 100%
|
8 | 3 | | Configure d0 systems so ALL servers start up at boot time | ups/upd issues | - | - | 100%
|
8 | 4 | tasklist | File storage server and store commands - extra features | | - | - | 100%
|
8 | 5 | | V2 Project Tools -- Deltas, Sums, combinations of constraints, get rid of SQL | bag it until V2 - design only - see 3.29 | - | - | X
|
8 | 6 | tasklist | Station with disk cache and buffer management | | - | - | 100%
|
8 | 7 | tasklist | Framework metadata | for output files | - | - | 100%
|
8 | 8 | tasklist | MC card files | and other parameter files |
| - |
| 8A | | | V1.6 SAM System - minor fixes and improvements to V1.5 | approx 3.0 FTEs on feature development. Target date May 1 2000 | -- COMPLETED -- July 5, 2000
| - |
8A | 1 | | Bug fixes and urgent extensions
| - | - | - |
8A | 2 | | D0om name expander
| - | - | - |
8A | 3 | | sam_bootstrap product | for ensuring startup of all servers
| - | - |
8A | 6 | | Station/disk cache and buffer management | improvements and bug fixes, file locking
| - | - |
8A | 9 | | CORBA utilities into sam_util | work on sam_manager
| - | - |
8A | 10 | | Database server changes in support of station
| - | - | - |
| 9 | | | V2.0 SAM System - for cosmic ray data-taking | approx 3.0 FTEs on feature development. Target date June 26 2000 | --COMPLETED(alpha) V2.1-August 17, 2000
| - |
9 | 1 | | Bug fixes and urgent extensions | - | 7 FTEdays | - | 80%
|
9 | 2 | tasklist | Project Master/Consumer robustness | restart consumer on PM crash | 1FTEdays | - | 95%
|
9 | 3 | tasklist | File storage server and store commands - async mode | DLSAM and Farm i/f | 2 FTEdays | - | 95%
|
9 | 4 | tasklist | File merge/split implementation | (after design completed) | 7 FTEdays |
|
9 | 5 | tasklist | Project definition and classification | implement new design | 2 FTEdays | - | 80%
|
9 | 6 | tasklist | Auto destination mapping | 1st version of | 1 FTEdays | - | 85%
|
9 | 7 | tasklist | MC file import facility | automate + extensions for MC request fns | 2 FTEdays | - | 10%
|
9 | 8 | tasklist | Database and tools upgrade for V2.0 | in support of 9.4-9.6 | - | | 100%
|
9 | 9 | tasklist | Status information, browsing and diagnostics | - | 11 FTEdays | - | 10%
|
| 9A | | | V2.2 SAM System - parallel small upgrade while working on V3.0 | approx 1.5 FTEs on development. Target date September 15, 2000 | 7.5 FTEweeks
| - |
9A | 1 | | Bug fixes and urgent extensions | - | 8 FTEdays
| - |
9A | 2 | tasklist | Project Master/Consumer robustness | unit test and add to test harness | 1FTEdays |
|
9A | 3 | tasklist | File storage server and store commands - async mode | finish DLSAM and Farm i/f | 2 FTEdays | 10 Expdays
|
9A | 4 | tasklist | File merge/split implementation | (after design completed) | 7 FTEdays |
|
9A | 5 | tasklist | Project definition and classification | 2nd version | 5 FTEdays |
|
9A | 6 | tasklist | Auto destination mapping | improve | 1 FTEdays |
|
9a | 7 | tasklist | MC file import facility | automate + extensions for MC request fns | 2 FTEdays
| - |
9A | 8 | tasklist | Database and tools upgrade for V2.0 | in support of 9.4-9.6 | 1 FTEdays |
|
9A | 9 | tasklist | Status information, browsing and diagnostics | - | 11 FTEdays
| - |
| 10 | | | V3.0 SAM System - with luminosity, database sync, resource management,batch interface, file merge/split | avg. 3.0 FTEs on feature development. New Target date November 15, 2000 | 27 FTEweeks
| - |
10 | 1 | |
| - | - | - |
| 11 | | | V4.0 SAM System - ready for data taking | approx 3.0 FTEs on feature development. Target date January, 30 2000 | 27 FTEweeks
| - |
11 | 1 | |
| - | - | - |
| 12 | | | V5.0 SAM System - thumbnail support, tune resource management | approx 3.0 FTEs on feature development. Target date March 15 2001 | 19 FTEweeks
| - |
12 | 1 | |
| - | - | - |
| 13 | | | V6.0 SAM System - full remote site/export support | Target date May 15 2001 - 3.0 FTEs on feature development | 21 FTEweeks
| - |
13 | 1 | |
| - | - | - |
| 19 | | | Test systems and software - procure and install | September 1998 to May 1999 | 1FTEweek
| - |
19 | 1 | | SAM PC Testbed | 10 Linux PCs | - | - | 100%
|
19 | 2 | | JClass graphing package | - | - | - | 100%
|
19 | 3 | | D0 Database Servers and disks | need to size final machine and disks for FY2001 | 5FTEdays | - | 90%
|
19 | 4 | | Find machine to test batch software | d0test | - | - | 100%
|
19 | 5 | | Prototype Analysis Server Machine to run loads on | d0test | - | - | 100%
|
| 20 | | | Access Control and Authentication | March 2000 to May 2000 | 4+ FTEweeks
| - |
20 | 1 | tasklist | Servers | recovery and restart | made part of test harness->22.16 |
|
20 | 2 | | Database | exercise recovery procedures | -> test harness 22.17 |
|
20 | 3 | | Access control and authentication design | coordinate with Strong Authentication for file transfer/FTP | 4FTEweeks
| - |
20 | 4 | | Implement authentication and access control | ASSUME NOT!
| - | - |
| 21 | | | Operations and Support | March 1999 to 2001 and beyond | 22 FTEweeks to March 01 @ 0.5 -> 1.0 FTE constant
| - |
21 | 1 | | Set up SAM User's group and meetings | ongoing help |
| - |
21 | 2 | | Mailing list | plus mail archive | - | - | 100%
|
21 | 3 | | Bug report and fixes facility | Use of Remedy
| - | - |
21 | 4 | | Prepare Run I Data for import | ? Not being done in SAM | - | - | X
|
21 | 5 | | Import Run I Production catalog and move Run I data | ? possibly only catalog- not in SAM | - | - | X
|
21 | 6 | | RunII operations | user help,problem resolution etc | - |
|
21 | 7 | | Data access statistics and monitoring | - | 4FTEweeks
| - |
21 | 8 | | Supporting data maintenance | e.g. application,group,data tier, etc | - | ? Exp FTEs
|
21 | 9 | | User and group maintenance | - |
| - |
| 22 | | | Tests, Simulations and Integration and Monitoring Tools | October 1997 to March 01 and beyond | 22 FTEweeks | - |
|
22 | 1 | | Spreadsheet simulations of data rates | Seasons of SAM | - | - | 100%
|
22 | 2 | | Tests with Enstore to fake robot | - | - | - | 100%
|
22 | 3 | | Tests with Enstore to STK robot | - | - | - | 100%
|
22 | 4 | | Tests with Enstore to EMASS robot | initial tests | - | - | 100%
|
22 | 5 | | Overnight tests with Enstore to EMASS | permanently assigned cartridges and library | - | - | 100%
|
22 | 6 | | Farm software integration and tests | need to convert to framework code and scripts | 3FTEdays | - | 80%
|
22 | 7 | | D0 Framework integration | input and output packages and RCPs | - | - | 100%
|
22 | 8 | | Farm Merge and "O" node tests | - | 15FTEdays |
|
22 | 9 | | Tests with Monte-Carlo import facility | - | 5FTEdays |
|
22 | 10 | | RIP and Online integration | create instrumented logger for Test harness | 2 FTEdays | - | 50%
|
22 | 11 | | Revisit data rates spreadsheet | or do new type of simulation using test harness | - | - | X
|
22 | 12 | | Test Harness - stress tests | simple.py tests only on sam cluster and d02ka | - | - | 100%
|
22 | 13 | | d0test disk throughput and contention tests | - | 5 FTEdays | - | 50%
|
22 | 14 | | d0test network throughput and round-robin | with Enstore | 2 FTEdays | 90%
|
22 | 15 | | Test Plan | requested by Ruth |
| - |
22 | 16 | tasklist | Test Harness and stress tests | using all systems- sam cluster, d0test,farms | 15 FTEdays
| - |
22 | 17 | tasklist | Database load tests and monitoring activities | incorporate work from 23.10 | 5 FTEdays
| - |
22 | 18 | tasklist | Information server and sam_monitor upgrade | for use with and outside of test harness | 25 FTEdays
| - |
| 23 | | | Joint work/reliance on Support Databases | most of the Manpower in Support Databases WBS. Continuous interface @0.2 FTE | 14 FTEweeks to Nov 01
| - |
23 | 1 | | Planning and procurement and installation
| - | - | - |
23 | 2 | | Database upgrades
| - | - | - |
23 | 3 | | Investigation of suitable 'free' or 'cheap' database for remote institution
| - | - | - |
23 | 4 | | DBA - operational support
| - | - | - |
23 | 5 | | Backup strategy and implementation and testing of backups
| - | - | - |
23 | 6 | | Database Server -> C++, as necessary for Calibration (migrate back to SAM if needed)
| - | - | - |
23 | 7 | | Use of Oracle queueing for online/offline database uploads and synchronization
| - | - | - |
23 | 8 | | Further studies of partitioning strategies and effects
| - | - | - |
23 | 9 | | Monitoring tools - OEM and DB instrumentation (e.g. query timings, page hits, etc.)
| - | - | - |
23 | 10 | | Very large database tests with populated tables
| - | - | - |