William F. "Woody" Roberts, Lead, Meteorologist, 303-497-6104, woody.roberts@noaa.gov

Leigh Cheatwood-Harris, Meteorologist, 303-497-7780, leigh.k.cheatwood@noaa.gov

Dr. Lynn Johnson, Hydrologist, 303-497-6984, lynn.e.johnson@noaa.gov

Michael Vrencur, Systems Administrator, 303-497-7526, michael.vrencur@noaa.gov

Purpose:

The GSD TestBeds/Evaluation Team, within the Information Systems Branch, designs and conducts evaluation exercises for the National Weather Service. This includes evaluations of hydrometeorological workstations, applications, and programs. The focus is on areas considered to be high risk or not well understood. We seek to provide feedback on results of these evaluations in an objective and timely manner so they can be used to influence further moderniaztion activities.

Projects:

• June 2005 Product Use Analysis
• June 2005 Product Use Histogram
• May 2004 Product Use Analysis

• GFESuite Training Questionnaire - Fall 2002 - Catalog of Responses
• GFESuite Training Questionnaire - Spring 2002 - Catalog of Responses
• GFESuite Training Questionnaire - Fall 2001 - Catalog of Responses
• GFESuite Focal Point Questionnaire -Fall 2001- Catalog of Responses
• GFESuite Training Questionnaire for RPP in Fall 1999 - Catalog of Responses

Publications:

Technical Reports and Memoranda:

• Kucera, P.C. and C.M. Lusk, 1996: Cool season product usage patterns from the DARE workstations at the Denver and Norman WSFOs. NOAA Technical Memorandum ERL FSL-18, NOAA Forecast Systems Laboratories, Boulder, CO, 59pp.
• FSL Evaluation Team, 1996: An Overview of Evaluation Results from the WFO Advanced Real-Time Forecast Exercise: RT95. FSL Evaluation Team Report, 23pp.
• Roberts, W.F., P.C. Kucera, C.M. Lusk, L.E. Johnson, D.C. Walker , 1996: DenOps1: The Initial Operational Evaluation of WFO-Advanced in Denver.
• Roberts, W.F., P.C. Kucera, C.M. Lusk, L.E. Johnson, D.C. Walker, 1995: Evaluation Plan for the 1995 Real-Time Forecast Exercise for WFO-Advanced.

Journal Articles and Other Reports:

• Lusk, C.M., P.C. Kucera, W.F. Roberts, L.E. Johnson, 1999: The Process and Methods Used to Evaluate Prototype Operational Hydrometeorological Workstations. Bulletin of the American Meteorological Society, 80, 57-65.
• Johnson, L.E., P.C. Kucera, C.M. Lusk, W.F. Roberts, 1998: Usability Assessments for Hydrologic Forecasting DSS. Journal of the American Water Resources Association, 34, 43-56.
• Lusk, C., W. Roberts, L. Johnson, D. Clark, P. Kucera, 1995: Evaluation of Pre-AWIPS Training, Final Report. NWS Norman Risk Reduction Project.
• Lusk, C., W. Roberts, L. Johnson, D. Clark, P. Kucera, 1995: Evaluation of Pre-AWIPS Training, Interim Report Number 4 - Evaluation of Follow-up Training and Pre-AWIPS learning curve. NWS Norman Risk Reduction Project.
• Lusk, C., W. Roberts, L. Johnson, D. Clark, P. Kucera, 1993: Evaluation of Pre-AWIPS Training, Interim Report Number 3 - Evaluation of ICWF Training. NWS Norman Risk Reduction Project.
• Lusk, C., W. Roberts, L. Johnson, D. Clark, P. Kucera, 1993: Evaluation of Pre-AWIPS Training, Interim Report Number 2. NWS Norman Risk Reduction Project.
• Lusk, C., W. Roberts, L. Johnson, D. Clark, P. Kucera, 1992: Documentation of the Adequacy of Type and Number of Workstations, Special Report Number 1. NWS Norman Risk Reduction Project.

Conference Papers:

• Cheatwood, L.K., and W.F. Roberts, 2006: Forecaster Usage Patterns of AWIPS D2D and GFESuite During 2005. 22nd Int. Conf. on Interactive Processing Systems (IIPS) for Meteorology, Oceanography, and Hydrology, Atlanta, GA, Amer. Meteor. Soc., P1.7.
• Roberts, W.F., and L.K. Cheatwood, 2005: Examples of GFESuite and D2D Use in Operations During 2004. 21st Int. Conf. on Interactive Information Processing Systems (IIPS) for Meteorology, Oceanography, and Hydrology, Seattle, WA, Amer. Meteor. Soc., P2.12.
• Roberts,W.F., 2004: Examples of Graphical Forecast Editor Use In Operations During 2003. CD-ROM, 20th Int. Conf. on Interactive Information Processing Systems (IIPS) for Meteorology, Oceanography, and Hydrology, Seattle, WA, Amer. Meteor. Soc., 8.11.
• Jung ,Young-Sun, Dong-Il Lee, Seong-Jin Kim, Seung-Kyun Park, Byung-Hwan Lim, Jun-Seok Chung, Ronald J. Kahn, Patrice C. Kucera, and William F. Roberts, 2002: ASF: An AWIPS-like Prototype Forecaster Workstation at KMA. Preprints, AWIPS Symposium, Orlando FL, Amer. Meteor. Soc., 124-126.
• Piercy, Charles, Mary D. Buckingham, Edwin Hiner, William F. Roberts, Patrice C. Kucera, 2002. The Hardware and Software Installation Process for the AWIPS Linux Workstation Demonstration. Preprints, AWIPS Symposium, Orlando FL, Amer. Meteor. Soc., 245-247.
• Mary D. Buckingham, Charles Piercy, Jerald J. Dinges, Jeffery Fornear, William F. Roberts, and Patrice C. Kucera, 2002. The AWIPS Linux Workstation Demonstration and Evaluation, AWIPS Symposium, Orlando FL, Amer. Meteor. Soc., 248-251.
• Kucera, P.C., S.P. Longmore, and W.F. Roberts, 2000: Product Usage Patterns at the AWIPS Build 4.2 OT&E Sites. Preprints, 16th International Conference on Interactive Information and Processing Systems, Long Beach, CA, Amer. Meteor. Soc., 302-305.
• Kucera, P.C., C.M. Lusk, W.F. Roberts, and L.E. Johnson, 1997: Warm Season Operational Use of the WFO-Advanced Workstation at the Denver WSFO. Preprints, 14th International Conference on Interactive Information and Processing Systems, Phoenix, AZ, Amer. Meteor. Soc., 325-329.
• Roberts, W.F., P.C. Kucera, C.M. Lusk, D.C. Walker, 1996: Operational Use of WFO-Advanced at the Denver WSFO. Preprints, 13th Conference on Interactive Information and Processing Systems, Long Beach, CA, American Meteorological Society.
• Szoke, E.J., P.C. Kucera, and E.R. Thaler, 1996: Use of the WFO-Advanced in the analysis and forecasting of two complex weather events. Preprints, 15th Conference on Weather Analysis and Forecasting, Norfolk, VA, American Meteorological Society, 465-468.
• Kucera, P.C. and W.F. Roberts, 1995: Warm Season Product Usage Patterns from the DARE Workstations at the Denver and Norman WSFOs. Preprints, 14th Conference on Weather Analysis and Forecasting, Dallas, TX, American Meteorological Society, 101-107.
• Roberts, W.F., P.C. Kucera, C.M. Lusk, L.E. Johnson, D.C. Walker, 1995: 1995 Real-Time Forecast Exercise for WFO-Advanced. Preprints, 12th Conference on Interactive Information and Processing Systems, Atlanta, GA, American Meteorological Society, 198-201.
• Roberts, W.F. and P.C. Kucera, 1993: Cool season product usage patterns from the DARE workstations at the Denver and Norman WSFOs. Preprints, 13th Conference on Weather Analysis and Forecasting, Vienna, VA, American Meteorological Society, 522-525.

Page Maintained by: mdweb administrator (mdweb.fsl@noaa.gov)

Revised: May 2, 2007