26th NATIONAL TEST & EVALUATION CONFERENCE

"Defense Test & Evaluation in a Net-Centric World"

1 - 4 March 2010

San Diego, CA

 

Agenda

Monday, 1 March 2010

TUTORIAL A
SESSION 1

MISSION-BASED CAPABILITY ASSESSMENT IN NETCENTRIC SYSTEMS OF SYSTEMS (SOS)

 

TUTORIAL C
SESSION 1

USING DESIGN OF EXPERIMENTS (DOE) TO TRANSFORM A TEST ORGANIZATION

 

Tuesday, 2 March 2010

CONFERENCE KEYNOTE ADDRESS

15,000 NETWORKS, 5 MILLION USERS: T&E NET CENTRIC CHALLENGES

  • Mr. John Illgen, Northrop Grumman Corporation; Chairman of the Board of Directors, NDIA

SESSION B: OTA COMMANDERS' ROUNDTABLE

LUNCHEON AND SPECIAL GUEST SPEAKER - REGATTA PAVILION IMPROVING PROCESSES AND POLICIES FOR THE ACQUISITION AND TEST OF INFORMATION TECHNOLOGIES IN DOD

  • Dr. H. Steven Kimmel, Senior Vice President, Alion Science and Technology Achieving Effective Acquisition of Information Technology in the Department of Defense

THE DOD ACQUISITION/TEST PROCESS, WHAT WENT WRONG AND HOW TO FIX THE PROCESS; A REPORT ON THE DEFENSE SCIENCE BOARD (DSB) STUDY OF DT&E & A PERSPECTIVE ON THE REMEDIES NEEDED TO IMPROVE DOD ACQUISITION

NETWORK INNOVATION AND EXPERIMENTATION: A SOCOM PROJECT REPORT

SESSION D - NET-CENTRIC T&E

  • T&E for Agile Information Technologies, Dr. Steven Hutchison, DISA
  • Closing the Test and Evaluation Gap in a Net-Centric Future, Mr. Gary Downs, Lockheed Martin
  • A Tool for Making T&E Itself Net-Centric, Mr. Alan Thomas, Naval Surface Warfare Center (NSWC) Dahlgren
  • Testing & Evaluating the Net-Ready Key Performance Parameter (KPP), Ms. Danielle Koester, JITC, Huachuca

SESSION E - T&E OF CHEMICAL/BIOLOGICAL SYSTEMS

  • Systematic Approach to Identifying and Testing Individual Respiratory Protection Against Toxic Industrial Chemicals, Dr. Karen McGrady, Joint Program Manager for Individual Protection
  • The Army Health Hazard Assessment Program's Medical Cost Avoidance Model, Dr. Timothy A. Kluchinsky, USAPHC (Provisionsal)
  • Naval Research Laboratory Industrial Chemical Analysis, Dr. Thomas Sutto, NRL
  • Test Methodology Development for Individual Respiratory Protection Against VXMs., Ms. Chris Susman, SURVICE Engineering
  • The Challenge of Fielding a System Across Services and PEOs, Ms. Debbie Singleton, JPM for Individual Protection

SESSION F - APPLICATIONS OF DESIGN OF EXPERIMENTS (DOE) AND SIX SIGMA IN T&E

  • Incorporating DoE and Test-Execution Lessons-Learned to Increase T&E Credibility, Ms. Nancy Dunn, ATEC/AEC
  • Optimal Verification Testing with Graphical Effects Analysis, Mr. Mark Anderson, Stat-Ease
  • Using Cost and Schedule Estimates Guided by Design of Experiments Process to Plan Schedule-Optimal or Cost-Optimal Test Designs for Integrated Development Testing and Operational Testing, E. Andrew Long, DOT&E
  • Use of Design of Experiments to Determine the Critical Technical Parameters and Evaluation Framework in a T&E Strategy, Mr. Mick Quintrall, Whitney, Bradley & Brown, Inc.
  • Comparison of Prediction Accuracy of Surrogate Models Developed Using Nested Latin Hypercube Designs "How Many Simulation Experiments Do I Need to Run?", Dr. Tom Donnelly, SAS Institute

SESSION G - TEST & EVALUATION FOR LETHALITY AND SURVIVABILITY ASSESSMENT

  • Integrated Survivability Assessment (ISA): Bridging DT&E, LFT&E and OT&E, Mr. David Hall, SURVICE Engineering
  • Mine Blast Analysis Tool for Rigid Body Response: A Quick, Reliable Predictive Methodology to Estimate Relative Acceleration Environments Experienced by Crewmembers in Specific Mine Scenarios, Ms. Katie Hill, SURVICE Engineering
  • A Method to Assess Survivability, Lethality and Vulnerability in a System of Systems, Dr. Jeffrey Smith, ARL, WSMR
  • A Process for Identifying Vulnerable Components Based on Impact to Mission Degradation, Mr. Kevin Agan, ARL, SLAD

 

Wednesday, 3 March 2010

WEAPON SYSTEMS ACQUISITION REFORM ACT AND DT&E WITHIN THE DEPARTMENT OF DEFENSE

T&E AND ITS ROLE IN 5000.02: HOW T&E CAN BECOME A PROGRAM LIFECYCLE SKILL

ERASING THE LINE WITH TITLE 10: BEST PRACTICES IN INTEGRATED TESTING

INTEGRATED TEST AND INDEPENDENT EVALUATION (IT&EI) USING DESIGN OF EXPERIMENTS (DOE) METHODOLOGIES: EARLY PLANNING FOR DT EXIT CRITERIA THAT MIRRORS OT ENTRANCE CRITERIA

SESSION I: T&E POLICY & STUDIES CONTINUED

Session I Chair: Dr. H. Steven Kimmel, Senior Vice President, Alion Science and Technology

SESSION J: PANEL DISCUSSION

SYSTEMS ENGINEERING CONSIDERATIONS IN PRACTICING TEST AND EVALUATION

  • Mr. Stephen Welby, Director, Systems Engineering, DDR&E, OSD
  • Col Shawn Shanley, USAF, Chief Systems Engineer, Office of the Assistant Secretary of the Air Force for Acquisition, Science, Technology, and Engineering (SAF/AQR)

SESSION K: TEST AND EVALUATION ARCHITECTURE & FACILITIES

  • Accelerating Technology Maturity via Rapid Debug and Redeployment, Mr. Redge Bartholomew, Rockwell Collins
  • Whitfill Central Technical Support Facility (CTSF) Conducts System of System (SoS) Tests in a Net-Centric Environment Achieving Interoperability for the Army, Ms. Madeline Wright, CTSF, Ft. Hood
  • Service-Oriented Architecture (SOA) Implications to Integrated End-to-End Testing, Mr. Brian Eleazer, SCRA
  • Lessons Learned from Army Interoperability Certification Testing, Mr. Robert Boerjan, CTSF, Ft. Hood
  • The "Eglin IV": Metrics of a Well-Designed Experiment, Mr. Gregory T. Hutto, 46 Test Wing, Eglin AFB

SESSION L: T&E OF SYSTEMS OF SYSTEMS

  • A Case Study of Successful T&E in a Complex System of Systems Environment, Mr. Edwin McDermott, Hanscom, AFB
  • Measuring System Contributions to System of Systems with Joint Mission Threads, Mr. Mark Fiebrandt, SRC
  • Combat Effectiveness Testing of System of Systems in the Face of Cyber Threat, Mr. Jonathon Payne, JFCOM, IO Range
  • An Approach to Service Level System of Systems Assessment (CTSF), Mr. David McClung, CTSF, Ft. Hood
  • C-RAM Conducts True System of Systems Testing and Evaluation, Mr. James Bloodsworth, US Army Aviation & Missile Research Development & Engineering Center

SESSION M:ROLE OF MODELING AND SIMULATION IN T&E

  • Validating M&S with T&EData: Pitfalls, Problems and Potential Solutions, Mr. David Hall, SURVICE Engineering
  • Defense Information Technology: An Integrated Model, Dr. Robert Berger, DDL Omni, Inc
  • NDIA Software T&E Summit/Workshop Results, Mr. Tom Wissink, Lockheed Martin Corporation
  • The Application of Synthetic Natural Environments for Modeling and Simulation Support of Testing Net-Centric Federations, Mr. Michael Leite, SAIC
  • Change is Good!...and other mantras to live by! Making Process Improvement Work for You, Ms. Coleen Crouch, Central Technical Support Facility

SESSION N: INTEGRATED TEST AND EVALUATION

  • Performance Engineering Initiatives for Early System Test of High Availability Systems, Mr. Edward Beck, Mission Solutions Engineering, LLC (MSE LLC)
  • Integrated Testing Implementation Guidance, Dr. Suzanne Beers, The MITRE Corporation
  • Early Development Testing for Rapid Acquisition, Col Robert Mattes, USAF (Ret), Foxhole Technology, Inc.
  • Some Operational Research Issues in System Testing, Dr. Donald Gaver, Naval Postgraduate School

 

Thursday, 4 March 2010

CHALLENGES OF SYSTEMS OF SYSTEMS TESTING, A REALITY CHECK: THE FCS PROGRAM

WHEN ROBOTS TALK ON THE NET, WHAT WILL THEY SAY?

  • VADM Joe Dyer, USN (Ret), President, iRobot Corporation; Chairman NDIA Robotics Division

NDIA ICOTE ANNUAL REPORT

  • Mr. Larry Graviss, NDIA Industrial Committee on Operational Test & Evaluation (ICOTE)

MISSION-BASED TEST AND EVALUATION STRATEGY: PROGRESS TOWARDS UNITING COMBAT DEVELOPER, MATERIEL DEVELOPER AND T&E