INCOSE - WMA
Donald J. Gantzer
SAIC
gantzerd@saic.com
703-412-3668
May 15 , 2007
Objectives
2
djGantzer 5-2-07
Agenda
SE Standards and Models
– Overview
– Evolution of Standards & Models
ISO - 15288
EIA - 632
IEEE - 1220
CMMI - Dev
Defense Acquisition Guide/SE
– Correlations across
– Application to Tech Planning
– Summary
– Some Key References
3
djGantzer 5-2-07
Oh…wither models & standards?!
“The Process Standards / Models Quagmire”.
Source: Systems and Software Consortium {SSCI}
4
djGantzer 5-2-07
SE Standards and Models Trends
SE-CMM
SECAM EIA-731 [SECM](99)
ISO 15288(02)
08?
IEEE-15288 (04) 06+
95 5 00 05
djGantzer Sources: INCOSE, SEI 5-2-07
Overview of SE Standards + CMMI
ISO/IEC - 15288 – SE – System life cycle processes
“Establish a common framework for describing the life cycle of systems” – 25 processes;
incl 7 project, 11 technical, and 7 agreement and enterprise; 62 pgs
- it is a hi-level framework [descriptive]
EIA - 632 – Processes for Engineering a System
“Provide an integrated set of fundamental processes to aid a developer in the
engineering or re-engineering of a system”
- 33 Requirements in 13 processes; 120 pgs
- it is less prescriptive, broader scope [e.g., incl enterprise environment]
IEEE - 1220 – Application and Management of the SE Process
“Defines the requirements for an enterprise’s total technical effort related to the
development of products and processes that will provide life cycle support for the
products. It prescribes an integrated technical approach to engineering a system and
requires the application of management of the systems process throughout the
product life cycle.” - 28 requirements 28; incl 14 general, 6 by LC stages, 8 in SE
Process ; 87 pgs –
CMMI - DEV – Capability Maturity Model Integration®
- 27 process areas:11 Management, 6 Engineering, 5 Support, and 5 Process; 573
pgs
6
djGantzer 5-2-07
SE Standards & Models Life Cycle Phases
DoD/DAG
ISO 15288 EIA 632 IEEE 1220 CMMI (informal)
[DoDI 5000.2]
Concept Pre-system Concept concept, Concept
Definition exploration,
Development
vision
Development System Def., feasibility, Tech
System Def., design,
Subsystem Development;
Subsystem development
design,
design, System
Detailed design
Detailed design; Development.&
FAIT Demonstration
IEEE 1220
EIA 632
Level of Detail
MIL-STD-499B
EIA/IS 632
ISO/IEC 15288
Breadth of Scope
8
djGantzer 5-2-07
SE/SW Standards Harmonization Road Map
[source: SSCI]
An Harmonization road map
ISO/IEC
IEEE EIA
JTC1/SC7
Software
Engineering
ISO/IEC 12207 Joint Standards Body
Harmonization
SC7 Internal
Assessment ISO/IEC 15504
Harmonization
…
Adapted from: SC7 WG7 N0560 Systems Engineering Study Group Report 11JAN02
9
djGantzer 5-2-07
Simple Generic SE Process
source: Mil Std 499A/B and DAU guidance
Inputs:
Functional
Analysis/allocation
Synthesis
Outputs:
10
djGantzer 5-2-07
IEEE 1220: Systems Engineering Note: includes
Technical Management
Planning Assessment Control
Process Process Process
Plans, Outcomes
Directives, Acquisition and Supply &
& Status Supply Process Feedback
Acquisition Process
CONOPS & Requirements
System Design
Requirements Definition Process System
Acquisition
Solution Definition Process* Products
Request
Architectures/Designs
Product Realization Note: provides
Note: under Implementation Process
revision to detailed activities
‘harmonize’ w ISO
Transition to Use Process and outcomes for
each process
15288 Products
Technical Support
Systems Requirements Product Product
Analysis Validation Verification Validation
Process* Process* Process Process
12
djGantzer (source: graph from INCOSE SE Handbook v2)* 5-2-07
Draft update to EIA-632 (out for internal review)
EIA – 632 [1999] EIA - 632a *{source: GEIA report; R.
Harwell, 11/05}; 4 domains; Systems
Management, System Creation, System
Evaluation, Enterprise Environment
Planning Planning
Assessment Progress Assessment
Control Control
Requirements Definition Concept Definition
Solution Definition System Definition
Product Realization System Realization
[Implementation/Transition]
Systems Analysis Mission & Systems Analysis
Requirements & End products Val., System V&V
System ver.
Supply & Acquisition Customer & Supplier Relationship
Management
Enterprise Support Resources & Infrastructure
Enterprise Support Governance
Enterprise support 13
LC Portfolio Mngt.
djGantzer 5-2-07
ISO 15288: System Life-Cycle Processes
(2002)
ENTERPRISE & SYSTEM LIFE CYCLE PROCESSES
AGREEMENT
PROCESSES PROJECT PROCESSES
Configuration Information
Decision-making Risk Management
Investment Management Management
Management
Acquisition
Operation Maintenance
Acquisition
Supply
Disposal
Each
Eachprocess
processhas
haspurpose,
purpose,outcomes,
outcomes,and andactivities
Figure1-1 System Life Cycle Process Overview per ISO/IEC 15288
activities Source: INCOSE SE Handbook, v3.0
14
djGantzer 5-2-07
CMMI Issues
DoD Sponsor Report
Programs execute at lower maturity levels than their organizations have achieved and
advertised
High-maturity practices are not consistently applied at the project level after contract
award
How to ensure new projects will incorporate CMMI processes
Appraisal sampling procedures – how to ensure adequate coverage of the
organizational unit
Appraiser quality – training, consistency
Lack of agreement on what constitutes Levels 4 and 5
Need to converge to a single representation
Content of appraisal disclosure statements is lacking
Inadequate training and education for acquirers
Should CMMI be used for source selection?
15
djGantzer 5-2-07
Summary Improvements in CMMI-Dev
v1.2 [August, 2006]
Additionally…
CMMI guide for Acquisition Orgs to leverage Supplier’s
efforts – 3/07
CMMI – Acq in final draft [summer 07?]
16
djGantzer 5-2-07
Capability Maturity Model Integrated
(CMMI- Dev)
SE SE
Related Related
Examples Examples Hardware
SW SW Related
Related Related Examples
Examples Examples
18
djGantzer 5-2-07
Defense Acquisition Guide (DAG) [11/04]
– Chapter 4 on SE
[Note: DAG/SE
used ISO
15288, EIA-
632, IEEE
1220, and
DAU 2001 SE
Handbook as
key
references]
19
djGantzer 5-2-07
Example Systems Engineering Process Architecture
(SE Processes taken from DAG, Chapter 4)
20
djGantzer 5-2-07
SE Standards/Models Mapping - Management
ISO-15288 EIA-632 IEEE-1220 CMMI-DEV DAG/SE Chap. 4
Project Planning Planning Planning tech effort, Project Planning; Technical Planning;
SE integration, of SE Integrated PM;
effort Interface Mngt.
Quantitative PM
Project Assessment Assessment Control Project Monitoring & Technical Assessment;
Control; M&A;
Quantitative PM
Project Control Control Control Project Monitoring & Interface Mngt.
Control
Decision Making Systems Analysis Systems Analysis Measurement & Decision Analysis
Analysis (M&A);
Decision Analysis &
Resolution;
Quantitative PM; Causal
Analysis & Resolution;
Risk Mngt. Systems Analysis Systems Analysis Risk Mngt. Risk Mngt.
21
djGantzer 5-2-07
SE Standard/Models Mapping - Technical
ISO-15288 EIA-632 IEEE-1220 CMMI-Dev DAG/ Chap. 4
Product Integration
Integration integration Integration
Verification System Verification Functional and Verification Verification;
Design Verification; [+Chap 9 – IT&E]
Tech reviews
Validation Requirements and Requirements Validation Validation;
End Products Validation; Tech
Validation reviews, test [+Chap, 9 – IT&E]
Product Integration; Transition
Transition
Transition to Use Org. Innovation &
Deployment; Org.
Training
ISO - 15288
EIA - 632
IEEE - 1220
CMMI - Dev
PM BoK
&
DoD(AT&L)/SSE Tech Planning considerations
23
djGantzer 5-2-07
ISO 15288 Project Planning activities
“Purpose is to produce and communicate effective and workable project plans”
Identify the project objectives and constraints
Define the project scope as established in the agreement
Establish a WBS based on evolving system architecture
Define and maintain a project schedule based on project objectives and work estimates
Project achievement criteria for the life cycle stage decision gates, delivery dates and major
dependencies on external inputs or outputs
Define the project costs and plan a budget
Establish the structure of authorities and responsibilities for project work
Define the infrastructure and services required by the project
Plan the acquisition of materials, goods and enabling system services supplied from outside the
project
Generate and communicate a plan for technical mgmt. of the project, including the reviews
Define the project measures to be generated and the associated data to be collected, validated
and analyzed
Generate a project quality plan
Source: Summarized from ISO 15288
24
djGantzer 5-2-07
EIA-632 – Technical Planning
Source: EIA-632
25
djGantzer 5-2-07
IEEE-1220 Planning the Technical Effort
“Prepare and Implement the technical plans and schedules to guide the
project toward accomplishment of its objectives and proper conclusion.”
Engineering plan [example SEMP content]
Master and Detail Schedules
Technical plans
Developmental strategies
Modeling & prototyping
Integrated repository, Data, Tools, and Integrated data package
Hw, SW, Humans
Life cycle processes
Spec and Drawing trees; SBS
Integration the SE effort
Tech Reviews
Quality management
Product & process improvement
26
djGantzer 5-2-07
CMMI – Project Planning
Purpose is to supply and maintain plans that define project activities.
Establish Estimates
– Estimate scope
– Establish Estimates of work products/attributes
– Define life cycle
– Determine effort & cost estimates
Develop Project Plan
– Establish budget & schedule
– Identify risks
– Plan for data management,
– Plan for resources; Needed knowledge & skills
– Plan stakeholder involvement
– Establish the Plan
Obtain commitment to the Plan
– Review plans that affect project
– Reconcile work & resource levels
Other key process area relationships: – Requirements
– Obtain commitment
Development, Monitoring & Control, Supplier Agreement
Mngt. Integrated PM, Risk Mngt., Measurement &
Analysis, …
Source: CMMI-Dev
27
djGantzer 5-2-07
CMMI Generic Practices for Planning
process area
Perform the planning process
Establish & maintain an Org policy for planning process
Plan the planning process
Provide resources
Assign responsibility
Train people
Manage configurations
Identify and involve relevant stakeholders
Monitor and control the planning process
Objectively evaluate adherence to the planning process
Review status with higher level management [PEO?]
…
28
djGantzer 5-2-07
PM – Book of Knowledge (PM-BoK)
(Project Management)
Scope*
Integration
(charter, scope statement, PMP)
Communication*
Risk*
Quality*
Human Resources*
Time (definition, sequencing, DoD PMBoK Extension (2003):
estimation)
SE
Cost (estimation, budgeting) SW Acquisition
Procurement (purchase, Logistics
acquisition, contracting)
T&E
* Apply Planning, Execution & Manufacturing
Control to each area
29
djGantzer 5-2-07
Planning Process example [INCOSE SE Handbook v3]
Controls
-Enterprise Strategic Plan
-Enterprise Policies &
Standards
Activities Outputs
Inputs - Define Scope, Objectives, and
- Project WBS &
-Proposals Data Dictionary
Constraints - SEP, tailored CMP, IMP,
-Project Constraints - Define WBS,
- Roles & Responsibilities RMP & QMP
Work Packages, - Key Personnel
- Resource Requirements Schedules & Budgets & Resources
Forecast -Prepare Project Plans - Project Performance
-Establish Project Structure, Roles & Measures
Responsibilities
Enablers
- Enterprise Project Procedures
& Processes
-Enterprise Infrastructure
30
djGantzer 5-2-07
DoD/SSE Technical Planning emphasis
Manage a Comprehensive Set of Requirements
– Define project scope w key stakeholders [FoS, SoS]
– Formulate, assess, select the preferred system concept
– Develop explicit and testable system/project requirements
– Develop a WBS [products & process]
Resource & Staffing to the Technical Plan
– Organize and staff the project team [TA, PM, LSE, IPTs]
– Estimate the time and resource requirements [IMS, EVMS]
– Develop a project critical path
– Develop a project budget
Develop and Managing Technical Baselines Note: DoD is updating DAG/SE, SEP
– Identify, manage, and mitigate project risks [technical] Prep Guide, and DoDI 5000.2
– Manage project changes and customer expectations
Managing Event-based Technical Reviews
Integrating Tech Planning into overall Program Planning &
Management Context [IMP/IMS, EVMS, program Risks]
32
djGantzer 5-2-07
SE Sources
Links:
ISO 15288: http://www.15288.com/
EIA 632: http://www.geia.org/index.asp?bid=552
IEEE 1220: http://www.software.org/quagmire/descriptions/ieee1220.asp
SEI-CMMI: http://www.sei.cmu.edu/cmmi/models/models.html#modules
Systems & Software Consortium: http://www.systemsandsoftware.org/
DAU-DAG: http://akss.dau.mil/dag/
DoD(AT&L) SE: http://www.acq.osd.mil/se/index.html
AF Center for SE; http://www.afit.edu/cse/
INCOSE – Standards TC http://www.incose.org/practice/techactivities/standards.aspx
References:
“SE Standards & Models Compared”; J. Lake (SMi) and S. Sheard (SPC), INCOSE 2004
“Evolution of a Standard EIA-632”; R. Harwell, INCOSE 2006
“Cross-Cultural Issues Associated with the Application of ISO/IEC Standard”; T. Ferris, INCOSE
2006
“INCOSE Insight: Special Feature: Standards in SE”, April 2007; see particularly K. Crowder, D.
Kitterman, T. Doran, R. Harwell, and S. Arnold articles.
33
djGantzer 5-2-07
Backup slides
34
djGantzer 5-2-07
Some SE Process References
35
djGantzer 5-2-07
NDIA Top 5 SE Issues
Source: NDIA SE Conference 10/06; M. Schaffer DUSD(A&T) SSE
2003 2006
Inconsistent SE
Lack of awareness of
practices across all life
SE importance
cycle phases
Insufficient quantity
Lack of adequate
and quality of SE
qualified resources
expertise
Inadequate tools and
Insufficient SE tools
collaborative
and environments
environments
My challenge to you:
– Instilling upfront and continuous technical rigor
– Understanding Systems-of-Systems SE
– Fielding capability to the warfighter sooner
– Increasing combat systems fuel efficiency
– Addressing growing software concerns
Sincere thanks to our partners
– Industry, in particular, NDIA
– Service and Agency Engineering Staffs
EOA B1
Joint JCD EOA TD & CDD SDD CPD O&S
SPG FAA FNA Rpt PD
Concepts RR
FRP DR
OSD/
COCOM FCB
JCS
Operational
Support Capability Demonstrate capabilities
OSD/JCS COCOM meet user needs
Based Assessments Sound technical
Define relationships with Enterprise planning to Assess portfolio
related capabilities, support performance (CAR)
architectures (e.g., GIG) warfighting
Identify alternatives; SoS
capabilities Integrate SoS;
trade cost, sched, perf assess cost, sched, perf