SlideShare a Scribd company logo
2009
NiwotRidge LLC
GlenB. Alleman
[RISK MANAGEMENT GUIDEANCE]
The managementof riskisa critical successfactorof any projector program.Thisdocumentisa
collectionof riskmanagementcategoriesthatare usedtoask the question“didyouthinkaboutthisrisk
and itsimpacton our probabilityof success?”
[RISK MANAGEMENT GUIDEANCE] October12, 2009
2 RequirementsRisks |NiwotRidge LLC
RiskManagementisan essential elementof everyproject.The riskmanagementapproachmust be
analytical,foreword looking,structured,informative,andcontinuous.Riskassessmentsstartasearlyin
the projectlife cycle aspossible andshouldidentifycritical technical,performance,schedule,andcost
risks.
Once risksare identified,soundriskhandlingstrategiesandactionsare developedanddocumented.As
a projectprogresses,newinformationimprovesadditionalinsightintoriskareasandallowsthe
continuous refinementof the riskhandlingstrategies.
A close relationshipbetweenthe IntegratedProjectteam(IPT) members
RE QU IR E ME NT S RIS K S
 Can the current requirementsbaseline be identified?
● How isthisbaseline represented?
● Can all the requirementsbe tracedtothe needcapabilitiesandthe implementationefforts?
● Are the operational requirementsproperlyestablishedandclearlystated?
 Is the requiredoperatingenvironmentdescribedaccuratelyandinsufficientdetail?
 Are sufficientsubjectmatterexpertsavailabletoreview the requirements?
 Have all requirementsbeencapturedfrom:
● Documents?
● Architectures,models,oruse cases?
● Customerexpectations?
● Operational usage?
● All relevantstakeholders?
● Organizational policiesorstandards?
● Militarypoliciesorstandards?
● Commercial standards?
 Have the requirementsbeensuccessfullyimplementedonanyothersystemorproduct?
● If so, whatrisksand issuesemergedduringthe executionof the project?
 Are non-developmental items(NDI) beingusedonthe program?
● If so, have theirinterfacesbeenidentified,capabilitiesverified,andsupplyreliability
assured?
 Is requirementsanalysisbasedonrealisticdesignassumptions?
● Is there a designbasiswhichdrivesthe requirements?
● Is that designbasiscredible andverifiable?
 Are requirementsforthe currentdevelopmentorspiral:
● Complete (no TBDs)?
● Clear,withMeasuresof Performance andMeasuresof Effectiveness?
● Feasible?
● Testable,withtestcoverage models?
● Measurable,withunitsof measure definedforeachdeliverable?
● Understoodbyall stakeholders?
● Time-sequenced?
● Prioritized?
● Designor solutionindependent?
[RISK MANAGEMENT GUIDEANCE] October12, 2009
3 RequirementsRisks |NiwotRidge LLC
 Do the requirementsmeetthe customer'sintentforthe systemorproduct(i.e.,will itdowhat
it’ssupposedtodo)?
 Are requirementsstable?
● What requirementschange rate isacceptable for thisproject?
● Is a requirementschange control processinplace?
● How quicklyare requirementschanging?
 Can the requirementschange inresponse to:
● Newor changingmission?
● Fundingshiftorcut?
● Worldevent?
● Technologyopportunity?
● Schedule disruptions?
● Resource reduction?
 Are requirementschangesanalyzedfor:
● Impact onlowerrequirements?
● Impact onachievingprogramobjectives?
● Conflictwithprogramobjectivesorrequirements?
● Interfaceswithotherprogramsorsystems?
 Are the requirements underconfigurationcontrol?
 Are dependentrequirementsidentified?
 Doeseach requirementhave one ormore funded"parent"requirement(s)?
 Are requirementsavailable tothe programfroma single repository?
 Doesthe program have a Change Control Board (CCB):
● Establishedatthe programlevel?
● Establishedatappropriate sub-programlevels?
● Representative of all stakeholders?
● That meetsregularly?
● That is effective?
 Are requirementsconsistentwith:
● Program fundingandschedule?
● Stakeholderinvolvement?
● Technologyavailable?
● Infrastructure architecture?
 Are hardware,software andinterface constraintsidentified?
 Do the requirementsaddressthe entire lifecycle (includinglogisticsandsuitability)?
[RISK MANAGEMENT GUIDEANCE] October12, 2009
4 Schedule Risks |NiwotRidge LLC
SCH E D U LE RIS KS
 Is there sufficienttime todevelop,document,andgainapproval forprogramacquisition
strategy?
 Is there sufficienttime tocontract,develop,andtestasupportable product?
 Is schedule consideredintrade-offstudies?
 Doesthe schedule reflectrealisticacquisitionplanning?
 Are the AcquisitionPlanningBoard(APB) scheduleobjectivesrealisticandattainable?
 Are the resourcesavailable tomeetschedule?
 Doesthe schedule accommodate forrework?
 Doesthe schedule accommodate forcontingencyplanning?
 Are the schedule estimationmethodsaccurate andstandardizedwithinprogram?
 How visibleisthe programschedule todecision-makersandhigher-levelmanagement?
CO S T AN D BAS IS O F ES T IMAT E RIS KS
 Were realisticcostobjectivesestablishedearly?
 Doesthe fundingprofile matchthe acquisitionstrategy?
 Is the fundingprofilestable frombudgetcycle tobudgetcycle?
 To Reduce Total OwnershipCost(RTOC):
● Was the systembaselinedbeforecontractaward?
● Was sustainmentplanningdone upfront?
● Are cost and manpowersavingsprojectionstrackedtoplan?
● Are cost and manpowersavingsprojectionsrealized?
 Are cost-performance tradeoffsbeingdone,especiallyformarginal performance capability
improvements?
 What are the redesigncostsof:
● EngineeringChange Proposals(ecps)?
● Modificationsonce systemisdeployed?
 Are supportrequirementsbeingcostedearly?
 Doesthe systemrelysignificantlyonsoftware?
CO N T R ACT ING AN D PR O CU REME NT RIS KS
 Doesthe contract include requirementsfornecessaryengineeringandmanagementprocesses
and policies?
 Are there multiple contractorsinvolvedinthe program?
● Didanalysisdeterminewhobesttodointegration - governmentorcontractor?
● Is the Governmentresponsible forintegration?
● Is a Prime Contractorresponsibleforintegration?
● Has an integrationcontractbeenauthorized,planned,andimplemented?
 Is the contractor able to complete agreedtofunctionalitywithindefinedguidelines?
 Are there sufficientincentives?
 Is the Governmentaware of the workrequiredtocomplete the jobwithinbudgetandschedule?
 Is the Governmentmonitoringthe workperformed?
[RISK MANAGEMENT GUIDEANCE] October12, 2009
5 Funding/Financial Risks |NiwotRidge LLC
 Didanalysisdeterminethe workrequired?
 Didpast experience determine the workrequired?
 Can the GovernmentandContractor reachagreement on:
● Program requirements?
● Testresults?
● Warranty responsibility?
 Is Governmentable todiscussthe workprogramwithpeople doingthe job?
● EvenwhensubcontractedbyPrime Contractor?
 Is the subcontractmanagementevaluatedsufficiently?
 Are specificitemsthatusedtobe undermilitarystandardsidentifiedandmanaged?
 Do the Government-purchaseddatapackagesfollow contractor-uniquemanufacturing
processes?
 Are the Government-purchaseddatapackagesreproducible?
 Is reprocurementdataavailableintime forproduction?
 Do the followinghave goodrelationships:
● GovernmentandContractor?
● Contractor andIntegrator?
● Contractor andSubcontractor?
 Doesthe Contractor pro-actively:
● Identify DiminishingManufacturingSource (DMS) parts?
● Solve DiminishingManufacturingSource (DMS) issues?
 Doesthe Contractor have a good processto manage changesinthe program?
 Can the Contractor be downsizedorboughtout?
 Is systemengineeringexpertise available atthe contractorfacility?
 Are the keypersonnel citedbythe contractorin hisproposal actuallyperformingonthe
contract?
 Do the contractor personnel availableunderthe contracthave the skillsnecessarytodevelopor
integrate the system?
 Will the contractor be able to hire forthe productionrun?
 Will skilledpersonnelbe re-allocatedif contractistoosmall?
 Was the program baselinedpriortocontractaward?
FU N D IN G / FIN AN CIAL RIS KS
 Is the fundingprofilestable?
 Is the fundingprofileallocatedadequatelyforthe programschedule?
● Are RDT&E fundsearlyand/orinadequate?
● Are productionfundsearly,late,and/orinadequate?
● Doesfundingtimingconsiderlongleaditems?
 Is the fundingunderthe control of the program manager?
 Is the fundingforthe programin contentionwithotherprograms?
 Are fundsreprogrammedperiodicallybyyears?
 Are fundsreprogrammedperiodicallybyappropriations?
 Doesthe fundingprofile allowforareasonable programplan?
[RISK MANAGEMENT GUIDEANCE] October12, 2009
6 ManagementandLeadershipRisks |NiwotRidge LLC
 Is the fundingsufficientforrealizationof the requirements?
 Doesfundingconsiderlicensingfees?
MAN AG E ME NT AN D LE ADE RS HIP RIS KS
 Doesthe program have documentedmanagementprocessesorcontrols?
 Doesthe program managerhave managementandleadershipexperience?
 Doesthe program managerhave managementandleadershiptraining?
 Is the program managerpositionchangingfrequently?
 Are program budget,cost,and/orschedule fixedforreasonable durations?
 Are program budget,cost,and/orschedule political issues?
 Are parallel orevolutionarydevelopmentshandledeffectively?
 Is the program managementcentralized(single locationforPMand PCO)?
 Is the program planfeasible?
 Is the program managerable tomeetwithseniordecision-makersforprogramdecisionswhen
needed?
 Doesthe program managerunderstandthe prioritiesof the stakeholders?
 Are the administrative reportingrequirementsreasonable?
 Are the resourcesassignedtothe programoffice sufficienttohandle the programworkload?
 Are the governmentandsupportcontractor resourcesassignedtothe programsufficientto
handle the programworkload?
 Do requestsforadditional informationrequire additionalfunding?
 Are all stakeholdersknown?
 Are otherprograms evaluatingthisprogramforpossibledevelopmentopportunities?
 Is the program prioritysufficienttogetnecessarypersonnel,equipment,andfacilities?
 Is the propermix (experience,skills,stability) of people assignedtothe programor contractor
team?
 Are effective riskassessmentsperformed?
● Are the resultsunderstood?
● Are the resultsactedupon?
 Doesthe program managementteamhave acommitmenttodeliveringaqualityproduct?
[RISK MANAGEMENT GUIDEANCE] October12, 2009
7 SystemsEngineeringRisks |NiwotRidge LLC
SYS T E MS EN G INE ERIN G RIS KS
 Are the designimplicationssufficientlyconsideredinconceptexploration?
 Is conceptmature enoughfordevelopmenttobegin?
● If not, have trade studiesbeendone toclarifycritical components?
● Didtrade studiesincludeproductionrisk?
 Will the systemsatisfyuserrequirements?
 Is the designcosteffective?
 Doesthe designrelyonnewor untriedtechnologyorexoticmaterialstoachieve performance
objectives?
 Will still maturingorunproventechnologiesbe adequatelydevelopedbefore itsneeded
capabilities?
● Is a TechnologyReadinessLevel (TRL) usedtoassessthe maturityof technologies?
● Has the risk impactfor eachTRL level beencapturedinthe RiskManagementPlan(RMP)?
 Is productionfundingavailable atthe needed time inthe developmenteffort?
 Has the standard operatingenvironment (SOE) beenestablished?
 What engineeringprocessesare beingusedonthe program?
 Is the systemdesignfault-tolerantinawayneededforproperfunctioning?
 What isthe growth/expandabilityrange of the systemindevelopment?
 Doesthe developmentalignwiththe operational concept?
 How closelydoesthe designenvironmentmatchthe actual operational environment?
 Is the systembeingbenchmarkedatappropriate milestones?
 Who has configurationcontrol?
 Are interfacingsystemsbeingdevelopedinparallel?
 Are reliability,maintainability,availabilityrequirementsbeingmet?
 Are the technical,operational andprogrammatic requirementsstable?
 Are stressand strength/stressanalysesperformedtoensure thatappliedvaluesinderatingand
safetyforcomponentpartsand materialsmeetcriteria?
 Are “worst case”tolerance analysesperformedtoensure thatsystemperformance remains
withinspecifiedlimits?
 Doesanalysisresultinappropriate designrevisionstoreduce risk?
 Are parts and materialstestedearlyinthe designatintendedoperational stresslevels?
[RISK MANAGEMENT GUIDEANCE] October12, 2009
8 Facilities |NiwotRidge LLC
FACIL IT IE S
 Were productionimplicationsconsideredduringconceptexploration?
 Was productionconsideredsufficientlyindesign?
 Do program plansinclude vendorsupport?
 Do program plansinclude longleaditems?
 Do program plansaddressthe knownvariability’sof costand schedule?
 Are the productionprocessesproven?
 Are sufficient,cost-effective facilitiesavailableforproduction?
 Is the infrastructure provided(e.g.,office space,facilities,supplies,etc.) sufficientforprogram
needs?
 What isthe impactto the program of changesin infrastructure availabilityorperformance?
 Doesthe program needCapital Equipment?
 Is the capital equipmentprovidedcorrectandsufficientforprogramneeds?
 What isthe impactto the program of changesin capital equipmentavailabilityorperformance?
 Doescontract offeranyincentive tomodernizefacilitiesorreduce cost?
 Do buildingshave appropriate storage forhazardousmaterialsandappropriate ventingfortoxic
or asphyxiatinggases?
 Doesmachineryandequipmenthave requiredsafetydevices?
 Do noise levelsincreasethe probabilityof mishapoccurrence?
 Whenpotential forinjuryfromchemicalsexists,are appropriate antidotesorfirstaidavailable?
 Is the needforeye washand washdownfacilitiesassessed?
 On occasion,whentemporaryfacilitiesorconstructionare necessaryforcertainoperations,do
these facilitiespresentsignificanthazards?
 Are buildingshousinghazardousactivitydesignedtobe compatiblewiththe enclosed
operation?
 Are buildingshousinglasersorotherelectromagneticradiatingdevicesdesignedtominimize
hazardsand provide controlledaccess?
 Doesthe designminimize the effectsof anyhazardousactivitysuchasfire,explosion,toxicity,
radiation,andasphyxiation?
 Can visual andaural warningsand alarmsbe readilyseenandheard?
 Doesthe buildingdesignfurtherfacilitate the rapidevacuationof occupants?
 Are fire extinguishingagentsreadilyaccessibleandeffective,butbythemselvesdonotpresenta
significanthazard topersonnel?

More Related Content

PDF
Risk Management Processes (v2)
PPTX
From WBS to Integrated Master Schedule
PDF
IMP / IMS Step by Step
PDF
Building a Credible Performance Measurement Baseline
PPTX
Getting To Done - A Master Class Workshop
PDF
A Guide for Capital Project Mamnagers
PDF
Strategic portfolio management
PDF
Principles of Risk Management
Risk Management Processes (v2)
From WBS to Integrated Master Schedule
IMP / IMS Step by Step
Building a Credible Performance Measurement Baseline
Getting To Done - A Master Class Workshop
A Guide for Capital Project Mamnagers
Strategic portfolio management
Principles of Risk Management

What's hot (20)

PDF
EVM+Agile the darkside
PDF
IMP & WBS - Getting Both Right is Paramount
PDF
Practices of risk management
PDF
Heliotropic Abundance
PDF
How primavera can help you in managing risks in project intensive industry ppt
PDF
The simple problem of schedule performance indices
PDF
Cure for cost and schedule growth
PDF
Deliverables based planning handbook
PDF
Project Management Theory
PDF
Earned Value Management and Agile
DOCX
What is risk?
PDF
Performance based management in a nut shell (v5)
PPTX
Establishing schedule margin using monte carlo simulation
PDF
Measures of Effectiveness, Measures of Performance, Technical Performance Mea...
PDF
Making Agile Development work in Government Contracting
PDF
Six ½ Day Sessions on the Road To Becoming a CAM
PDF
IMP IMS overview
PDF
Increasing the Probability of Project Success with Five Principles and Practices
PDF
Capabilities based planning
DOCX
Increasing the probability of program success
EVM+Agile the darkside
IMP & WBS - Getting Both Right is Paramount
Practices of risk management
Heliotropic Abundance
How primavera can help you in managing risks in project intensive industry ppt
The simple problem of schedule performance indices
Cure for cost and schedule growth
Deliverables based planning handbook
Project Management Theory
Earned Value Management and Agile
What is risk?
Performance based management in a nut shell (v5)
Establishing schedule margin using monte carlo simulation
Measures of Effectiveness, Measures of Performance, Technical Performance Mea...
Making Agile Development work in Government Contracting
Six ½ Day Sessions on the Road To Becoming a CAM
IMP IMS overview
Increasing the Probability of Project Success with Five Principles and Practices
Capabilities based planning
Increasing the probability of program success
Ad

Similar to Risk Management Guidance (20)

PDF
Pm blackjack the21thingsyour-projectsponsorreallywantstoknow.-whitepaper_15
PDF
Project success assessment
PDF
Osman Exec Profile
PDF
Ey prm-predicting-project-risks
DOCX
AnnMarieDeNeen Resume 20164
PDF
Connected Project Management in the Oil, Gas & Chemicals Industry
PDF
Project Iniation And Setup
PDF
Understanding the risks in enterprise project management
DOCX
Raid based approach for efficient project management in a pragmatic way towar...
DOCX
PROGRAMME MANAGEMENT BEST PRATICE
PDF
How To Develop A Project Management Plan
DOCX
Continuous Risk Management
PDF
TECHNICAL PROJECT MANAGEMENT SKILLS
PDF
Project breathalyzer
DOCX
Project Risk management
DOC
Effective Project Management for Software Development.doc
PDF
Project Success Assessment
PDF
Connecting PMB® with PMBOK®
DOCX
1185880 - McGraw Hill Education ©PProjectrojectnetnetwor
DOCX
1185880 - McGraw Hill Education ©PProjectrojectnetnetwor
Pm blackjack the21thingsyour-projectsponsorreallywantstoknow.-whitepaper_15
Project success assessment
Osman Exec Profile
Ey prm-predicting-project-risks
AnnMarieDeNeen Resume 20164
Connected Project Management in the Oil, Gas & Chemicals Industry
Project Iniation And Setup
Understanding the risks in enterprise project management
Raid based approach for efficient project management in a pragmatic way towar...
PROGRAMME MANAGEMENT BEST PRATICE
How To Develop A Project Management Plan
Continuous Risk Management
TECHNICAL PROJECT MANAGEMENT SKILLS
Project breathalyzer
Project Risk management
Effective Project Management for Software Development.doc
Project Success Assessment
Connecting PMB® with PMBOK®
1185880 - McGraw Hill Education ©PProjectrojectnetnetwor
1185880 - McGraw Hill Education ©PProjectrojectnetnetwor
Ad

More from Glen Alleman (20)

PDF
Managing risk with deliverables planning
PDF
A Gentle Introduction to the IMP/IMS
PDF
Increasing the Probability of Project Success
PDF
Process Flow and Narrative for Agile+PPM
PDF
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
PDF
From Principles to Strategies for Systems Engineering
PDF
NAVAIR Integrated Master Schedule Guide guide
PDF
Integrated master plan methodology (v2)
PDF
DHS - Using functions points to estimate agile development programs (v2)
PDF
Making the impossible possible
PDF
Process Flow and Narrative for Agile
PDF
Building the Performance Measurement Baseline
PPTX
Program Management Office Lean Software Development and Six Sigma
PDF
Policy and Procedure Rollout
PDF
Integrated Master Plan Development
PDF
Seven Habits of a Highly Effective agile project manager
PDF
Paradigm of agile project management (update)
PDF
The 5 Immutable principles of project management
PDF
Integrating cost, schedule, and technical performance
PDF
Writing Proposal Text
Managing risk with deliverables planning
A Gentle Introduction to the IMP/IMS
Increasing the Probability of Project Success
Process Flow and Narrative for Agile+PPM
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
From Principles to Strategies for Systems Engineering
NAVAIR Integrated Master Schedule Guide guide
Integrated master plan methodology (v2)
DHS - Using functions points to estimate agile development programs (v2)
Making the impossible possible
Process Flow and Narrative for Agile
Building the Performance Measurement Baseline
Program Management Office Lean Software Development and Six Sigma
Policy and Procedure Rollout
Integrated Master Plan Development
Seven Habits of a Highly Effective agile project manager
Paradigm of agile project management (update)
The 5 Immutable principles of project management
Integrating cost, schedule, and technical performance
Writing Proposal Text

Recently uploaded (20)

PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
Big Data Technologies - Introduction.pptx
PDF
KodekX | Application Modernization Development
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Modernizing your data center with Dell and AMD
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Electronic commerce courselecture one. Pdf
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PPTX
A Presentation on Artificial Intelligence
DOCX
The AUB Centre for AI in Media Proposal.docx
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Review of recent advances in non-invasive hemoglobin estimation
Reach Out and Touch Someone: Haptics and Empathic Computing
Big Data Technologies - Introduction.pptx
KodekX | Application Modernization Development
Understanding_Digital_Forensics_Presentation.pptx
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
“AI and Expert System Decision Support & Business Intelligence Systems”
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Network Security Unit 5.pdf for BCA BBA.
Mobile App Security Testing_ A Comprehensive Guide.pdf
Modernizing your data center with Dell and AMD
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Electronic commerce courselecture one. Pdf
Digital-Transformation-Roadmap-for-Companies.pptx
A Presentation on Artificial Intelligence
The AUB Centre for AI in Media Proposal.docx
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
How UI/UX Design Impacts User Retention in Mobile Apps.pdf

Risk Management Guidance

  • 1. 2009 NiwotRidge LLC GlenB. Alleman [RISK MANAGEMENT GUIDEANCE] The managementof riskisa critical successfactorof any projector program.Thisdocumentisa collectionof riskmanagementcategoriesthatare usedtoask the question“didyouthinkaboutthisrisk and itsimpacton our probabilityof success?”
  • 2. [RISK MANAGEMENT GUIDEANCE] October12, 2009 2 RequirementsRisks |NiwotRidge LLC RiskManagementisan essential elementof everyproject.The riskmanagementapproachmust be analytical,foreword looking,structured,informative,andcontinuous.Riskassessmentsstartasearlyin the projectlife cycle aspossible andshouldidentifycritical technical,performance,schedule,andcost risks. Once risksare identified,soundriskhandlingstrategiesandactionsare developedanddocumented.As a projectprogresses,newinformationimprovesadditionalinsightintoriskareasandallowsthe continuous refinementof the riskhandlingstrategies. A close relationshipbetweenthe IntegratedProjectteam(IPT) members RE QU IR E ME NT S RIS K S  Can the current requirementsbaseline be identified? ● How isthisbaseline represented? ● Can all the requirementsbe tracedtothe needcapabilitiesandthe implementationefforts? ● Are the operational requirementsproperlyestablishedandclearlystated?  Is the requiredoperatingenvironmentdescribedaccuratelyandinsufficientdetail?  Are sufficientsubjectmatterexpertsavailabletoreview the requirements?  Have all requirementsbeencapturedfrom: ● Documents? ● Architectures,models,oruse cases? ● Customerexpectations? ● Operational usage? ● All relevantstakeholders? ● Organizational policiesorstandards? ● Militarypoliciesorstandards? ● Commercial standards?  Have the requirementsbeensuccessfullyimplementedonanyothersystemorproduct? ● If so, whatrisksand issuesemergedduringthe executionof the project?  Are non-developmental items(NDI) beingusedonthe program? ● If so, have theirinterfacesbeenidentified,capabilitiesverified,andsupplyreliability assured?  Is requirementsanalysisbasedonrealisticdesignassumptions? ● Is there a designbasiswhichdrivesthe requirements? ● Is that designbasiscredible andverifiable?  Are requirementsforthe currentdevelopmentorspiral: ● Complete (no TBDs)? ● Clear,withMeasuresof Performance andMeasuresof Effectiveness? ● Feasible? ● Testable,withtestcoverage models? ● Measurable,withunitsof measure definedforeachdeliverable? ● Understoodbyall stakeholders? ● Time-sequenced? ● Prioritized? ● Designor solutionindependent?
  • 3. [RISK MANAGEMENT GUIDEANCE] October12, 2009 3 RequirementsRisks |NiwotRidge LLC  Do the requirementsmeetthe customer'sintentforthe systemorproduct(i.e.,will itdowhat it’ssupposedtodo)?  Are requirementsstable? ● What requirementschange rate isacceptable for thisproject? ● Is a requirementschange control processinplace? ● How quicklyare requirementschanging?  Can the requirementschange inresponse to: ● Newor changingmission? ● Fundingshiftorcut? ● Worldevent? ● Technologyopportunity? ● Schedule disruptions? ● Resource reduction?  Are requirementschangesanalyzedfor: ● Impact onlowerrequirements? ● Impact onachievingprogramobjectives? ● Conflictwithprogramobjectivesorrequirements? ● Interfaceswithotherprogramsorsystems?  Are the requirements underconfigurationcontrol?  Are dependentrequirementsidentified?  Doeseach requirementhave one ormore funded"parent"requirement(s)?  Are requirementsavailable tothe programfroma single repository?  Doesthe program have a Change Control Board (CCB): ● Establishedatthe programlevel? ● Establishedatappropriate sub-programlevels? ● Representative of all stakeholders? ● That meetsregularly? ● That is effective?  Are requirementsconsistentwith: ● Program fundingandschedule? ● Stakeholderinvolvement? ● Technologyavailable? ● Infrastructure architecture?  Are hardware,software andinterface constraintsidentified?  Do the requirementsaddressthe entire lifecycle (includinglogisticsandsuitability)?
  • 4. [RISK MANAGEMENT GUIDEANCE] October12, 2009 4 Schedule Risks |NiwotRidge LLC SCH E D U LE RIS KS  Is there sufficienttime todevelop,document,andgainapproval forprogramacquisition strategy?  Is there sufficienttime tocontract,develop,andtestasupportable product?  Is schedule consideredintrade-offstudies?  Doesthe schedule reflectrealisticacquisitionplanning?  Are the AcquisitionPlanningBoard(APB) scheduleobjectivesrealisticandattainable?  Are the resourcesavailable tomeetschedule?  Doesthe schedule accommodate forrework?  Doesthe schedule accommodate forcontingencyplanning?  Are the schedule estimationmethodsaccurate andstandardizedwithinprogram?  How visibleisthe programschedule todecision-makersandhigher-levelmanagement? CO S T AN D BAS IS O F ES T IMAT E RIS KS  Were realisticcostobjectivesestablishedearly?  Doesthe fundingprofile matchthe acquisitionstrategy?  Is the fundingprofilestable frombudgetcycle tobudgetcycle?  To Reduce Total OwnershipCost(RTOC): ● Was the systembaselinedbeforecontractaward? ● Was sustainmentplanningdone upfront? ● Are cost and manpowersavingsprojectionstrackedtoplan? ● Are cost and manpowersavingsprojectionsrealized?  Are cost-performance tradeoffsbeingdone,especiallyformarginal performance capability improvements?  What are the redesigncostsof: ● EngineeringChange Proposals(ecps)? ● Modificationsonce systemisdeployed?  Are supportrequirementsbeingcostedearly?  Doesthe systemrelysignificantlyonsoftware? CO N T R ACT ING AN D PR O CU REME NT RIS KS  Doesthe contract include requirementsfornecessaryengineeringandmanagementprocesses and policies?  Are there multiple contractorsinvolvedinthe program? ● Didanalysisdeterminewhobesttodointegration - governmentorcontractor? ● Is the Governmentresponsible forintegration? ● Is a Prime Contractorresponsibleforintegration? ● Has an integrationcontractbeenauthorized,planned,andimplemented?  Is the contractor able to complete agreedtofunctionalitywithindefinedguidelines?  Are there sufficientincentives?  Is the Governmentaware of the workrequiredtocomplete the jobwithinbudgetandschedule?  Is the Governmentmonitoringthe workperformed?
  • 5. [RISK MANAGEMENT GUIDEANCE] October12, 2009 5 Funding/Financial Risks |NiwotRidge LLC  Didanalysisdeterminethe workrequired?  Didpast experience determine the workrequired?  Can the GovernmentandContractor reachagreement on: ● Program requirements? ● Testresults? ● Warranty responsibility?  Is Governmentable todiscussthe workprogramwithpeople doingthe job? ● EvenwhensubcontractedbyPrime Contractor?  Is the subcontractmanagementevaluatedsufficiently?  Are specificitemsthatusedtobe undermilitarystandardsidentifiedandmanaged?  Do the Government-purchaseddatapackagesfollow contractor-uniquemanufacturing processes?  Are the Government-purchaseddatapackagesreproducible?  Is reprocurementdataavailableintime forproduction?  Do the followinghave goodrelationships: ● GovernmentandContractor? ● Contractor andIntegrator? ● Contractor andSubcontractor?  Doesthe Contractor pro-actively: ● Identify DiminishingManufacturingSource (DMS) parts? ● Solve DiminishingManufacturingSource (DMS) issues?  Doesthe Contractor have a good processto manage changesinthe program?  Can the Contractor be downsizedorboughtout?  Is systemengineeringexpertise available atthe contractorfacility?  Are the keypersonnel citedbythe contractorin hisproposal actuallyperformingonthe contract?  Do the contractor personnel availableunderthe contracthave the skillsnecessarytodevelopor integrate the system?  Will the contractor be able to hire forthe productionrun?  Will skilledpersonnelbe re-allocatedif contractistoosmall?  Was the program baselinedpriortocontractaward? FU N D IN G / FIN AN CIAL RIS KS  Is the fundingprofilestable?  Is the fundingprofileallocatedadequatelyforthe programschedule? ● Are RDT&E fundsearlyand/orinadequate? ● Are productionfundsearly,late,and/orinadequate? ● Doesfundingtimingconsiderlongleaditems?  Is the fundingunderthe control of the program manager?  Is the fundingforthe programin contentionwithotherprograms?  Are fundsreprogrammedperiodicallybyyears?  Are fundsreprogrammedperiodicallybyappropriations?  Doesthe fundingprofile allowforareasonable programplan?
  • 6. [RISK MANAGEMENT GUIDEANCE] October12, 2009 6 ManagementandLeadershipRisks |NiwotRidge LLC  Is the fundingsufficientforrealizationof the requirements?  Doesfundingconsiderlicensingfees? MAN AG E ME NT AN D LE ADE RS HIP RIS KS  Doesthe program have documentedmanagementprocessesorcontrols?  Doesthe program managerhave managementandleadershipexperience?  Doesthe program managerhave managementandleadershiptraining?  Is the program managerpositionchangingfrequently?  Are program budget,cost,and/orschedule fixedforreasonable durations?  Are program budget,cost,and/orschedule political issues?  Are parallel orevolutionarydevelopmentshandledeffectively?  Is the program managementcentralized(single locationforPMand PCO)?  Is the program planfeasible?  Is the program managerable tomeetwithseniordecision-makersforprogramdecisionswhen needed?  Doesthe program managerunderstandthe prioritiesof the stakeholders?  Are the administrative reportingrequirementsreasonable?  Are the resourcesassignedtothe programoffice sufficienttohandle the programworkload?  Are the governmentandsupportcontractor resourcesassignedtothe programsufficientto handle the programworkload?  Do requestsforadditional informationrequire additionalfunding?  Are all stakeholdersknown?  Are otherprograms evaluatingthisprogramforpossibledevelopmentopportunities?  Is the program prioritysufficienttogetnecessarypersonnel,equipment,andfacilities?  Is the propermix (experience,skills,stability) of people assignedtothe programor contractor team?  Are effective riskassessmentsperformed? ● Are the resultsunderstood? ● Are the resultsactedupon?  Doesthe program managementteamhave acommitmenttodeliveringaqualityproduct?
  • 7. [RISK MANAGEMENT GUIDEANCE] October12, 2009 7 SystemsEngineeringRisks |NiwotRidge LLC SYS T E MS EN G INE ERIN G RIS KS  Are the designimplicationssufficientlyconsideredinconceptexploration?  Is conceptmature enoughfordevelopmenttobegin? ● If not, have trade studiesbeendone toclarifycritical components? ● Didtrade studiesincludeproductionrisk?  Will the systemsatisfyuserrequirements?  Is the designcosteffective?  Doesthe designrelyonnewor untriedtechnologyorexoticmaterialstoachieve performance objectives?  Will still maturingorunproventechnologiesbe adequatelydevelopedbefore itsneeded capabilities? ● Is a TechnologyReadinessLevel (TRL) usedtoassessthe maturityof technologies? ● Has the risk impactfor eachTRL level beencapturedinthe RiskManagementPlan(RMP)?  Is productionfundingavailable atthe needed time inthe developmenteffort?  Has the standard operatingenvironment (SOE) beenestablished?  What engineeringprocessesare beingusedonthe program?  Is the systemdesignfault-tolerantinawayneededforproperfunctioning?  What isthe growth/expandabilityrange of the systemindevelopment?  Doesthe developmentalignwiththe operational concept?  How closelydoesthe designenvironmentmatchthe actual operational environment?  Is the systembeingbenchmarkedatappropriate milestones?  Who has configurationcontrol?  Are interfacingsystemsbeingdevelopedinparallel?  Are reliability,maintainability,availabilityrequirementsbeingmet?  Are the technical,operational andprogrammatic requirementsstable?  Are stressand strength/stressanalysesperformedtoensure thatappliedvaluesinderatingand safetyforcomponentpartsand materialsmeetcriteria?  Are “worst case”tolerance analysesperformedtoensure thatsystemperformance remains withinspecifiedlimits?  Doesanalysisresultinappropriate designrevisionstoreduce risk?  Are parts and materialstestedearlyinthe designatintendedoperational stresslevels?
  • 8. [RISK MANAGEMENT GUIDEANCE] October12, 2009 8 Facilities |NiwotRidge LLC FACIL IT IE S  Were productionimplicationsconsideredduringconceptexploration?  Was productionconsideredsufficientlyindesign?  Do program plansinclude vendorsupport?  Do program plansinclude longleaditems?  Do program plansaddressthe knownvariability’sof costand schedule?  Are the productionprocessesproven?  Are sufficient,cost-effective facilitiesavailableforproduction?  Is the infrastructure provided(e.g.,office space,facilities,supplies,etc.) sufficientforprogram needs?  What isthe impactto the program of changesin infrastructure availabilityorperformance?  Doesthe program needCapital Equipment?  Is the capital equipmentprovidedcorrectandsufficientforprogramneeds?  What isthe impactto the program of changesin capital equipmentavailabilityorperformance?  Doescontract offeranyincentive tomodernizefacilitiesorreduce cost?  Do buildingshave appropriate storage forhazardousmaterialsandappropriate ventingfortoxic or asphyxiatinggases?  Doesmachineryandequipmenthave requiredsafetydevices?  Do noise levelsincreasethe probabilityof mishapoccurrence?  Whenpotential forinjuryfromchemicalsexists,are appropriate antidotesorfirstaidavailable?  Is the needforeye washand washdownfacilitiesassessed?  On occasion,whentemporaryfacilitiesorconstructionare necessaryforcertainoperations,do these facilitiespresentsignificanthazards?  Are buildingshousinghazardousactivitydesignedtobe compatiblewiththe enclosed operation?  Are buildingshousinglasersorotherelectromagneticradiatingdevicesdesignedtominimize hazardsand provide controlledaccess?  Doesthe designminimize the effectsof anyhazardousactivitysuchasfire,explosion,toxicity, radiation,andasphyxiation?  Can visual andaural warningsand alarmsbe readilyseenandheard?  Doesthe buildingdesignfurtherfacilitate the rapidevacuationof occupants?  Are fire extinguishingagentsreadilyaccessibleandeffective,butbythemselvesdonotpresenta significanthazard topersonnel?