Tag exercises

Use of Pre-Developed Exercises – Proceed with Caution

Tim Riecker, The Contrarian Emergency Manager 2 Comments

I was recently asked by a client about my thoughts on pre-developed or ‘canned’ exercises.  As it turns out, I have a lot of feelings about them, most of them negative.  Pre-developed exercises, if properly understood and applied, can be a huge help, but the big problem is that we’re dealing with human nature, and some people are just damn lazy.  Garbage in, garbage out.

We need to keep in mind that exercises, fundamentally, are developed to validate plans.  Not my plans.  Your own plans.  While standards of practice mean that most plans have a high degree of commonality (i.e. a HazMat response plan for a jurisdiction in California will be largely the same as one for a jurisdiction in New York State), it’s often the deviations from the standards and the local applications that need to be tested most.  So it doesn’t do well for anyone to replicate an exercise that doesn’t test your own plans.  Similarly, the foundation of exercise design is objectives.  While the pre-developed exercise may have a theme that coincides with what you want to test, sheltering, for example, there are a lot of different aspects of sheltering.  The pre-developed exercise might not focus on what you need to exercise.  With all this, anyone who wants a quality exercise from something pre-developed is going to have to do a lot of re-development, which might be more frustrating than starting from scratch.

HSEEP1

If you want a quality exercise, you really can’t short cut the process.  Not only might HSEEP be required for whatever grant funding you are using for the exercise, but it’s a best practice – and for good reason.  So often people want to cut corners.  If you do, the final product will look like you’ve cut corners.  It might lack proper context, good reference documents, or meaningful evaluation.   The exercise planning meetings have defined purpose, and the documents help capture that process and communicate the intent to specific audiences.

On the other hand, there are proper ways to use materials from a previously developed exercise to benefit your own exercise.  The development of good questions in discussion-based exercises and injects for operations-based exercises can be a challenge.  Reviewing other exercises, especially when there might be some similarity or overlap in objectives, can be a huge help, so long as they are properly contextualized and relate back to objectives for your exercise.  This isn’t a copy and paste, though… as it all should still be applied within the exercise design process.

There are some exercises out there that might seem like exceptions to what I’ve written above.  The first that comes to mind are FEMA’s Virtual Table Top Exercises (VTTX).  The VTTX is a great program, conducted monthly, focusing on different themes and hazards.  FEMA’s Emergency Management Institute (EMI) assembles a package of materials that go to each community registered for the event, allowing a measure of local customization.  While jurisdictions may use this material differently, it is at least an opportunity to discuss relevant topics and hopefully capture some ideas for future implementation.

Similarly, my company, Emergency Preparedness Solutions, recently completed a contract with the Transportation Research Board for a project in which we developed a number of ‘generic’ exercises for airports.  These functional exercises, facilitated through a web-based tool, can be easily customized to meet the needs of most airports across the nation and are written with objectives focused on the fundamentals of EOC management within the timeline of an incident.  While specific plans aren’t directly referenced in the exercises, airport personnel are able to examine the structure of response in their EOC and can reflect on their own plans, policies, and procedures.  Similar to FEMA’s VTTX series, they aren’t a replacement for a custom-developed exercise, but they can help examine some fundamentals and start some important discussions.  I’m not able to get into much more detail on this project, as the final report has yet to be published, but look forward to future posts about it.

All in all, I tend to caution against using pre-developed exercises.  I simply think that most people don’t use them with the right intent and perspective, which can severely limit, or even skew, outcomes.  That said, there exists potential for pre-developed exercises to be properly applied, so proceed with caution and with your wits about you.  Understanding that time, money, and other resources can be scarce, emergency management has always done well with ‘borrowing best practices’.  While there is sometimes nothing wrong with that, short cutting the process will often short cut the benefits.  Do it right.  Use of a custom-developed exercise is going to maximize benefit to your community or organization.

© 2018 – Timothy Riecker, CEDP

EPS New logo

Active Shooter Drills with Students – Good Idea or Bad?

Tim Riecker, The Contrarian Emergency Manager Leave a comment

While school shootings, unfortunately, are nothing new, we are seeing them occur with greater frequency.  Without getting into my thoughts on firearms, I will say that preparedness, prevention, and mitigation for mass shooting incidents in schools and other soft targets of opportunity, are multi-faceted.  Shooters are just as much of a persistent threat as hurricanes, tornadoes, or flooding; amplified by the will of the shooter(s) to do harm and their ability to reason through paths of deterrence.  While a number of measures can and should continue to be implemented to prevent and protect soft targets, just as we do with natural hazards, we must continue to prepare for an attack that slips past or through our preventative measures.

Readers will know that I’m a huge advocate of exercises in the emergency management/public safety/homeland security space.  While the primary purpose of exercises is to validate plans, policies, and procedures; we also use them to practice and reinforce activities.  Certainly every school, college, shopping mall, office building, and other mass gathering space should hold active shooter drills.  Many of these facilities already conduct regular fire evacuation drills, and shooter drills should also be added to the mix.

Where to start?  First of all, you need a plan.  ALL EXERCISES START WITH A PLAN.  The sheer number of exercises I’ve seen conducted with no plan or a knowingly poor plan in place is staggering.  If people don’t know what to do or how to do it, the value of the exercise is greatly diminished.  If you are a responsible party for any of these spaces, reach out to your local law enforcement and emergency management office for assistance in developing an active shooter protection plan.  If you are a regulated facility, such as a school or hospital, the state offices that provide your oversight are also a resource.  You can find some planning guidance here and here.   While your focus with this activity is an active shooter protection plan, recognize that you will also need to re-visit the public information component of your emergency operations plan (you have one, right?) and your business continuity plan, as I guarantee you will need to reference these in the event of a shooting incident.  A final note on planning… don’t do it in a vacuum!  It should be a collaborative effort with all relevant stakeholders.

As for exercises, consider what you want to accomplish and who needs to be involved.  In a mall, it’s not wise to include shoppers in exercises since they are a transient audience and forcing their involvement will very likely be some bad PR and impact stores financially.  That said, you need to anticipate that mall shoppers won’t know what to do or how to react to a shooter, therefore mall staff need to be very forceful and persistent in how they deal with patrons in such an incident.  Therefore, involving mall staff along with law enforcement and other stakeholders in an off-hours exercise is a great idea.

Schools, however, are a different situation, as their populations are static for an extended period of time.  While school faculty and staff should exercise with law enforcement, there are different thoughts on how and when to involve kids in these exercises.  There are some that advocate their involvement, while there are some who are adamantly opposed.  I reflect back on fire evacuation drills, which occur with regularity in schools. These drills reinforce procedure and behavior with students.  They know they need to line up and proceed calmly and well behaved along a designated path to exit the building, proceeding to a meeting spot where teachers maintain order and accountability.  These are behaviors that stick with many into adulthood if they find themselves in a fire evacuation (drill or otherwise) – so it’s also a learning experience.  The same holds for tornado and earthquake drills, which are held regularly in many areas around the country.  Fundamentally, for a shooter situation, we also need to reinforce procedure and behavior with students.  They need to know what to do in lockdown, lockout, and evacuation.

The prospect of a shooter is a horrible thing for anyone to deal with, much less a child.  I’ve spoken to parents who, themselves, are horrified about the prospect of speaking to their children about a shooter in their school.  In every occasion, I’ve said this: You damn well better talk to them about it.  This is a discussion with perhaps greater importance than talks about strangers, drugs, alcohol, or sex; and it needs to begin with children from kindergarten on up.  Schools need to teach students what to do when the alert occurs for an active shooter – typically this involves getting them safely out of view from someone who might be in the hallway while teachers lock or barricade the door and turn off lights.  Students need to understand the gravity of the situation and remain still and quiet.  Evacuation will generally only occur under someone’s direction.  There will be loud noises and it’s likely the police won’t speak kindly as they are clearing rooms, looking for a shooter and potential devices.  To be certain, it’s scary for adults and I wish our children didn’t have to endure such a thing, but practicing and reinforcing procedures and behavior will save lives.  I’ll offer this article, that discusses some of the potential psychological impacts of shooter drills on kids.  These impacts are a reality we also need to deal with, but I think the benefits of the drills far outweigh the costs.

Mass shootings, like most aspects of public safety, underscore the need for us to do better not only in public safety response, but also as a society.  The answers aren’t easy and there is no magic pill that will provide a solution to it all.  It requires a multifaceted approach on the part of multiple stakeholders, sadly even those as young as four years old, to prepare, prevent, and protect.

© 2018 – Timothy M. Riecker, CEDP

Emergency Preparedness Solutions, LLC

HSEEP Training – Is it Required

Tim Riecker, The Contrarian Emergency Manager Leave a comment

Continuing from my previous blog post, I’ll answer a search phrase used to bring someone to my blog.  Earlier this month, someone searched ‘Is HSEEP training mandatory?’.  We speak, of course, of the Homeland Security Exercise and Evaluation Program, which is the DHS-established standard in exercise program and project management.

The short answer to the question: Maybe.

Generally speaking, if your exercise activities are funded directly or indirectly by a federal preparedness grant, then grant language usually requires that all exercises are conducted in accordance with HSEEP.  While most federal grant guidance doesn’t explicitly state that exercise personnel must be formally trained in HSEEP, it’s kind of a no-brainer that the fundamental way to learn the standards of practice for HSEEP so you can apply them to meet the funding requirement is by taking an HSEEP course.  If you are a jurisdiction awarded a sub-grant of a federal preparedness grant or a firm awarded a contract, there may exist language in your agreement, placed there by the principal grantee, that specifically requires personnel to be trained in HSEEP.

Beyond grant requirements, who you work for, who are you, and what you do generally don’t dictate any requirement for HSEEP training.  Aside from the federal grant funding or contracts mentioned, there is no common external requirement for any organization to have their personnel trained in HSEEP.  If your organization does require it, this is likely through a management-level decision for the organization or a functional part of it.

So, while HSEEP is a standard of practice, training in HSEEP, in general terms, is not a universal requirement.  That said, I would certainly recommend it if you are at all involved in the management, design, conduct, or evaluation of exercises.  FEMA’s Emergency Management Institute (EMI) offers HSEEP courses in both a blended learning and classroom format.  The emergency management/homeland security offices of many states and some larger cities offer them as well.

© 2018 Timothy Riecker, CEDP

Emergency Preparedness Solutions, LLC SM

Exercises: Simple is Usually Better

Tim Riecker, The Contrarian Emergency Manager 2 Comments

I find often that people want to run exercises they aren’t quite ready for.  Sometimes those exercises are too complex, or they simply aren’t the appropriate type.  Most often, we run exercises to test plans, policy, and procedures; but sometimes those plans, policies, and procedures aren’t quite ready to be tested.  Last year I advised a client to run a workshop instead of a tabletop exercise.  The initial goal of the tabletop was to validate a new plan, but this plan wasn’t ready to be validated.  The problem was that many stakeholders hadn’t yet seen the plan, and the review of that plan by our team in preparedness for the exercise wasn’t favorable.  The plan had much of the needed content, but it was disjointed and didn’t have any logical flow.  By conducting a scenario-based workshop, we were able to identify not only the ideal flow of the plan by flagging benchmark activities, but we were also able to discuss expectations of and for each stakeholder agency in the plan.  The client was then able to apply the results of the workshop to restructure their plan and make some needed substantive changes.

Similarly, I’ve encouraged a current client to conduct a workshop instead of a tabletop.  The initial goal of this tabletop was to identify how a new group of stakeholders could integrate into an existing plan.  In this situation, the tabletop would have been less than effective as the new stakeholder group isn’t yet identified in the plan.  The outcome of the workshop will be to identify how this integration can occur.

I think that sometimes people gravitate to certain exercises simply because they are more popular in a certain application.  That preconceived notion might be too complex or simply a poor choice for what you really need to accomplish.  When it comes to discussion-based exercises, most people default to a tabletop.  With operations-based exercises, it can vary.  Drills are often used for tactical applications, but we don’t see them as much in EOCs.  Drills certainly have a place in an EOC if you are looking to test a very specific function or activity.  While full-scale exercises are fun and sexy, I’ve been to the site of plenty that are total chaos because the fundamental premise of certain plans hasn’t been worked out (or some stakeholders aren’t familiar with them), which perhaps should have been done through a discussion-based exercise or a drill or functional exercise first.  Running a drill to test and familiarize the process of setting up key equipment prior to doing it for the first time in a full scale will pay a lot of benefits, and certainly prevent dozens or hundreds of other people being held up in a full scale.

Another issue I often see with exercises is very long and complex Master Scenario Events Lists (MSELs).  The MSEL is essentially the timeline or script of the exercise.  Along with listing all injects, it also identifies all benchmarks in the management of the exercise, such as StartEx and EndEx, and the introduction of new elements or transition to a different segment.  While there is no particular rule of thumb for how many injects are needed for different exercise types, everything needs to associate back to the objectives of the exercise.  I hate injects that are crafted simply for ‘noise’ (unless it’s an intel exercise), or injects intended to just give someone something to do.  Arguably, if the participants take an exercise seriously, such as a functional exercise, and play out the situation as they would in real life, you can engage an entire EOC for a few hours with even ten well-crafted injects.  While some functions are very focused, consider that the vast majority of what we do in emergency management requires coordination among a variety of elements and functions.  Capitalize on that.  One inject may engage multiple agencies or functions because of the need to coordinate and problem solve.  It’s not enough to identify a solution to the problem, but work through where the resources will come from, how they will get to where they need to go, and what support is needed for them and how long.  That’s a lot of problems to solve and will often transcend every function within the incident command system.  Exercises don’t need to be complex to be effective.  Create a handful of objectives and make sure everything relates back to them.  Simplicity can work.

My last recommendation is to keep your exercise planning team a manageable size.  I’ve been the lead planner for some very large exercises.  These exercises, largely due to their sponsors, ended up involving massive exercise planning teams – and by massive I mean over five or six dozen people – or more.  These are just sheer insanity.  Not every agency or organization involved in the exercise needs to be directly represented, nor does each organization need to send a small army of people.  What you do need is consensus from those organizations on the objectives and their scope of play.  That doesn’t mean they have to be involved in every aspect of planning the exercise.  Just like any other meeting or group project, a large exercise planning team can be cumbersome and management by committee is never efficient.  If need be, stakeholder groups can be developed based upon function.  For example, a fire service exercise planning team would develop their contributions to the exercise.  Just make sure that these groups are well coordinated and the overall exercise planning effort is unified, otherwise you’ll end with a disjointed exercise effort.

In the end, simplicity rules.  As you begin planning your exercise, consider, in every step if it can or should be simplified.  Always refer back to your intent and your objectives.  Chances are you can create a simpler exercise that is just as impactful, or perhaps more impactful.  When our inclination is to make things overly complicated, we often miss the point entirely.

© 2017 – Timothy Riecker, CEDP

Emergency Preparedness Solutions, LLC

 

 

Measuring Preparedness – An Executive Academy Perspective

Tim Riecker, The Contrarian Emergency Manager 10 Comments

A recent class of FEMA’s Emergency Management Executive Academy published a paper titled Are We Prepared Yet? in the latest issue of the Domestic Preparedness Journal.  It’s a solid read, and I encourage everyone to look it over.

First off, I wasn’t aware of the scope of work conducted in the Executive Academy.  I think that having groups publish papers is an extremely important element.  Given that the participants of the Executive Academy function, presently or in the near future, at the executive level in emergency management and/or homeland security, giving others the opportunity to learn from their insight on topics discussed in their sessions is quite valuable.  I need to do some poking around to see if papers written by other groups can be found.

As most of my readers are familiar, the emphasis of my career has always been in the realm of preparedness.  As such, it’s an important topic to me and I tend to gravitate to publications and ideas I can find on the topic.  The authors of this paper bring up some excellent points, many of which I’ve covered in articles past.  They indicate a variety of sources, including literature reviews and interviews, which I wish they would have cited more completely.

Some points of discussion…

THIRA

The authors discuss the THIRA and SPR – two related processes/products which I find to be extremely valuable.  They indicate that many believe the THIRA to be complex and challenging.  This I would fully agree with, however I posit that there are few things in the world that are both simple and comprehensive in nature.  In particular regard to emergency management and homeland security, the inputs that inform and influence our decisions and actions are so varied, yet so relevant, that to ignore most of them would put us at a significant disadvantage.  While I believe that anything can be improved upon, THIRA and SPR included, this is something we can’t afford to overly simplify.

What was most disappointing in this topic area was their finding that only a scant majority of people they surveyed felt that THIRA provided useful or actionable information.  This leaves me scratching my head.  A properly done THIRA provides a plethora of useful information – especially when coupled with the SPR (POETE) process.  Regardless, the findings of the authors suggest that we need to take another look at THIRA and SPR to see what can be improved upon, both in process and result.

Moving forward within the discussion of THIRA and SPR, the authors include discussion of something they highlight as a best practice, that being New York State’s County Emergency Preparedness Assessment (CEPA).  The intent behind the CEPA is sound – a simplified version of the THIRA which is faster and easier to do for local governments throughout the state.  The CEPA includes foundational information, such as a factual overview of the jurisdiction, and a hazard analysis which ranks hazards based upon likelihood and consequence.  It then analyses a set of capabilities based upon the POETE elements.  While I love their inclusion of POETE (you all know I’m a huge fan), the capabilities they use are a mix of the current Core Capabilities (ref: National Preparedness Goal) and the old Target Capabilities, along with a few not consistent with either and a number of Core Capabilities left out.  This is where the CEPA falls apart for me.  It is this inconsistency with the National Preparedness Goal that turns me off.  Any local governments looking to do work in accordance with the NPG and related elements, including grants, then need to cross walk this data, as does the state in their roll-up of this information to their THIRA and SPR.

The CEPA continues with an examination of response capacity, along the lines of their response-oriented capabilities.  This is a valuable analysis and I expect it becomes quite a reality check for many jurisdictions.  This is coupled with information not only on immediate response, but also sustained response over longer periods of time.  Overall, while I think the CEPA is a great effort to make the THIRA and POETE analysis more palatable for local jurisdictions, it leaves me with some concerns in regard to the capabilities they use.  It’s certainly a step in the right direction, though.  Important to note, the CEPA was largely developed by one of the authors of the paper, who was a former colleague of mine working with the State of New York.

The Process of Preparedness

There are a few topic areas within their paper that I’m lumping together under this discussion topic.  The authors make some excellent points about our collective work in preparedness that I think all readers will nod their heads about, because we know when intuitively, but sometimes they need to be reinforced – not only to us as practitioners, but also to other stakeholders, including the public.  First off, preparedness is never complete.  The cycle of preparedness – largely involving assessment, planning, organizing, equipping, training, and exercising – is just that – a cycle.  It’s endless.  While we do a great deal of work in each of these, our accomplishments are really only temporary.

The authors also mention that our information is not always precise.  We base a lot of what we do in preparedness on information, such as a hazard analysis.  While there are some inputs that are factual and supported by science, there are many that are based on speculation and anecdote.  This is a reality of our work that we must always acknowledge.  As is other of their points – there is no silver bullet.  There is no universal solution to all our woes.  We must constantly have our head in the game and consider actions that we may not have ever considered before.

ICS Improvement Officer

The authors briefly discuss a conceptual position within the ICS Command Staff they call the ICS Improvement Officer.  The concept of this fascinating, if not a bit out of place in this paper given other topics of discussion.  Essentially, as they describe this position, it is someone at the Command Staff level who is responsible for providing quality control to the incident management processes and implementations of the organization.  While I’ve just recently read this paper and haven’t had a lot of time to digest the concept, I really can’t find any fault with the concept.  While the planning process itself is supposed to provide some measure of a feedback loop, there isn’t anyone designated in the organization to shepherd that process beginning to end and ultimately provide the quality control measures necessary.  In practice, I’ve seen this happen collaboratively, among members of the Command and General Staff of a well-staffed structure, as well as by the individual who has the best overall ICS insight and experience in an organization – often the Planning Section Chief.  The authors elude to this position also feeding an AAR process, which contributes to overall preparedness.  I like this idea and I hope it is explored more, either formally or informally.

Conclusion

There are a number of other topic areas of this paper which I haven’t covered here, but I encourage everyone to read on their own.  As mentioned earlier, I’d like to see more of the research papers that come from FEMA’s Emergency Management Executive Academy available for public review.  Agree or disagree with their perspectives, I think their discussions on various topics are absolutely worth looking at.  It’s these discussions like these which will ultimately drive bigger discussions which will continue to advance public safety.

I’m always interested in the perspectives of my readers.  Have you read the paper?  What do you think of the discussion topics they presented?

© 2017 – Timothy M Riecker, CEDP

Emergency Preparedness Solutions, LLC

 

Preparedness Exercises – The Building Block Concept Can Be Misleading

Tim Riecker, The Contrarian Emergency Manager Leave a comment

If you’ve been doing emergency management and homeland security exercises for even a little while, you are probably familiar with this graphic.  It’s included in a great many exercise training courses and other materials that talk about the different types of exercises out there.  This graphic looks correct at first glance.  It seems to make sense.  Intuitively, we assume that full-scale exercises are the most complex exercise type and that they test capabilities to the greatest extent.  When we put more thought into that, though, we realize that it can be wrong.

I’m happy to note that the most recent document on the Homeland Security Exercise and Evaluation Program (HSEEP) (April 2013) does NOT include this graphic.  They include a couple of paragraphs on using a ‘progressive approach’ to a multi-year exercise program, recommending that “each successive exercise building upon the previous one until mastery is achieved” is the path forward.  While I’m not too crazy about this statement, either, it’s not as misleading as the legacy ‘building block’ graphic.

Here’s the problem with the graphic – It assumes too much.  While in some instances this graphic can be correct, it shouldn’t be regarded as even occasional guidance.  I’ve witnessed, managed, designed, evaluated, or otherwise participated in a number of workshops, tabletops, drill, and functional exercises that are far more complex than some full-scale exercises I’ve likewise been involved in.  Similarly, I can attest to some ‘lower level’ exercises testing capabilities to a greater extent than the ‘higher level’ exercises.  The hierarchal structure is simply misleading.  The problem this can create is people being dismissive of the relevance, necessity, and value of conducting exercises other than functional and full-scale.

Making a training comparison, exercise types don’t really stick to a scaled taxonomy.  (Check out this article for a small introduction to Bloom’s Taxonomy which is used in instructional design.) While we can state that an awareness level course is more about knowing and understanding, and an operations-level course is more about applying, we can’t say the same for exercises as a spectrum generalization.  Consider that seminars are certainly geared toward orienting people with information, while workshops, on the other hand, require creation of a product, by definition.  Tabletop exercises can (and should) be incredibly in-depth, analyzing plans and policy, while drills are more about application.

So what exercise type should you choose?  It goes back to the foundations of exercise design – consider your objectives, then consider what exercise type best fits what was identified that you want to accomplish.  Reflecting, now, back on the progressive approach mentioned in the HSEEP document, it’s true that you probably don’t want to jump into a full-scale right away.  That has less to do with the perceived complexity of the exercise and more to do with how plans are properly tested – which is the main reason why we exercise.  First, we need to talk through aspects of our plans, policies, and procedures.  We need to make sure that our foundational assumptions are sound and that broader decisions and actions are in line with the documents created.  This is typically the reasoning behind conducting a table top exercise before any type of operations-based exercise.  Once we have established that the foundational premise and supporting policies of the plan is sound, then it can make sense to progress to a selection of operations-based exercises to test various tactile aspects of the plan and associated procedures.

That said, some procedures are so tactile that really the only way to test them is through an operations-based exercise.  Perhaps they are first built in a workshop-type of environment, then go straight to a drill for testing.  That might be all that’s needed.  Yes, they could be further integrated into a functional or full-scale later, if you choose to integrate them into other activities.

The bottom line here is that while the building-block approach to exercises makes sense at a glance, it is really quite more complex than the graphic eludes to.  Yes, it still has some relevance, but it should not be viewed as the rule.  Just as in training and emergency response, objectives drive everything in exercises.

© 2017 – Timothy M Riecker

Emergency Preparedness Solutions, LLC

 

In a POETE State of Mind

Tim Riecker, The Contrarian Emergency Manager 2 Comments

One of the searches that has most often brought people to my blog over the last couple of years has been POETE.  In case you forgot, POETE stands for Planning, Organizing, Equipping, Training, and Exercising.  If you conduct an internet search for POETE, there are very few relevant results.  Along with a few of my blog posts, there are a couple of articles published by others, and a few FEMA documents that include obscure references to POETE.  Sadly, there is nothing available that provides (official) guidance, much less doctrine.

Why is it that such a great tool has so few tangible references?  Unfortunately, I don’t have an answer to that.  I hope that will soon change.

POETE was most widely indoctrinated several years ago as an analysis step within the State Preparedness Reports (SPRs), which are annual submissions completed by every state, UASI (Urban Area Security Initiative-funded program), and territory.  Note: The SPR templates and guidance are generally not publicly posted, as they are sent directly to the points of contact for each jurisdiction – thus they generally don’t come up in internet search results.

The SPR is a step beyond the THIRA (Threat and Hazard Identification and Risk Analysis), which is a very in-depth hazard analysis.  The SPR examines each jurisdiction’s level of preparedness for hazards, referencing the 32 Core Capabilities.  Each Core Capability is then analyzed through the lens of POETE.

As a conceptual example, let’s use the Operational Communications Core Capability.  The POETE analysis will examine the jurisdiction’s preparedness by examining:

  • Planning (are plans adequate? Have they been tested?  What improvements need to be made?);
  • Organizing (are there organizational barriers to success? What human operational communications resources are available?  Are there gaps?  Have teams been exercised? What improvements need to be made?);
  • Equipment (does the jurisdiction have equipment necessary for operational communications? What needs are there relative to the resource management cycle?);
  • Training (what training has been provided? What training gaps exist?  When/how will they be addressed?);
  • Exercises (what exercises have been conducted that include the operational communications Core Capability? What were the findings of the AAR/IPs?  What future exercises are scheduled that include this Core Capability?).

Along with answering a few questions on each element, jurisdictions are asked to rate their status for each POETE element for each Core Capability.  If they look at their reports submitted historically, they can see the measure of progress (or lack thereof) with each.  They also have a tracking of identified action items to help them improve their measure of preparedness.

While this analysis can be quite tedious, it’s extremely insightful and informative.  Often, stakeholders have conceptual ideas about the state of preparedness for each Core Capability, but absent conducting this type of in-depth analysis, they rarely see the details, much less have them written down.  Documenting these helps with recognition, awareness, tasking, tracking, and accountability.  It’s a valuable activity that I would encourage all jurisdictions and organizations to conduct.

What else can POETE be applied to?  In the past few years, POETE is being included in DHS preparedness grants.  They often want applicants to identify key tasks within the POETE structure, and awardees to chart progress along the same lines.

I’ve advocated in the past to use the POETE structure in improvement plans, which are a step beyond after action reports from exercises, events, and even incidents.  Having key activities identified across each POETE element for the Core Capabilities analyzed is extremely helpful, and ensures that issues are being identified comprehensively.

Using the POETE concept across all preparedness efforts helps to tie them together.  By documenting each element for each Core Capability, you will have full visibility and reference to your current status and what needs to be improved upon.  It helps drive accountability, a comprehensive approach, and reduces duplication of efforts – especially in larger organizations.  While implementing such a program will take some investment up front to begin to identify, organize, and chart progress and establish an organizational system to do so, I feel it’s an investment that will pay off.

I’m hopeful that the use of POETE continues to see adoption across all of emergency management and homeland security, and that it is further reinforced as a standard through DHS, FEMA, NFPA, and other organizations which hold sway for settings standards and/or requirements.

How does your organization, agency, or jurisdiction use POETE?

© 2017 – Timothy M Riecker, CEDP

Emergency Preparedness Solutions, LLC

Planning for Preparedness

Tim Riecker, The Contrarian Emergency Manager 2 Comments

Yes, planning is part of preparedness, but organizations must also have a plan for preparedness.  Why?  Preparedness breaks down into five key elements  – remember the POETE mnemonic – Planning, Organizing, Equipping, Training, and Exercising.  I’m also in favor of including assessment as a preparedness element.  Needless to say, we do a lot when it comes to preparedness.  Each of these elements alone involves significant activity, and together there are opportunities for activities to be synchronized for maximum benefit.  In smaller organizations, these elements may be addressed by one or two people, which itself can be challenging as these are the same people running the organization and addressing myriad other tasks.  In larger organizations each element alone may be addressed by a number of people, which also provides a complication of synchronizing tasks for maximum benefit.  Either way, as with all project and program management, without a plan of action, we may forget critical tasks or do things out of order.

By establishing a preparedness plan, we can address many of these issues.  The plan can be as detailed as necessary, but should at least identify and address requirements (internally and externally imposed) as well as benchmarks to success.  But what do we plan for?

Assessment – Yes, I’m including this as an element.  Assessment is something we should constantly be doing.  Just as we strive to maintain situational awareness throughout an incident, we have to be aware of and assess factors that influence our state of readiness.  There are a variety of assessments that we do already and others that can be done as they relate to the other five elements.  In fact, assessments will inform our preparedness plan, helping us to identify where we are and where we need to be.  We can review after action reports from incidents, events, and exercises to determine what improvements must be made.  We can research best practices and examine funding requirements, legal requirements, and standards such as EMAP or NFPA 1600 which can broadly influence our programs.  We assess current plans to identify what our gaps are and what plans need to be revisited.  We can assess our organization to determine if staffing is maximized and that policy, procedure, and protocol support an agile organization.  The status of equipment can be assessed to determine what is operational and ready to deploy.  We can conduct a training needs assessment to identify what training is needed; and lastly, we can assess opportunities to exercise.  Not only should our assessments inform what needs to be accomplished for each of the POETE elements, but regular assessment check ins and activities should be identified, nay planned for, within our preparedness plan.  Consider what else can inform our preparedness plan.  A recent hazard analysis, THIRA, or state preparedness report (SPR) can feed a lot of information into a preparedness plan – especially the state preparedness report, as it is specifically structured to identify POETE gaps.

Planning – We should always examine what we have.  If plan reviews aren’t scheduled, they often fall to the wayside.  Plan review teams should be identified for each plan, and a review schedule or cycle established.  Benchmark activities for plan review activities should also be identified.  The need for new plans should also be highlighted.  Based on standards, requirements, best practices, or other need, what plans do you organization need to assemble in the next year or two?  Again, identify benchmarks for these.

Organization – Assessments of your organization, either as direct efforts or as part of after action reports or strategic plans can identify what needs to be accomplished organizationally.  Maybe it’s a reorganization, an increase in staffing levels, an impending change in administration, expected attrition, union matters, or something else that needs to be addressed.  As with many other things, some matters or organization are simple, while others are very difficult to navigate.  Without a plan of action, it’s easy to allow things to fall to the wayside.  What changes need to be made?  Who is responsible for implementing them?  Who else needs to be involved? What’s a reasonable timeline for making these changes happen?

Equipping – Many logisticians are great at keeping accurate records and maintenance plans.  This measure of detail isn’t likely needed for your preparedness plan, but you still should be documenting the big picture.  What benchmarks need to be established and followed?  Are there any large expenditures expected for equipment such as a communications vehicle?  Is there an impending conversion of equipment to comply with a new standard?  Are there any gaps in resource management that need to be addressed?

Training – Informed by a training needs assessment, a training plan can be developed.  A training plan should identify foundational training that everyone needs as well as training needed for people functioning at certain levels or positions.  Ideally, you are addressing needs through training programs that already exist, either internally or externally, but there may be a need to develop new training programs.  A training plan should identify what training is needed, for who, and to what level (i.e. to steal from the hazmat world – Awareness? Operations? Technician?).  The plan should identify who will coordinate the training, how often the training will be made available, and how new training will be developed.

Exercises – We have a standard of practice for identifying exercises into the future – it’s called the multi-year training and exercise plan (MYTEP).  While it’s supposed to include training (or at least training related to the identified exercises), training often falls to the wayside during the training and exercise planning workshop (TEPW).  The outcomes of the TEPW can be integrated into your preparedness plan, allowing for an opportunity to synchronize needs and activities across each element.

Just as we do with most of our planning efforts, I would suggest forming a planning team to shepherd your preparedness plan, comprised of stakeholders of each of the elements.  I envision this as a group that should be in regular communication about preparedness efforts, with periodic check-ins on the preparedness plan.  This engagement should lead to synchronization of efforts.  Identify what activities are related and how.  Has a new plan been developed?  Then people need to be trained on it and the plan should be exercised.  Has new equipment been procured?  Then people should be trained in its use and plans should account for the new or increased capability.

Like any effort, endorsement from leadership is necessary, especially when multiple stakeholders need to be brought together and working together.  Many emergency management and homeland security organizations have positions responsible for preparedness, often at the deputy director level.  The formation and maintenance of a comprehensive preparedness plan should be a foundation of their efforts to manage preparedness and forecast and synchronize efforts.

Does your organization have a plan for preparedness beyond just a multi-year training and exercise plan?  What elements do you tie in?  Do you find it to be a successful endeavor?

Do you need assistance in developing a preparedness plan?  Contact us!

© 2016 – Timothy Riecker

Emergency Preparedness Solutions, LLC – Your Partner in Preparedness

Emergency Management: Why Failure is Necessary

Tim Riecker, The Contrarian Emergency Manager 4 Comments

One of the many podcasts I listen to is the TED Radio Hour from NPR.  For the uninitiated, the TED Radio Hour is a compilation of highlights from several TED Talks (you know what these are, right?) arranged around certain topics.  I like the topical arrangement and the sampling they do of the presentations, as well as the inclusion of interviews with many of the presenters.  Yesterday I listed to one from July 29, 2016 titled Failure is an Option.  In it, I was most drawn to the points made by Tim Hartford, an economist, and began to think that this guy needs to speak at some emergency management conferences.  What can an economist tell emergency managers?  His TED Talk is titled Trial, Error, and the God Complex.  It’s worth checking out.

How often do you hear someone in public safety proclaim that they don’t know about a certain topic or how to handle a certain situation.  Not very often.  Certainly we have a lot of confident, Type A people (myself included) who will not be stopped by a problem, even if we don’t know right off how we will solve it.  At the extreme end of this are those who refuse to plan.  Why?  Maybe they don’t want to be constrained by a plan, or maybe they don’t want something put in writing.  Maybe they simply don’t know right now what they will do, either a) hoping that it never happens, or b) assuming they will figure it out when it does.  Determination and persistence is good, but we can’t become ignorant despite it.  As I often mention in my posts, this is public safety, not a pick-up game of kick ball.  To me, there is nothing more serious.

Our egos drive us to feel that everything is on the line all the time.  While some may refuse to plan, others do plan, but the approach may not be realistic.  We’ve all seen plans that begin with one, two, maybe even three pages of assumptions.  That’s a lot of assuming for an emergency or disaster situation, which we all know is uncertain and dynamic.  Those long lists make me uncomfortable, as they should you.  Why do we do it?  Sure there are some things we can expect, but otherwise we are trying to dictate terms to the disaster.  Trust me, the disaster doesn’t give a damn about the plan you wrote or the terms and conditions you try to lay out for it.  But it makes us feel better by putting the disaster in a very defined box.  I know I’ve been guilty of this.

Let’s remove the ego.  Let’s proclaim that maybe we have no idea, or we have a few ideas but we aren’t sure which one is best.  Preparedness should be collaborative.  Get lots of ideas from people.  Talk though them and figure out which ones are the most viable.  Get these ideas down on paper, even loosely, and try them out.  We need to take advantage of our preparedness work to figure out the things we don’t know.

A number of years ago, it was identified through feedback and after action reports of incidents that the flow of information and resource requests in a certain EOC simply wasn’t working the way it was intended.  While I’m a big fan of the application of ICS in an EOC, the specific role an EOC plays as a multi-agency coordination center, the cross functions of some staff, and the politics involved aren’t really accounted for in ICS, so the strictest applications of ICS sometimes don’t apply well.  A small group of us were tasked to fix it.  While we each had some theories, none of really knew why the current processes weren’t working.  So we set up a small exercise solely for this purpose.  Our observations helped us identify the root cause of the problem.  The members of our group, all experienced EOC personnel, had different theories on how to solve the problem.  We went again to exercises, this time a series of small ones.  We ushered some people into the EOC, each time giving them a flow chart and some narrative on what each person should be doing relative to the processes we devised.  The injects flowed and we observed the outcomes.  We saw what worked and what didn’t.  We then assembled an amalgamation of the best traits of each methodology into a new process.  Then guess what we did – we exercised that – and it worked.  Not only did we have a great scientific and structured approach, we also had validation of our final product – one that stood up to further exercises and actual incidents.

Does trial and error take time?  Sure it does.  Does it always yield results?  Yes – although not always positive ones – but those are still results.  It’s important to remember to collect data on each of our attempts.  Just like an exercise we want to evaluate and document.  Sometimes our ideas turn out to be epic failures, and that’s OK.  Had we not found this out during our trial and error, just like an exercise, it could have been devastating and costly in a real life application.  A severe mistake during an incident can be career ending for you, and life ending for those you are sworn to protect.

The bottom line is that it’s OK to fail – just try to control when and how you fail.  In order to accept that premise, however, we need to let go of the super Type A hero/god/ego thing.  Yes, we can learn from successes, but we learn more from failure, especially with a little root cause analysis.  Sometimes things look great on paper, but unless you actually try them out, you’ll never know.  In your trial and error, also consider different variables which may have influence on the outcomes.  It’s great to plan for a response and practice it on a sunny day, but what about pouring rain, freezing temperatures, or high winds?  How does this impact your plan?  Often we can make assumptions (remember those?), but we’ll never really know unless we try.

Do you buy into this?  Thoughts appreciated.

© 2016 – Timothy Riecker, CEDP

Emergency Preparedness Solutions, LLC – Your Partner in Preparedness