As always, hello! Welcome back, if you are returning! Thanks for reading, if this is your first time! I am a little late getting my post done this week Life got in the way, but I guess that is what this is all about...balancing the two!
I was going over some readings this week and I was particularity intrigued with the Gartner presentation on Developing High-Impact EA Performance Metrics. This can be viewed here:
http://www.gartner.com/document/1413013
The presentation touched on why we lose our way when it comes to strategy execution. I have seen this in many forms and if there is one theme about my post this semester it has been that execution is crucial but only achievable with consensus and direction. The article goes on to discuss that EA efforts should be guided by this strategic direction, becoming, essentially, the bridge between strategy and execution. To act as this bridge, we must measure EA performance. This measurement should be through the use of metrics, giving EA and management the ability to track the overall performance of the EA efforts.
I can not agree more. Yet in my experience, this breaks down because most organizations have difficulty defining, building and managing core metrics. I talk about the process a little in my week five post here:
Week 5 Blog Post
I touch on the metric discussion briefly near the end and on utilizing Goal, Question, Metric or GQM.
To restate
Per, Basili, V. , et. al. The Goal Question Metric Approach, GQM is
“A technique that is based on the assumption that for an organization to measure in a purposeful way it must first specify the goals for itself and its projects, then it must trace those goals to the data that are intended to define those goals operationally, and finally provide a framework for interpreting the data with respect to the stated goals.”
http://www.cs.umd.edu/~mvz/handouts/gqm.pdf
In other words, GQM is a hierarchical structure starting with a goal which specifies the purpose of measurement, object to be measured, issue to be measured, and viewpoint from which the measure is taken.
There are three levels to GQM.
Level 1 Conceptual (GOAL) defined for an object from various points of view relative to a particular environment:
- Products: Artifacts, deliverables, and documents that are produced during the system life cycle; e.g. models, components, test suites.
- Processes: Software related activities commonly associated with time; e.g. modeling, designing, testing.
- Resources: Items used by the processes to produce their outputs; e.g. personnel, hardware, software, office space.
Level 2 Operational level (QUESTION) A set of questions used to characterize the way the assessment/achievement of a specific goal is going to be performed based on some characterizing model (the RBM).
These questions try to describe the object of the measurement (product, process, resource) on a selected quality issue and to determine its quality from a selected viewpoint.
Level 3 Quantitative level (METRIC) Data associated with every question to answer it in a quantitative way. The data can be:
- Objective: If they depend only on the object being measured and not on the viewpoint from which it is taken; e.g., number of versions of a document, staff hours spent on a task, size of a component.
- Subjective: If they depend on both the object that is being measured and the viewpoint from which they are taken; e.g., readability of a text, level of user satisfaction.
Here is a depiction of that structure that better represents the hierarchical structure
Now let us look at that in an example. I have tried to use something that can relate to project level work such as change request turn around time. Working from a current state to future state one of the things we identified in a SWOT is the ability to be reactive. As the business changes, so should the processes and improvements the EA efforts are overseeing. Thus, we want to track improvements from the viewpoint of the project manager.
This provides a very measurable approach to the metric that everyone can agree to, measure and report the change over time.
Let me know what you think or if I am off base here. I would like to hear how others have built a consensus in their efforts around performance and tracking EA efforts.
Thanks again for reading!