Among the dozens of reasons causing projects to collapse (Young, 2021), few project practitioners speak of methodology. That is, the triple constraints of scope, time, cost, combined with quality, dominate the popular mainstream discourse concerning why projects fail. Few mention methodology. This is a mistake. This article points out the importance of getting it right when deciding between agile and waterfall as an approach to project management and execution. Moreover, this paper not only compares and contrasts these two most common project management methodologies used globally (in part 1), but goes further to argue that choosing the wrong methodology can lead directly to project failure (in part 2).
Research question: Can selecting the wrong methodology cause a project to fail?
Waterfall is a popular methodology used today to manage projects. Another type of methodology is called agile, growing quickly in popularity in recent decades. The thesis of this article asserts that selecting the wrong methodology (either agile or waterfall) is devastating, and can lead to project failure. Note that a third popular global methodology, called PRINCE2, is beyond the scope of this article, and will not be discussed herein.
The waterfall methodology, often referred to as the “traditional“, “predictive“ or “conventional“ approach, is perhaps the oldest manner in which projects are managed. It is a linear approach to executing a project’s deliverables. It is a known as a sequencial lifecycle model (Hamilton, 2021). In other words, waterfall represents a step-by-step system in which the current project phase is dependent upon successful completion of the previous phase; and similarly, the next phase cannot commence until the current phase is finished. With some variation depending upon the organization and the particlular project in question, there are typically 6 stages within a classic waterfall project approach, outlined below:
What is clear is that the waterfall methodology is linear. Each step is a pre-requisite to the subsequent step. See diagram #1 below for an example of the waterfall approach.
Diagram #1: The 6-Step Waterfall Project Lifecycle Model (Young, 2022)
Note: Consider the arrows pointing downward to the next step, representing how water flows or travels in a linear, sequential fashion, as if over a waterfall – hence the “waterfall“ terminology.
Pros and Cons of Waterfall
There is a reason waterfall is the oldest, most used project execution model. It has many advantages project teams enjoy. However, despite its numerous benefits, waterfall is not without its shortcomings. Some of its pros and cons are briefly presented below.
Diagram #2: The 5 Phases of the Waterfall Project Management Lifecycle (Young, 2022)
Note: Notice that full project planning is completed early in the project lifecycle, in step #2.
Diagram #3: Waterfall organization chart (Young, 2022)
Note: The number of resources will vary based on project size and complexity, but the hierarchical nature of the project structure remains the same on all waterfall projects, with the project manager as the de facto project leader. All other team members, like testers, have their defined role and contribution to the project.
To be sure, the waterfall methodology has numerous advantages worthy of consideration when initiating a project, especially the certainty it creates by planning early. Waterfall, however, is not without its shortcomings, requiring project sponsors to carefully consider it and other options when establishing a project. Some of the best known cons of waterfall are discussed below.
To be sure, therefore, the waterfall approach has both advantages and disadvantages. It is an approach not meant for every project, given its inherent, inflexible limitations. As a result, other approaches to project management have emerged in recent decades, offering an alternative to the traditional waterfall methodology. The agile approach is perhaps the most prominent new way of thinking about how projects ought to be managed in the 21st century, and is articulated next.
Seasoned project practitioners have been employing agile techniques for years. Today, due to increased and fierce competition, the rapid pace of technological advancement, along with disruptive startup companies, has put immense pressure on medium to large organizations to get their products to market quicker, adding business and consumer value sooner – just to stay competitive. As the Agile Alliance succinctly states, “More mature organizations are increasingly prone to being highly complex and potentially slow to innovate, and lag behind in delivering new solutions to their customers. These organizations find themselves competing with smaller organizations and startups that are able to rapidly produce products that fit customer needs. This speed of change will continue to drive large organizations to adopt an agile mindset in order to stay competitive and keep their existing market share.“ (Project Management Institute, 2017).
This is where agile was borne – out of the need to respond to a fast-paced, ever changing, uncertain, highly competitive market and business dynamic. Opposite to waterfall, agile is a mindset that values flexibility and speed. Agile approaches were created to explore project feasibility in short cycles and quickly adapt based on evaluation and feedback (Project Management Institute, 2017).
Stated another way, agile is a practice that facilitates continuous iteration of development and testing (Hamilton, December 2021). In agile, the project team works on different phases of the project at the same time, with short-term timeframes. Refer to diagram #4 below for a depiction of agile.
Diagram #4: The Agile Lifecycle (Young, 2022)
Note: In agile, each iteration (known as a sprint and typically lasting 2 – 4 weeks) contains 6 steps, and delivers a specific feature or benefit to the customer quickly. (An example of an immediate, quick feature benefit of a sprint is to develop a longer battery life on a smart phone). It is not until all the features (or requirements) have been successully delivered will an agile project be considered closed. The pros and cons of agile are briefly explored next.
As mentioned, the agile project management methodology is a 21st-century response to a rapidly changing business environment, brought about primarily due to major advances in technology – not the least of which is the revolutionary advent of the Internet. Some of the main advantages of the agile approach are expressed below.
There is little doubt, therefore, that the agile methodology – which values speed, increased customer interaction, and project team collaboration – represents a profound mindset shift from the traditional waterfall approach, which prefers up-front planning of scope, schedule, resources, quality and costs. Unsurprisingly, however, the agile approach is not flawless, and not ideal for all projects in all organizations. As such, the disadvantages of agile are mentioned next.
Diagram 5 below summarizes neatly the pros and cons mentioned above.
Diagram #5: Project Methodology Pros and Cons Matrix (Young, 2022)
AGILE | WATERFALL | |
PROS | Frequent Customer Interaction, Communication and Stakeholder EngagementFaster Development Lifecycle and Delivering of Business BenefitsEmbrace Change & UncertaintyReduces Overall Project RiskImproved Team-Building and Empowerment | Most planning & estimation are done up-frontEarly scope definitionEasier to monitor & controlMeasurements are well-definedClear roles and responsibilities |
CONS | Requires Consistent Customer Involvement & InteractionColocation Not Always PossibleAssumes 100% Team Allocation & DedicationThe Timebox Approach Not Always SuitableAssumes a High Performing, Self-Managed Team | Inflexible StructurePoor Management of UncertaintyLow Customer and Stakeholder EngagementMight Not Be Suitable for Large, Complex ProjectsInfrequent & Deferred TestingScope Creep |
To be sure, there is no one perfect way or methodology to manage a project successfully. Both agile and waterfall have benefits and pitfalls. Thus, it is the responsibility of the project team, in conjunction with the project sponsor and other key stakeholders, to design an execution strategy that works for them based on the organization‘s structure and culture. In part 2 next, it is shown how selecting the wrong project methodology can spell disaster for achieving successful project results, up to and including project failure.
Undoubtedly, projects fail for many reasons, from poor communication and bad cost estimating, to weak monitoring, or insufficient testing and quality control during the execution phase of the project (Young, 2021). But among the very first important decisions the project team must make, in collaboration with the project sponsors and key stakeholders, is which project methodology (agile or waterfall) to choose that is expected to drive the project to successful completion and benefits realization. If the project team and its leadership get this crucial early decision wrong, the project is destined for troubled times ahead, often leading to complete failure.
To appreciate how critical the project methodology decision is in respect of setting up the project team for success, consider the emergency room triage nurse analogy. That is, upon entering a hospital‘s emergency room, the patient immediately is referred to a triage nurse. Among other things, a primary responsibility of the triage nurse at this very early stage of patient care is accurate assessment and preliminary diagnosis of the illness or condition of the patient. Accordingly, the triage nurse performs an evaluation of the patient’s condition and vital signs in order to determine, not only the urgency and severity of the condition, but just as important is the direction or next steps towards treatment. If the evaluation suggests, for example, a heart issue, the patient is directed to the cardiology department for care. Similarly, if the problem is a bone bruise or contusion, the patient is referred to the fracture clinic for repair, and so on. Thus, before any remediation can occur, it is vital that the triage nurse accurately assess the ailment and refers the patient for the appropriate care and treatment.
The inverse is also true – but with dire consequences. In other words, failure of the triage nurse to adequately assess the patient’s needs may lead to disastrous implications, including literally life and death. This point cannot be over-emphasized. Imagine a true, real-life scenario whereby a football (soccer) player collapses on the field and is quickly rushed to the hospital emergency room, unable to walk. The triage nurse concludes the injury is minor, only a sprained ankle, and sends the footballer home with an ice pack and Advil medication.
Later, after walking on the sore ankle for two weeks with no relief or improvement and severe pain, the footballer returns to emergency to be re-assessed. This time a different triage nurse concludes that the injury is a torn achilles tendon, requiring emergency surgery to prevent amputation. The emergency room doctor agrees and surgery is performed immediately, saving the leg from amputation.
Thus, the implication of a misdiagnosis in this case is clear. Inadequate triage can lead to terrible future consequences for a patient. Though not literally life and death, the same principle applies to project management. In the very early stages of a project, before planning begins and preferably during the initiation stage, the key project stakeholders and sponsor must decide, or triage, the state (or condition) of the up-coming project and company culture and structure, selecting which methodology is best suited to successfully execute the project.
Here, the leadership must choose between agile and waterfall. Is scope known and unambiguous? Can small, incremental benefits be realized in short bursts? How much time do stakeholders have to support the project team? How technically complex is the project? Is colocation feasible? What is the project’s size? Is there a high degree of uncertainty associated with the requirements and testing? Is this a short-term or long-term initiative? These and other factors must be strongly considered and triaged well in advance of project execution.
Failure to treat a project like an emergency room triage nurse can lead directly to project failure. Consider, for instance, a scenario whereby the project sponsor does not take the necessary time to triage and assess the project in terms of the best execution strategy and simply defaults to a waterfall methodology as it is the most common. As has been demonstrated in this article, agile and waterfall are nearly polar opposite project mindsets. To try to force what ought to be an agile approach into a waterfall project is destined to fail because they are very different. The most obvious example is that agile employs a scrum master while waterfall uses a pure project manager. Hiring a scrum master to execute a complex waterfall project will likely fail.
It is irrefutable that there are numerous reasons projects fail. Poorly defined scope, cost, quality and schedule are commonly seen as project killers and are well documented. What is often neglected, however, as a significant factor contributing to project failure, is incorrect selection of the appropriate project methodology by organizational leaders before the project even starts. But this is just as important as scope or quality control.
This article has shown that agile and waterfall are two leading approaches to project management – both with advantages and shortcomings. But they are very different in their mindset, execution and philosophies and are not suitable for all projects. To select an agile approach for a short-term, low budget, few resources, global project with low complexity and high certainty is inappropriate and counterproductive. Conversely, choosing waterfall for a project where scope, time, cost and quality are constantly changing, along with business requirements, is likely to fail miserably.
Author: Ricardo Young
Agile: A Practical Guide. (Project Management Institute, 2017). Newton Square, PA.
Fair, J. (2012). Agile versus Waterfall: Which Approach is Right? Paper presented at PMI Global Congress 2012, Marsailles, France. Newton Square, PA.
Hamilton, T. (December 11, 2021). Agile vs Waterfall: Know the Difference Between Methodologes. Retrieved Februray 4, 2022 from https://www.guru99.com/waterfall-vs-agile.html
Hoory, L and Bottorff, C. (October 27, 2021). Agile versus Waterfall: Which Project Management Methodology Should I use? Retrieved February 4, 2022 from https://www.forbes.com/advisor/business/agile-vs-waterfall-methodology/
Lees, H. (September 30, 2021). Agile v Waterfall: What is the Difference? Which is Best For You? Retrieved February 4, 2022 from https://www.trustradius.com/buyer-blog/difference-between-agile-vs-waterfall
Lotz, M. (July 5, 2018). Waterfall v Agile: Which is the Right Development Model for Your Project? Retrieved February 4, 2022 from https://www.seguetech.com/waterfall-vs-agile-methodology/
Santos, J. (September 1, 2021). Agile v Waterfall: Differences in Software Development Methodologies. Retrieved February 4, 2022 from https://project-management.com/agile-vs-waterfall/
Terry, J. (n.d.). Agile Methodologies: A Beginner’s Guide. Retrieved February 4, 2022 from https://www.planview.com/resources/guide/agile-methodologies-a-beginners-guide/history-of-agile/#:~:text=It%20all%20started%20in%20the,new%20software%20to%20market%20faster.