Methods might not improve designs, but are still useful for design professionals

Methods are a core topic in UX design. The human centered design cycle, Design Thinking steps or other variants that suggest how to structure one’s design activities. Not designing methodically is framed as wrong and as missing out on valuable insights 8. However, it is unclear if formally structured methods improve the design outcomes itself as created by designing per se.

Designing per se happens, whenever the designer acts directly on the designs (plans, prototypes, files) to develop and improve these designs. This takes the largest part in the education of designers and it is what defines the professional identity. Design in practice includes also other activities that are part of the designer’s job, but not designing per se, like meetings, calculations and negotiations. These tasks are often seen as necessary evils 1. I argue, that, while design methods might not improve the designing per se, they improve a lot of other activities that are also important to successfully design in practice like being respected by colleagues, negotiating what needs to be done and claiming the definition of “what really matters”.

That the use of methods might not improve outcome of a design process has been demonstrated. In the empirical studies, designers do not approach design according to plans 10 and act opportunistically 11 12 10, they change the problem they are solving mid-process as they discover new requirements12 and they do switch the frames that they use to make sense of their designs 1314. And all that seems not to lower the quality of design. Some of these practices do actually seem to be necessary for successful designing15.

So if in these studies, design outcome is not improved by adhering to what a particular method prescribes, why use methods at all? The power of methods is less in telling what people should do to create a good design per se, but in than their social use, that is collaborative sensemaking, their use to claim authority and to enable managerial control in organizations.

Design work is often multidisciplinary. UX designers usually work (directly or indirectly) with developers; product designers need to communicate with engineers. The methods used in the design process can serve as a resource for coordination: Designers and people they work with will use the method to ensure they are on the same side and to ensure that they make sense of the world in a similar way. They will say "We will then enter the implementation phase" or "Let’s get the results of the user research until early November". They might also tell the manager of the developers "We will need to work with a member of your team in February; before we have no scenarios that should be used to write the user stories". This only works if the method is at least somewhat known by the people designer communicates with. If the people know the method and the terms, they can assume standard responses, standard actions, standard sequences. This does not mean that the actual process happens according to what the method prescribes. It is rather that what happens is explained using the method, including instances where people do something that the method does not suggest: “We should have been doing an in-depth analysis, however…”. Indeed, plans can serve as a way to communicate more easily about what is unexpected 17 16.

This collaborative sensemaking can not only be used in friendly coordination. A method also signifies rationality. First on the level of "this is the rational way of doing it" and then by rhetorically alluding to natural science and economics. A method helps to “find” needs and “unlock” potential, it identifies the “right” customers, it suggests to evaluate if the products performance is “really” as it should be. Like that what it alludes to – the “scientific method”– a design method can also be used as a weapon against opinions which can be framed as not in accordance to the method thus rationality: The method is then mentioned and employed to lower the acceptance of other, “non-methodical” ways to proceed: "We should not start without knowing what our users actually want", “You should have checked with quality control, they would have noticed”, “Without data we can not know what users actually do”. This only works if the method is accepted as the way work should be done, but as method ally with rationality, science and economics they have a good standing, usually 2.

Despite all pushes to democratic organizations, performances are measured, people are judged as being productive or not and managers hire and fire 5. Methods can be used to assure that people behave similarly by prescribing what should be done when and in which order. Methods can also assure that these behaviors lead to standardized “deliverables” that allow to see that progress is literally made (or not!): Often, steps in methods prescribe the use of representations of progress like reports, metrics or prototypes. This regime of control and communication is not maintained forcefully 4. The methods and what they enable management to do is part of the environment the work happens in, like the path you walk on and the language you speak.

Now, as a designer one could take offense in what methods are used for and try to escape them. But that would also mean to try to escape the structures that shaped what a designer does and thus also the identity of design itself. Methods and the rationality they bring are not something pushed on designers from the outside, it also is an important way to strengthen the discipline and present it as a profession, a profession that is useful for earning money by fitting into structures of management and promising scalability of its output: A design is created once and that design is used to build products over and over again or to show many many people the website. Designers could show that designing is deeply social, shaped by contingencies and sensemaking. But these are less valuable concepts when power should be maintained and defended.

Notes

  • I noted that invoking methods as a concept itself that people should follow is similar to involking abstract math as described by Jean Lave in “Cognition in Practice”, where she writes that “…arithmetic is used there to justify choice are just the symbolically powerful images of rationality, utility and objectivity”(p158) and “Calculating activity exists, but formal solutions… are more often… used as vehicles for the expression of feelings about rationality, than for its implementation” (p176) (Lave, Jean. Cognition in Practice: Mind, Mathematics and Culture in Everyday Life. Learning in Doing. Cambridge ; New York: Cambridge University Press, 1988.)
  • Laura Yarrow suggests in a tweet that Design Thinking works like a MacGuffin (An object in a story that drives the protagonists but does not do anything itself): “ …it can indirectly help with design maturity and build trusting relationships between design and other teams”.
  • Another method that is irrational, yet might lead to desired results is root cause analysis and 5 Whys, attempts to find out the final cause in an imagined chain of events. Assuming a root cause can prevent recognizing systemic issues and multiple factors; asking “why” can lead to hearing retrospective explainations rather than a retelling of what mattered in the situation (more critiqe: The Infinite Hows (Kitchen Soap blog) ). However, the assumption that there is a root cause can motivate doing an analysis in the first place; assuming that one has found the root cause helps to argue that one needs to fix that assumed cause.

  1. Looking at another job that also deals a lot of with methods, software development, there is a whole culture of despising meetings and the time they take away from “real work”. Meetings, hated or not, though perform crucial tasks in modern organizations 9 

  2. The use of methods as a social defense is described by Wastell in “The fetish of technique: methodology as a social defence”18. The crisis of professions and their relation to the need to be rational is discussed in Schön’s “Reflective Practicioner” 13. Llach’s “Builders of the Vision” discusses the concept of the architect as the person who creates the concept which then is instantiated by diligent builders as described by 13th century polymath Leon Battista Alberti. 

  3. The higher value of abstract creation vs. dealing with real world contingencies shows also in the lack of appreciation of maintainance. Maintainance is slow, context bound, much more like care and attending to than the green field creation so much loved by designers and developers. 

  4. Although not focusing on plans, the use of communication (also) for control is discussed in Yates’ book “Control through Communication” 19: The process of making work adhere to a formal structure is the theme of Agre’s “Formalization as a Social Project” 20. This can also serve to make outcomes trackable, which allows not to manage how people do things but that they do them 21

  5. I do not know sources that deal with the topic of how methods, managment and design are connected. However, computer programming and it’s relationship to methods has sources that tell about this aspect. For example, Ensmenger’s “The Computer Boys Taker over” 22 tells how computer programming was framed and reframed by both programmers and managers in each fractions interests. An important word in this discussion is the “Software Crisis” which was used to justify the need for more formal methods. Fitzgerald: “An examination of the literature reveals a two-fold bias, which, firstly, construes the ‘software crisis’ as a problem arising from the sloppy, ad hoc and irrational approaches of systems developers in practice; and, secondly, views the solution to the software crisis in terms of more widespread adoption of rigorous and formalized systems development methodologies.” 23 

  6. Gedenryd, Henrik. How Designers Work - Making Sense of Authentic Cognitive Activities. Vol. 75. Cognitive Science, 1998. http://lup.lub.lu.se/record/18828

  7. Parnas, D. L., and P. C. Clements. “A Rational Design Process: How and Why to Fake It.” IEEE Transactions on Software Engineering SE-12, no. 2 (February 1986): 251–57. https://doi.org/10.1109/TSE.1986.6312940

  8. Kolko, Jon. “Without Design Methods, I Feel Like I Am Cheating.” Blog, May 18, 2012. http://www.ac4d.com/2012/05/without-design-methods-i-feel-like-i-am-cheating/ 

  9. Schwartzman, H. B. The Meeting: Gatherings In Organizations And Communities. Softcover reprint of the original 1st ed. 1989. Springer, 2013. 

  10. Visser, Willemien. “More or Less Following a Plan during Design: Opportunistic Deviations in Specification.” Int. J. Man-Mach. Stud. 33, no. 3 (1990): 247–78. 

  11. Visser, Willemien. “Organisation of Design Activities: Opportunistic, with Hierarchical Episodes.” Interacting with Computers 6, no. 3 (1994): 239–74. 

  12. Guindon, Raymonde. “Designing the Design Process: Exploiting Opportunistic Thoughts.” Hum.-Comput. Interact. 5, no. 2 (1990): 305–44. 

  13. Schön, Donald A. The Reflective Practitioner: How Professionals Think in Action. New York: Basic Books, 1983. 

  14. Dorst, Kees, and Nigel Cross. “Creativity in the Design Process: Co-Evolution of Problem–Solution.” Design Studies 22, no. 5 (September 2001): 425–37. https://doi.org/10.1016/S0142-694X(01)00009-6

  15. Atman, Cynthia J, Justin R Chimka, Karen M Bursic, and Heather L Nachtmann. “A Comparison of Freshman and Senior Engineering Design Processes.” Design Studies 20, no. 2 (March 1, 1999): 131–52. https://doi.org/10.1016/S0142-694X(98)00031-3

  16. Bardram, Jakob E. “Plans as Situated Action: An Activity Theory Approach to Workflow Systems.” In Proceedings of the Fifth European Conference on Computer Supported Cooperative Work, 17–32. Springer, Dordrecht, 1997. https://doi.org/10.1007/978-94-015-7372-6_2

  17. Rönkkö, Kari, Yvonne Dittrich, and Dave Randall. “When Plans Do Not Work out: How Plans Are Used in Software Development Projects.” Computer Supported Cooperative Work (CSCW) 14, no. 5 (2005): 433–68. 

  18. Wastell, David G. “The Fetish of Technique: Methodology as a Social Defence.” Information Systems Journal 6, no. 1 (1996): 25–40. https://doi.org/10.1046/j.1365-2575.1996.00104.x

  19. Yates, JoAnne. Control through Communication: The Rise of System in American Management. Johns Hopkins paperbacks ed. Studies in Industry and Society 6. Baltimore, Md.: Johns Hopkins Univ. Press, 1993. 

  20. Agre, Philip E. “Formalization as a Social Project.” Quarterly Newsletter of the Laboratory of Comparative Human Cognition 1, no. 14 (1992): 25–27. 

  21. Agre, Philip E. “Surveillance and Capture: Two Models of Privacy.” The Information Society 10, no. 2 (April 1, 1994): 101–27. https://doi.org/10.1080/01972243.1994.9960162

  22. Ensmenger, Nathan L. The Computer Boys Take Over: Computers, Programmers, and the Politics of Technical Expertise. Cambridge, Mass.: MIT Press, 2012. 

  23. Fitzgerald, Brian. “Formalized Systems Development Methodologies: A Critical Perspective.” Information Systems Journal 6, no. 1 (January 1996): 3–23. https://doi.org/10.1046/j.1365-2575.1996.00100.x.