A new level of testing?

Yesterday I saw this awesome video of Lars Andersen: a new level of archery. It is going viral on the web being watched over 11 million times within 48 hours. Now watch this movie carefully…

The first time I watched this movie, I was impressed. Having tried archery several times, I know how hard it is to do. Remember Legolas from the Lord of Rings movie? I thought that was “only” a movie and his shooting speed was greatly exaggerated. But it turns out Lars Andersen is faster than Legolas. My colleague Sander send me an email telling me about the movie I just watched saying this was an excellent example of craftsmanship, something we have been discussing earlier this week. So I watched the movie again…

Also read what Lars has to say in the comments on YouTube and make sure you read his press release.

This movie is exemplar for the importance of practice and skills! This movie explains archery in a way a context-driven tester would explain his testing…

0:06 These skills have been long since been forgotten. But master archer Lars Andersen is trying to reinvent was has been lost…

Skills are the backbone of everything being done well. So in testing skills are essential too. I’ll come back to that later on. And the word reinvent triggers me as well. Every tester should reinvent his own testing. Only by going very deep, understand every single bit, practice and practice more, you will truly know how to be an excellent tester.

0:32 This is the best type of shooting and there is nothing beyond it in power or accuracy. Using this technique Larsen set several speed shooting records and he shoots more than twice as fast as his closest competitors…

Excellent testers are faster and better. Last week I heard professor Chris Verhoef speak about skills in IT and he mentioned that he has seen a factor 200 in productivity difference between excellent programmers and bad programmers (he called them “Timber Smurf” or “Knutselsmurf” in Dutch).

0:42 … being able to shoot fast is only one of the benefits of the method

Faster testing! Isn’t that what we are after?

0:55 Surprisingly the quiver turned out to be useless when it comes to moving fast. The back quiver was a Hollywood Myth…

The back quiver is a Hollywood myth. It looks cool and may look handy on first sight, since you can put a lot of arrows in it. Doesn’t this sound like certificates and document-heavy test approaches? The certificates looks good on your resume and the artifacts look convenient to help you structure your testing… But turn out to be worthless when it comes to test fast.

1:03 Why? Because modern archers do not move. They stand still firing at a target board.

I see a parallel here with old school testing: testers had a lot of time to prepare in the waterfall projects. The basic assumption was that target wasn’t moving, so it was like shooting at a target board.  Although the target proved always to be moving, the testing methods are designed for target boards.

1:27 Placing the arrow left around the bow is not good while you are in motion. By placing your hand on the left side, your hand is on the wrong side of the string. So you need several movements before you can actually shoot..

Making a ton of documentation before starting to test is like several movements before you can actually test.

1:35 From studying old pictures of archers, Lars discovered that some historical archers held their arrow on the right side of the bow. This means that the arrow can be fired in one single motion. Both faster and better!

Research and study is what is lacking in testing for many. There is much we can learn from the past, but also from social science, measurement, designing experiments, etc.

1:56 If he wanted to learn to shoot like the master archers of old, he had to unlearn what he had learned…

Learning new stuff, learning how to use heuristics and train real skills, needs testers to unlearn APPLYING techniques.

2:07: When archery was simpler and more natural, exactly like throwing a ball. In essence making archery as simple as possible. It’s harder how to learn to shoot this way, but it gives more options and ultimately it is also more fun.

It is hard to learn and it takes a lot of practice to learn to do stuff in the most efficient en effective way. Context-driven testing sounds difficult, but in essence it makes testing as simple as possible. That means it becomes harder to learn because it removes all the methodical stuff that slows us down. These instrumental approaches trying to put everything in a recipe so it can be applied by people who do not want to practice, make testing slow and ineffective.

2:21 A war archer must have total control over his bow in all situations! He must be able to handle his bow and arrows in a controlled way, under the most varied of circumstances.

Lesson 272 in the book Lessons Learned in Software Testing: “If you can get a black belt in only two weeks, avoid fights”. You have to learn and practice a lot to have total control! That is what we mean by excellent testing: being able to do testing in a controlled way, under the most varied of circumstances. Doesn’t that sound like Rapid Software Testing? RST is the skill of testing any software, any time, under any conditions, such that your work stands up to scrutiny. This is how RST differs from normal software testing.

2:36 … master archers can shoot the bow with both hands. And still hit the target. So he began practicing…

Being able to do the same thing in different ways is a big advantage. Also in testing we should learn to test in as many different ways as possible.

3:15 perhaps more importantly: modern slow archery has led people to believe that war archers only shot at long distances. However, Lars found that they can shoot at any distance. Even up close. This does require the ability to fire fast though.

Modern slow testing has led to believe that professional testers always need test cases. However, some testers found that they could work without heavyweight test documentation and test cases. Even on very complex or critical systems also in a regulated environment. This does require the ability to test fast though.

Lars Andersen: a new level of archery3:34 In the beginning archers probably drew arrows from quivers or belts. But since then they started holding the arrows in the bow hand. And later in the draw hand. Taking it to this third level. That of holding the arrows in the bow hand, requires immense practice and skill and only professional archers, hunters and so on would have had the time for it. … and the only reason Lars is able to do it, is he has been years of practicing intensely.

Practice, practice, practice. And this really makes the difference. I hear people say that context-driven is not for everybody. We have to accept that some testing professional only want to work 9 to 5. This makes me mad!

I think professional excellence can and should be for everyone! And sure you need to put a lot of work in it! Compare it to football (or any other good thing you want to be in like solving crossword puzzles, drawing, chess or … archery). It takes a lot of practice to play football in the Premiership or the Champions League. I am convinced that anyone can be a professional football player. But it doesn’t come easily. It demands a lot of effort in learning, drive (intrinsic motivation, passion), the right mindset and choosing the right mentors/teachers. Talent maybe helps, and perhaps you need some talent to be the very best, like Lionel Messie But dedication, learning and practice will take you a long way. We are professionals! So that subset of testers who do not want to practice and work hard, in football they will soon end up on the bench,  won’t get a new contract and soon disappear to the amateurs.

Lars Andersen: a new level of archery4:06 The hard part is not how to hold the arrows, but learning how to handle them properly. And draw and fire in one single motion not matter what methods is used.

Diversity has been key in context-driven testing for many years. As testers we need to learn how to properly use many different skills, approaches, techniques, heuristics…

4:12 It works in all positions and while in motion…

… so we can use then in all situations even when we are under great pressure, we have to deal with huge complexity, confusion, changes, new insights and half answers. 

5:17 While speed is important, hitting the target is essential.

Fast testing is great, doing the right thing, like hitting the target is essential. Context-driven testers know how to analyze and model their context to determine what the problem is that needs to be solved. Knowing the context is essential to do the right things to discover the status of the product and any threats to its value effectively, so that ultimately our clients can make informed decisions about it. Context analysis and modelling are some of the essential skills for testers!

There are probably more parallels to testing. Please let me know if you see any more.

 

”Many people have accused me of being fake or have theories on how there’s cheating involved. I’ve always found it fascinating how human it is, to want to disbelieve anything that goes against our world view – even when it’s about something as relatively neutral as archery.” (Lars Andersen)

6 Comments

  1. I saw this video and thought about making a blog post about it. Now I don’t have to, because you did (as usual) a very good post! Thank you!

    But you wrote:
    “Practice, practice, practice. And this really makes the difference. I hear people say that context-driven is not for everybody. We have to accept that some testing professional only want to work 9 to 5. This makes me mad!”

    I wrote a long comment about different ways I could disagree with this statement depending on what I read into it. At the end I found a possible interpretation that I could agree being angry with. But instead of guessing could you explain why this makes you angry? I read about a lot of angry testers and am curious if the anger is aimed in the right direction.

    Thank you again for a great post!

    • Hi Göran, I am disappointed with the people who call themselves professionals and do not act as professionals. I wrote about professionals in a earlier post “Heuristics for recognizing professional testers” (http://www.huibschoots.nl/wordpress/?p=1666). The part that makes me mad is that many get away with it. They still have well payed jobs and get hired by managers who aren’t able to recognise professional testers. There is also no “enforcement” by a professional association. This problem is not specific for testing or IT in general. In many other professions I see that happen. Maybe we could learn from how doctors, pilots and other professions (or professional associations) demand that their members do life long learning and commit to ethical and moral standards.

  2. Thnx Huib, you found a great comparison!

  3. Huib,

    I really enjoyed this blog post!

    I also saw this video recently, and was impressed and inspired by it. However, I didn’t delve into it as deeply as you did. But, I’m glad that you did. Thanks!

    Anyway, here are some edited bits of a Skype conversation I had on 1/23 after I saw the video that might complement your blog post:

    [1/23/2015 3:39:59 PM] damian synadinos: How seriously do you take your craft? How much do you study it? Learn it? Practice it?
    [1/23/2015 3:39:59 PM] damian synadinos: https://www.youtube.com/watch?v=BEG-ly9tQGk
    [1/23/2015 3:40:14 PM] damian synadinos: This guy is pretty serious about his craft. I aspire to that level of dedication.
    [1/23/2015 3:41:32 PM] damian synadinos: The archery itself is kinda cool to me. But, I was awed to think about this guy’s dedication to his craft.
    [1/23/2015 3:42:44 PM] damian synadinos: the video also had elements of, as Laurent Bossavit calls it, leprechaun hunting: showing that some things “everyone knows to be true” are actually myths.
    [1/23/2015 3:45:23 PM] damian synadinos: in the video, he debunks things like “archers often carrier quivers on their back”. I relate that to Laurent debunking things like “fixing bugs later is exponentially more expensive”.
    [1/23/2015 3:45:45 PM] damian synadinos: to debunk either, it took a lot of reading, learning, work, effort. and the result probably wasn’t a popular message
    [1/23/2015 3:47:01 PM] damian synadinos: “everyone knows archers carry quivers of arrows on their backs” just like “everyone knows that it costs more to fix a bug later”. wrong and wrong.
    [1/23/2015 3:53:58 PM] damian synadinos: in my opinion, I think debunking myths is an important and noble thing to do

  4. Awesome job, really! And what I could add to this:
    2:36 … master archers can shoot the bow with both hands. And still hit the target. So he began practicing…
    related to testing this reminds me, that being a good testing engineer means you could tackle tasks using manual and automated approaches, instead of labeling yourself as “manual” or “automation” e.g. left or right handed in the archery context.

  5. I find it interesting to draw the parallel to testing. Wouldn’t it be cool, if well performed testing were as well respected as Lars’ level of archery? (Don’t answer, it’s a rhetorical question.) In fact, I assume parallels with other disciplines (other than testing as well. Programming comes to mind. 🙂

    Overall, I see a parallel of modern slow archery to ‘lab testing’. Both are isolated environments with little distraction and not much (if any) movement. I assume you’d be dead pretty fast, if you tried to apply modern slow archery in an ancient time war.

    In a similar way, ‘old school testing’ (how you call it) is not much help when you’re deploying to production a few times per week (or day).

Leave a Reply

Your email address will not be published. Required fields are marked *