Skip to main content

Test Approach Mnemonic: MICROBE


With TestBash 2017 on the way, I've been reflecting on my journey as a public speaker, since being inspired by the speaker and overall experience of TestBash Brighton 2013. Looking through some older material I discovered 'Testing is Exploratory', delivered at Leeds Testers Gathering, back in 2014. Extolling the virtue of a lightweight and transparent test approach, inspired by my attendance on Rapid Software Testing the previous year...

Here's what I said then:
What is a 'Test Approach'? 
"It is the act of THINKING about the BUSINESS PROBLEM and how TESTING will contribute VALUE using your own BRAIN and that of OTHERS with the outcome of DELIVERY in mind." 
Test Approach Mnemonic:
  • Mission - the primary concern of the testing, your mum should understand.
  • Involving – involve stakeholders, discover their biases, not your own. 
  • Challenges - what questions are we seeking to explore? 
  • Risk - we are in the risk business, so what are the business risks?
  • Observable - show it rather than write it, pictures and spoken words are engaging.
  • Brief – Concise is the real challenge, means choices are required!
  • Epistemic Humility – Have you been humble with your knowledge? Have you allowed challenge and diversity? 
See, Microbe, reminds you to keep it small, see? 

What about now then? I would amend my definition of a 'Test Approach':
"It is the act of CONTINUOUSLY THINKING as information EMERGES about how TESTING can provide ACTIONABLE INSIGHTS using the collective ORACLES around you to DELIVER VALUE to those who matter."

The key additions are the loud notions of 'CONTINUOUSLY', 'EMERGES' and 'ACTIONABLE INSIGHTS' which are inspired by more experience of testing in an agile context. Having been fortunate enough to work on a number of projects and products where the architecture has been allowed, for the most part, to emerge, an adaptive test approach which sharpens with change has been crucial. Creating a great test approach which provides information that was relevant is waste of a high order. In terms of ACTIONABLE INSIGHTS, given we build systems iteratively, timely information from testing can actually be acted upon near the point of discovery. Make it count!

I would also disambiguate 'your own BRAINS and that of OTHERS' to 'ORACLES', as that implies more than just brains, which is a subset of possible oracles. DELIVER VALUE is key addition. Testing, in my view, suffers from the law of diminishing returns, the more you do, the less value you are likely to get. To believe that one's testing can match the infinite variety of the world, is a false position. Delaying delivery is delaying learning.

The actual mnemonic I would change in a few ways too:

  • Mission - the primary concern of the testing, as in there are many concerns, but a choice must be made. After all, we can't test it all.
  • Involving – involve stakeholders, discover their biases, and your own.
  • Challenges - what are the questions that those who matter wish to be answered? What might I need to fulfil the mission that I don't currently have?
  • Risk - we are in the risk business, so what are the business risks?
  • Observable - if you can't observe what you are testing, how effective is your testing? If I can't observe the entity I am testing (via logs for example) how can I remedy that?
  • Brief – Concise is the real challenge, how does one get a breadth of testing lenses so one can sample the product to find important problems?
  • Epistemic Humility – Have you been humble with your knowledge? Have you allowed challenge and diversity?

I still love to set a mission. I like that it feels like a meaningful negotiation. Where shall we focus? What isn't important? Gets to the heart of the matter early I find.

As for the rest, most of the mnemonic has changed apart from two areas, risk and epistemic humility. I still fundamentally believe testing is risk based, and the information exposed by testing should concern those risks to be of value. Extending that knowing that you don't know everything is a something I'm glad I've retained as my career has progressed. Its even more true now. As a proportion, I know a lot less now than I did then.

Always fun to reflect on what you used to think about testing. Try it!

Original slides here:

https://www.slideshare.net/slideshow/embed_code/key/FVzbIPcQoGWFCA

Comments

  1. Thanks for sharing your thoughts with us, loved reading it and going to save these slides for future reference. Keep up the good work

    ReplyDelete

Post a Comment

Popular posts from this blog

Testers Guide to Myths of Unit Testing

One area that testers might be able to enhance their contributions to software development teams is how we perceive and contribute to unit testing. I believe testers busting their own illusions about this aspect of building something good would bring us much closer to developers, and help us realise what other layers of testing can cover most effectively.

Also, I want to do a talk about it, so I figured I would test the premise, see if potential audiences were into it. I put this on Twitter:
Working on a talk about what testers might believe about unit #testing & how we interact with developers creating unit tests. Any challenges/additions for my list below? #development#agilepic.twitter.com/4oT5HE4qs3 — Ash Winter (@northern_tester) December 19, 201730 replies with ideas tends to indicate that people might be into it. 
The ListI thought, as my final blog of 2017, I would provide a super useful list of the myths and legends we as testers might believe about unit testing:
That developer…

Wheel of Testing Part 2 - Content

Thank you Reddit, while attempting to find pictures of the earths core, you surpass yourself.
Turns out Steve Buscemi is the centre of the world.

Anyway. Lets start with something I hold to be true. My testing career is mine to shape, it has many influences but only one driver. No one will do it for me. Organisations that offer a career (or even a vocation) are offering something that is not theirs to give. Too much of their own needs get in the way, plus morphing into a badass question-asker, assumption-challenger, claim-demolisher and illusion-breaker is a bit terrifying for most organisations. Therefore, I hope the wheel is a tool for possibilities not definitive answers, otherwise it would just be another tool trying to provide a path which is yours to define.


In part one, I discussed why I had thought about the wheel of testing in terms of my own motivations for creating it, plus applying the reasoning of a career in testing to it. As in, coming up with a sensible reflection of real…

Getting started with testability

At TestBash Netherlands, I said that, in my experience, a lot of testers don't really get testability. I would feel bad if I didn't follow that up with a starting point for expanding your mindset and explicitly thinking about testability day to day, and making your testing lives better! 

In large scale, high transaction systems testability really is critical, as compared to the vastness and variability of the world, testing done within organisations, before deployment, is limited by comparison. We need ways to see and learn from the systems we test where it matters, in Production.
Being able to observe, control and understand is central to testing effectively, and there are loads of resources and experience reports out there to help. I was/am inspired by James Bach, Seth Eliot, Matt Skelton, Sally Goble, Martin Fowler and a little bit of PerfBytes/Logchat, so lets see if it works for you! 

Overall Model:

Heuristics of Software Testability by James Bach

http://www.satisfice.com/tool…