,

Trojan Horses are not Trojan Mice. 5 Questions to Spot the Difference.

Trojan Horses and Business Case Option Appraisals. I’ve always had a deep suspicion about the option appraisals you see in business cases. It feels to me like a one of those corporate games that lurk in the shadows. You play by the rules and get the answers YOU want. It might not be the best…

Trojan Horses and Business Case Option Appraisals. I’ve always had a deep suspicion about the option appraisals you see in business cases. It feels to me like a one of those corporate games that lurk in the shadows. You play by the rules and get the answers YOU want. It might not be the best answer for the people on the receiving end of your plans, but you’ve followed the rules. So it doesn’t matter (from an organisational governance point of view), youve followed the rules.

This post is a reflection on how you understand if someone is just playing the game. Have they really looked at multiple options and tested them rigorously? Does the options appraisal reflect that, or is it just a Trojan Horse? Something they have become emotionally attached to. As part of the ‘Review Panel’ you are just playing your part in the game.

So, here are some thoughts on how it applies to the much loved ‘pilot project’ and some questions to ask... let’s begin.

How did the other pilots go? An innocent question to ask anyone talking about their options or ‘pilot project’.

A common response… tumbleweed… silence… nothing but embarrassing silence and the shuffling of feet…

Confirmation that ‘The Game is On’.

Phased Implementation is not a Safe to Fail Pilot. I want to paint this in 6ft high letters somewhere so that; ‘Policy Wonks’, PRINCE2 Practitioners, Think Tank Strategists, and Corporate Policy Leads can see it every day.

Phased implementation of a single big idea, quite often gets disguised as a ‘pilot project’. In reality it is just a Trojan Horse. A sneaky way of introducing a single idea as a method of solving complicated problem. This sort of phased implementation is not a pilot. It is certainly not an experimental ‘safe to fail’ pilot to test different ideas. (Link here to previous posts on ‘safe to fail’ pilots.)

I’ve had a couple of conversations recently about managing risk and learning from failure. These were with people who had seen more than their fair share of public (and private) sector projects over very many years.  We ended up agreeing on the following:

  • A large number of projects are developed on the basis of working towards a single well-defined ‘perfect’ product or outcome,
  • This often doesn’t account for the context of the situation or the fact it is complex;
  • Frequently, as part of the planning stage there will have been very few alternative options considered;
  • Ideas generation is at best restricted to a carefully controlled focus group, or brainstorming session (packed with groupthink);
  • If you are lucky there might have been some ‘stakeholder consultation’;
  • If options have been considered, most of them will be variations on the same theme;
  • There will always be a ‘do nothing’ option thrown in for dramatic effect;
  • Many of these projects claim to have gone through a testing or pilot stage, in reality they haven’t;
  • What this ‘testing’ and ‘piloting’ actually amounts to is phased implementation;
  • The ‘pilot’ phase is actually a Trojan Horse for getting the idea introduced beyond the point of no return;
  • Very few (if any) of these tests and pilots are ever killed off, or substantially changed; and
  • Learning from failure isn’t a phrase you will hear very often (if ever).

Apologies if that sounds a bit sceptical. I just wanted to get across the point that the phased implementation of a single clever idea is not a real pilot exercise.

How to spot a real pilot exercise. If someone starts banging on about their pilot project, be suspicious, in a nice helpful way…

Here are five questions to throw into the conversation. Check for the reaction and listen for the responses. Be prepared to deal with a tumbleweed moment

  1. How did you generate different ideas for your pilots?
  2. How have the other pilots gone?
  3. Did you learn much from the ones that failed?
  4. Do you have anything in place to stop this pilot if it starts to fail?
  5. How will you be sharing the learning from your pilot?

Possibly a bit cruel, but remember; Trojan Horses (single idea, phased implementation) are very different to Trojan Mice (multiple safe to fail experiments run in parallel).

So, what’s the PONT? 

  • Pilots (testing things rigorously) are very different from phased implementation. Trojan Horses are not Trojan Mice.
  • A good pilot exercise is best done with a diverse range of ideas to test.
  • Ask the five simple questions to test if something really is a pilot, and be prepared for the tumbleweed moment.

Picture Source. How did the other pilots go?….  a tumbleweed moment. I particularly like the person leaving the scene in the road sign….

Tumbleweed at a gas station in Chelan, Washington by A.Balet. http://en.wikipedia.org/wiki/File:Tumbleweed_in_Chelan_WA.jpg

Linked Posts:

Trojan Mice – explanation here. http://whatsthepont.com/2013/07/28/continuous-improvement-why-matters-to-squeeze-the-pips-release-trojan-mice-and-win-small/

Agile Project Management link. http://whatsthepont.com/2012/12/02/agile-project-management-and-a-naval-bombardment-in-newport-south-wales/

Safe to Fail Pilots & Dave Snowden link.http://whatsthepont.com/2013/11/04/loving-and-learning-from-failure-great-idea-but-how-does-it-work/

Responses to “Trojan Horses are not Trojan Mice. 5 Questions to Spot the Difference.”

  1. johnbromford

    Sometimes I think you must be hacking into my phone. I’ve been banging on about this for ages. Very few if any pilots that I’ve come across would pass your 5 question test. I think we are just starting to get the hang of sorting the mice from the horses though. We have a number of pilots about to start which are definitely Trojan Mice and very refreshing it is too.

    1. whatsthepont

      Thanks John,
      Promise I’m not hacking your phone.

      The looking at multiple options as a solution to a complicated problem is so often overlooked. I sometimes think that we forget that there is more than one right answer in these situations.
      Why not test a few of them to see which work best.

      I spent 4 hours in the car with my son who is studying product design on Friday night. He told me about how tough the evaluation process is for picking the ideas that move forward into production.
      It sounded pretty brutal, but I do wonder if it is worth bringing some of that product design approach into to world of service delivery?

      Good luck with your Trojan Mice.
      Giving people some freedom and the permission to do things differently and take risks in a safe to fail environment sounds exciting.

      Thanks for the comment
      Chris

  2. Mary Hughes

    There’s the thing about the horse being a massive great fake object too…however beautifully made.

    1. whatsthepont

      Thank you Mary,
      That conveys oh so much meaning…..
      A few words, but I know exactly where you are coming from.
      Keep them coming.
      Chris

      Good to see you today.
      Things much calmer after the 28th.
      See you on the 29th
      Chris

  3. Good Practice Exchange

    Interesting! Your comment about consultation is an interesting one – are they lucky or unlucky if there’s been consultation? Most people’s experience of consultation is so poor that I’m not sure they’d feel that their input would genuinely influence a pilot project (check out this BBC blog from Mark Easton http://www.bbc.co.uk/news/uk-24670413).

    As the public service is in a space where we need to do things differently, we really need to have the public on board. I think effective public engagement would come under one of the ideas in your conclusion – “a good pilot exercise is best done with a diverse range of ideas to test”.

    Great stuff as always!

    – Dyfrig

  4. nosapience

    Of course, question 1 that identities whether or not it’s actually a pilot is: what’s your plan for quickly killing it. It’s not an experiement if you can’t switch it off in an instant with zero casualties. If not, that’s when the Frankenstein breaks free!

    There are five types of change Invention, from Revolution, from adaptation, out of innovation out of old fashioned exploration in places you don’t know finding things you never thought of.

    All five are different and require equally different space! Few people know the origin of the word ‘pilot’ is foot, the bit that the bloke who knew the waters, used to turn the boat! He didn’t build the boat, he know the waters and had a go, so that others could learn the way!

    “Trojan Mice’ is a very silky quote!

  5. nosapience

    Reblogged this on Nosapience's Blog and commented:
    One more from the solid and slighly shiny WHATSTHEPONT … lovely man!

  6. Failure Dynamics

    Hi Chris. Always interesting stuff and just a brief comment from me.

    I think it’s interesting to examine the motivations and status of the ‘ideas person or persons’ in relation to pilot projects. I suspect pilots are often created to prove they will work when scaled up, when they should be created to prove they will fail. If they don’t fail then you obviously have something to work with. Fear of identifying failure is therefore present at the very beginning and so the recognition of it is avoided at all costs.

    It could perhaps be argued then that ego and status are contributory factors in producing fear of failure.

    Give responsibility for developing pilots to the new people, the young people, the outliers 🙂

  7. Trojan Horses are not Trojan Mice. 5 Questions to Spot the Difference | weeklyblogclub

    […] Trojan Horses are not Trojan Mice. 5 Questions to Spot the Difference by Chris Bolton. […]

  8. Trojan horses, writing ghosts, and aiming for the Moon | weeklyblogclub

    […] Bolton tackled exotic creatures rather than exotic places in his post: Trojan Horses are not Trojan Mice. 5 Questions to Spot the Difference. He looked at when pilot projects are not pilot projects. I was surprised to read that there are […]

  9. That Which Does Not Kill Us Makes Us Stronger. Beneficial Accidents and Survivable Failure | What's the PONT

    […] (I prefer the word ‘dampen’) what doesn’t. I have talked about this before in: 5 Differences Between Trojan Horses and Trojan Mice and What’s Eating the Trojan […]

  10. Minimum Viable Transformation: Change should be Small and Imperfect – What's the PONT

    […] As far as I’ve seen the idea of small ‘experiments’, testing multiple ideas, accepting that failures will happen, and a process of learning and iteration rarely feature. The ‘Transformation Programme’ is about certainty and guaranteed success, there can be no room for failure (it’s too big to fail). I’ve touched on this idea before in the comparison of Trojan Mice with Trojan Horses. […]

  11. Trojan Mice and the #DollyChallenge – What's the PONT

    […] Spotting the difference between Trojan Horses and Trojan Mice: https://whatsthepont.blog/2013/11/10/trojan-horses-are-not-trojan-mice-5-questions-to-spot-the-diffe… […]

  12. Trojan Mice in 900 Seconds – What's the PONT

    […] Spotting the difference between Trojan Horses and Trojan Mice:  https://whatsthepont.blog/2013/11/10/trojan-horses-are-not-trojan-mice-5-questions-to-spot-the-diffe… […]

  13. How to Spot the Decoy Effect in Business Case Options Appraisals. – What's the PONT

    […] Ultimately its about having a bit of healthy skepticism and keeping your nose open for the smell of ‘Trojan Horse Poo’. Is someone trying to roll their favourite Trojan Horse past you by deploying the Decoy Effect? Sorry to mention Trojan Horse Poo, but I have written about them and Trojan Mice previously (link he… […]

  14. When do we stop learning from Beneficial Accidents? Tales from the Coal Dust Cresta Run. – What's the PONT

    […] while back I suggested 5 questions (here) you could use to spot Trojan Horses, and more recently something on how to spot people using the Decoy Effect in business case options […]

  15. Rip up your Culture Change Road Map and learn to use a Compass – What's the PONT

    […] what is possible. Sometimes the ‘probes’ are called Trojan Mice explained here in; Trojan Horses are not Trojan Mice. 5 Questions to Spot the Difference. Above all do things together, with the people affected by the change. A co-productive […]

  16. Tolerated failure implants learning better than success. – What's the PONT

    […] My suggestion. Make it mandatory for every business case options appraisal to detail all the failures that happened as part of developing the favoured options. A proper detailed list of what went wrong and what was learnt. Guess what, I’ve written the questions to ask here in; How to spot the difference between a Trojan Horse and Trojan Mice. […]

Leave a comment