We are embarking on a innovative approach to a social problem and we need a framework to guide the evaluation process. As it is a complex challenge, we’re beginning with a developmental evaluation framework. To begin creating that,I was at work for most of the morning putting together a meta-framework, consisting of questions our core team needs to answer. In Art of Hosting terms, we might call this a harvesting plan.
For me, when working in the space of developmental evaluation, Michael Quinn Patton is the guy whose work guides mine. This morning I used his eight principles to fashion some questions and conversation invitations for our core team. The eight principles are:
- Developmental purpose
- Evaluation rigor
- Utilization focus
- Innovation niche
- Complexity perspective
- Systems thinking
- Co-creation
- Timely feedback
The first four of these are critical and the second four are kind of corollaries to the first and the first two are essential.
I think in the Art of Hosting and Art of Harvesting communities we get the first principle quite well, that participatory initiatives are, by their nature, developmental. They evolve and change and engage emergence. What I don’t see a lot of however is good rigour around the harvesting and evaluation.
All conversations produce data. Hosts and harvesters make decisions and choices about the kind of data to take away from hosted conversations. Worse, we sometimes DON’T make those decisions and then we end up with a mess, and nothing useful or reliable as a result of our work.
I was remembering a poorly facilitated session I once saw where the facilitator asked for brainstormed approaches to a problem. He wrote them in a list on a flip chart. When there were no more ideas, he started at the top and asked people to develop a plan for each one.
The problems with this approach are obvious. Not al ideas are equal, not all are practical. “Solve homlessness” is not on the same scale as “provide clothing bundles.” No one would seriously believe that this is an effective way to make a plan or address an issue.
You have to ask why things matter. When you are collecting data, why are you collecting that data and how are you collecting it? What is it being used for? Is it a reliable data source? What is your theoretical basis for choosing to work with this data versus other kinds of data?
I find that we do not do that enough in the art of hosting community. Harvesting is given very little thought other than “what am I going to do with all these flipcharts?” at which point it is too late. Evaluation (and harvesting) rigour is a design consideration. If you are not rigourous in your data collection and your harvesting methods, others can quite rightly challenge your conclusions. If you cannot show that the data you have collected is coherent with a strategic approach to the problem you are addressing, you shouldn’t be surprised if your initiative sputters.
In my meta-framework the simple questions I am using are:
- What are our data collection methods?
- What is the theoretical basis and coherence for them?
That is enough to begin the conversation. Answering these has a major impact on what we are hosting.
I high recommend Quinn Patton et. al.’s book Developmental Evaluation Exemplars for a grounded set of principles and some cases. Get rigourous.
More from the Kauffman book:
“The wondrous diversity of life out your window evolved in ways that largely could not be foretold. So, too, has the human economy in the past fifty thousand years, as well as human culture and law. They are not only emergent but radically unpredictable. We cannot even prestate the possibilities that may arise, let alone predict the probabilities of their occurrence. This incapacity to foresee has profound implications. In the physicist Murray Gell-Mann’s definition, a “natural law” is a compact description beforehand of the regularities of a process. But if we cannot even prestate the possibilities, then no compact descriptions of these processes beforehand can exist. These phenomena, then, appear to be partially beyond natural law itself. This means something astonishing and powerfully liberating. We live in a universe, biosphere, and human culture that are not only emergent but radically creative. We live in a world whose unfoldings we often cannot prevision, prestate, or predict—a world of explosive creativity on all sides. This is a central part of the new scientific worldview.”
(from “Reinventing the Sacred: A New View of Science, Reason, and Religion” by Stuart A. Kauffman)
I’ve begun Stuart Kauffman’s latest book, which will be a little heavy summer reading, and he states his purpose very clearly in the preface:
“If no natural law suffices to describe the evolution of the biosphere, of technological evolution, of human history, what replaces it? In its place is a wondrous radical creativity without a supernatural Creator. Look out your window at the life teeming about you. All that has been going on is that the sun has been shining on the earth for some 5 billion years. Life is about 3.8 billion years old. The vast tangled bank of life, as Darwin phrased it, arose all on its own. This web of life, the most complex system we know of in the universe, breaks no law of physics, yet is partially lawless, ceaselessly creative. So, too, are human history and human lives. This creativity is stunning, awesome, and worthy of reverence. One view of God is that God is our chosen name for the ceaseless creativity in the natural universe, biosphere, and human cultures. Because of this ceaseless creativity, we typically do not and cannot know what will happen. We live our lives forward, as Kierkegaard said. We live as if we knew, as Nietzsche said. We live our lives forward into mystery, and do so with faith and courage, for that is the mandate of life itself. But the fact that we must live our lives forward into a ceaseless creativity that we cannot fully understand means that reason alone is an insufficient guide to living our lives. Reason, the center of the Enlightenment, is but one of the evolved, fully human means we use to live our lives. Reason itself has finally led us to see the inadequacy of reason. We must therefore reunite our full humanity. We must see ourselves whole, living in a creative world we can never fully know.” (from “Reinventing the Sacred: A New View of Science, Reason, and Religion” by Stuart A. Kauffman)
For most of my carreer I have worked with complex systems. I am not an engineer or a planner. I have taken to calling myself a strategist and a host of strategic conversations. In other words, I use dialogue to help people with processes to make sense of the emergent complexity that they are dealing with. Enough sense that they can make decisions about what to do next.
The problem with complex problems though is this unknowability and unpredictability. This can create a kind of cognitive stress. We like to be in control, and to know what we are doing. Our image of competence is founded not only on our ability to take action in the present but to know what to do in the near future. The truth is of course that we cannot know what to do because the future is possibly surprising on a level of novelty that challenges everything we know. That seems to have been the lesson of 2016, anyway: we never really saw it coming.
Living with this uncertainty can elicit a kind of existential crises, and I speak from experience. One can become depressed and hopeless and despairing that one’s contributions are meaningless. I’m working through those feeling now in my own life and work (and not in any way fishing for validation). It is partly down to having inherited an excellent grounding in a rational world view that I find myself struggling for Kauffman’s imperative: that we must see ourselves whole, living in a creative world that we can never fully know.
I’m curious how many of you struggle with that, and realize that when the scales fall from your eyes, your attachment to reason becomes inadequate to face what life and work is handing to you. Our desire to be in control and competent blocks the surrender we need to fully enter into the promise of this creative and unfolding world. I’m working through it, but the promise of an emerging and ever creating world is a hard one to appreciate when my own mind desires a lock on certainty. How’s it go for you?
Detail from Richard Shorty’s work “Genesis 1:20-25”
Wednesday is National Aboriginal Day and ten days later, Canada commemorates its 150th birthday. Since the centenary in 1967 and even since Canada 125 in 1992, the whole enterprise of Canada has become deeply informed by the need for reconciliation between indigenous people and communities, and settler people and communities.
We are all treaty people. Everyone in Canada who has citizenship is also a beneficiary to the treaties that were signed and made as a way of acknowledging and making binding, the relationship between settler communities and indigenous nations. The ability to own private land, for example, is one way in which settlers benefit from treaties that were signed long ago, even if those treaties were made hundreds of years ago in other parts of the country. Canadian society depends on the ability of governments to provide access to land and resources, and that access flows directly from treaties. Not from conquering and taking. From legally binding agreements. You are a treaty person.
The promise of Canada has never been properly delivered to indigenous communities. Over decades courts have declared this. The Truth and Reconciliation Commission declared this. The Royal Commission on Aboriginal Peoples declared this. It is evident in data and research and popular culture.
The need for reconciliation is long overdue.
For thirty years I have worked in this space, and lately I have been working with a small set of principles, when settlers ask me about reconciliation. Here they are:
- Reconciliation requires restitution. For reconciliation to be real it must be accompanied by restitution. Reconciliation efforts aimed at increasing awareness are fine, but they should have a direct and material benefit to indigenous people and communities, When indigenous communities do well, we all do well. Restitution can happen in all kinds of ways including the return of lands and property, but it also requires the honouring of the ongoing relationships embedded in the treaties in which mutual benefit was supposed to flow for the future.
- Reconciliation is unsettling. My friend Michelle Nahanee talks about “emotional equity” which is one way of thinking about what it costs for indigenous people to interact in non-indigenous contexts. It is inherently unsettling. For non-indigenous people a true commitment to reconciliation means unsettling notions of what you take for granted. Just understanding how you are a treaty beneficiary is one way to suddenly become unsettled. And I have often said that the only job for settlers in reconciliation is to be unsettled. It is from that place that we can all meet and work on a different set of ideas than colonization.
- Settlers need to make the first move. Still with the idea of emotional equity, it is important that settlers make the first move in a reconciliation initiative. Indigenous people cannot be expected to be the ones to make it easy for everyone to do reconciliation. Settlers must make the first moves, and must do so in all the vulnerability and fear that comes from making the first move. Do something, do it badly, be open to learning and keep going.
- Reconciliation is a verb. The right term is “reconciling” because we aren’t ever going to acheive a place wher ethe world is reconciled. It is an ongoing project. If the project of the last 150 years was about creating a Canada where there were once only dozens of nations, perhaps the project of the next 150 years should be about figuring out how to make a country possible that reconciles the interests, duties and obligations of it’s history and privilege with the results of the colonization that enabled that privilege. There is no certain answer, but I have faith that together we can create a place that is better than either of us can do separately.
- Its about relationship. The reason why Canada has to confront the horrible legacy of colonization is that Canadians entered into and then promptly forgot the nature of the relationships that were set in place by the laws and policies of 1763. In that year King George proclaimed that nations west of the Atlantic watershed needed to be dealt with as nations, and according to the rule of law. That proclamation, recognizing the importance of relationship over domination, became the basis for all Aboriginal law in Canada and is still to this day the standard upon which adherence to the rule of law is applied. All Canadians are born or move into a relationship with indigenous people and the relationship is direct, personal and beneficial. Reconciliation needs to restore this sense of mutual dependancy and correct the balance.
I will be hosting conversations on reconciliation at Canada Day commemorations on (Nexwlelexwem) Bowen Island this year with my friend Pauline Le Bel, who is running a series of interesting events this year called “Knowing Our Place” about the relationship of Bowen Islanders to the Skwxwu7mesh Nation and to our At’lkitsem (Howe Sound). If you’re on Bowen, join us. If not, host your own and think about why reconciliation matters to you.
Yesterday I passed through the start line again. Forty nine times I have rode this incredible planet around the sun, corkscrewing together through space. Last night I sat by a small fire with a small glass of whiskey in my hand, friends and family around me and we just hung out, enjoying each other’s company, listening to a little Stephen Fearing and John Wort Hannam and eating fresh strawberries.
The last half dozen years of more have been really illuminating in terms of my own professional life. I have moved from the place of a pure practitioner to a professional who is trying hard to ground practice in theory, and theory that is based in cognitive science, pedagogy and complexity. When you dive into those worlds I think there comes an extended moment of despair or worry that nothing really matters, or nothing makes a difference. I have been there and I am probably still there, but I’m feeling my way into something new, something more existentially rich
Yesterday on a call with friends to discuss an upcoming Art of Hosting in Amsterdam in the fall, I used an image to talk about why I feel like “social innovation” is bit of an inaccurate term to explain what we are doing. I argued that we were learning to live with “social evolution” and that as individuals we have choices about how to deal with the fact that our evolving world demands that we all learn new things. Not learning is not an option. Even those among us that are bed-bound use cell phones and iPads. This was not something they ever imagined in the 1930s when they were teenagers.
So the image is this: when I visit Amsterdam perhaps I will take a vial of water from the Pacific ocean to connect us. I may stand beside a canal or on the shore of the English Channel and drop that small amount of water into the sea. And to the oceans, this act means nothing and is even beyond any practical scope of measurement. But to me, there is a deeper meaning attached to it. It is important. It is interesting. It connect me to my friends, acknowledges a bond. It helps me under the existential questions that come with the beginning of the 50th trip around the sun.
Recently I’ve been accompanying clients who are trying hard to measure the impact they are making in the world. I can’t let them suffer any longer. I have to step in and say “you can’t measure it. Rather, just keep doing it. Do it because it feels right, and it is good, and watch what you are doing and do more of the things that align with your sense of goodness and rightness. We have no idea what the effect is, so be present to your work, be diligent and disciplined. Make it worthy and worthwhile, and worth doing. Succeed or fail, your time on the earth is yours to use as you can. Be present to need, offer what you can, and allow the world to evolve.”
Of course I can go down a strategic and theoretical rabbit hole with this, but none of that should dissuade people from adopting a simple approach to their work, not too precious, not too cavalier. Just enough to give their work and life meaning, and to pursue goodness as you can.
A friend tells me that 49 is a good number. It is seven by seven and in many sacred traditions including my own, that number stands for the countless generations. Each of us is a product is of the 128 pairs of humans that gathered in a virtual circle 150 or 200 years ago, and had a hand in creating six more generations of humans that ultimately culminated in you. No one knew what they were doing. They weren’t trying to give you the gift of life and a scant few decades on this earth. Some of them barely survived long enough to contribute to the project. They didn’t know each other, didn’t even know that the other’s existed. Probably may of them would be disgusted at the thought that they would be participating in project with others of a certain race, culture or religion to create a living human being.
Now is a good time to be humble about what we are doing. Work and live. Help out and get out of the way.