As I started thinking about this, two camps seem to have little overlap when put into practice ... increasing participation versus increasing output. My mind then filled with a few related quotes that drive this issue.
"That which is measured improves. That which is measured and reported improves exponentially." - Karl Pearson
"When performance is measured, performance improves. When performance is measured and reported back, the rate of improvement accelerates." - Thomas S. MonsonRight after my mind caught hold of these quotes, another one slipped in.
"The only rules that really matter are these: what a man can do and what a man can't do." Jack SparrowWhat? The measurement quotes support the topic but the words of a fictional pirate seems out of place and make no mention of measurement.
Maybe I stopped the quote too soon. CAPTAIN Jack Sparrow continues,
"For instance, you can accept that your father was a pirate and a good man or you can't. But pirate is in your blood, boy, so you'll have to square with that some day."
This makes sense if I was talking about accepting that not every tree is full of honorable stories we love to share. There are scoundrels and scallywags as well. There are good people who did scandalous things. But, in pursing the rest of the quote, I feel like I'm on a tangent. How does what Jack say relate to the measurement quotes and the topic of participation versus output?
FamilySearch has hosted several Worldwide indexing events including an indexing event in 2014, a Spanish Indexing Day, and an arbitration drive in May 2015 event with FamilySearch. Many Latter-Day Saints face indexing challenges from their wards and stake.
What do nearly all of these challenges measure? Output. How many names did you arbitrate or index? The challenges rarely measure how many people participated in the event. If the ultimate goal was to index a bunch of names, then mission accomplished. If the goal was to involve more people in indexing, well, there wasn't anything reporting that outcome.
If the goal was is to index a bunch of names, what tends to happen? In a group of 100 people issued a challenge, 1-5% do 90% of the work. 50% or more do nothing. Additionally, to meet the output goal, the projects that will produce the most number of names in the shortest amount of time are targeted. Projects that have fewer names or take longer to process are ignored. It would be interesting to see the mean and median number of names indexed by each person during these challenges, as well as the mean and median difficulty level. I suspect that you would find the median is far below the mean (meaning that a small percentage of people are doing the bulk of the work) and the difficulty level is low for both (meaning that most everyone is trying to do the easy names).
Measuring the output increases the output. Reporting the output in a short amount of time increased the output exponentially. However, these metrics can not measure the difficulty (and perhaps the value) of the names indexed and arbitrated. The index of a birth certificate or marriage certificate with names, spouses, parents, ages, and even dates surely would have more genealogical value than a typed passenger list that lists only a surname and first initial. That does not mean that the passenger list is useless, but by itself it provides few relationship clues and only a single piece of event information (i.e. the person was alive at the time the vessel sailed). No birthdate, no marriage, no family ties. But an indexed passenger list will net the person 40 names in 10 minutes while a batch of birth certificates may only provide 15 names in 10 minutes. So it would appear that these challenges serve to get the least valuable records available first.
I would love to see challenges that give weight and importance to the records that are more difficult to index and arbitrate. I'd like to see challenges that ask folks to index the script rather than the typed items. The typed items are great, but typed documents are a recent invention in the history of record keeping. If we say not everything is online, we must also start saying not everything is typed.
I'd also like to see challenges that invite increased participation. Many hands make light work. And, increasing the number of people who participate may lead to more 'genealogy bug' biting moments. FamilySearch has several billion records with many millions more added each year (its hard to tell since you really don't know how many "records" you have until you index them - some pages may have 0, others may have 20). I have seen estimates that at the current rate these would take anywhere from 30 years to never to index. That sounds like we need a lot more indexers. FamilySearch is reporting about 100 - 125 million records indexed each year.
I have witnessed how exciting a challenge focused on increasing participation rather than output can be. Not surprisingly, the overall output was even higher than I expected if we just set an output goal.
Additionally, I like the challenges that focused on steady participation rather than big pushes and the burn out after. I like the idea of A Batch A Week. What would happen if a genealogical society decided to ask all members to index a batch a week? This would be the ultimate 'pay it back' activity for such a group who know the value of the more difficult to read projects. If all members indexed A Batch A Week for a membership year, then they can all do something super fun to celebrate!
What would happen if the family members who 'aren't into genealogy' committed to indexing A Batch A Week in honor of the family genealogist? Then family members could work on the projects that match their skill set. Family genealogist would ADORE the gift as they won't feel alone in the work. It's an intangible measure, but one strongly felt.
I know that many people issuing challenges and measuring the work are good people. I know that we all want more records to be available and searchable online. I do know that if we take a look at the participation versus output debate, perhaps a mixture of both will be a better overall benefit than focusing only on one aspect of the issue.
I'm still struggling to wrap my thoughts around this issue. I would love to discuss this topic and see things from a variety of angles. If you wish, feel free to post a comment below. You can also send me a message through my Patient Genealogist Facebook page.