Bert Sperling
by Bert Sperling
Thu Sep 18th 2008 at 1:18am UTC

Learning Mega-Study: Needs Focus?

Maclean’s magazine contacted me last month to ask for my comments about a recently released mega-study of “lifelong learning.” The subject of the piece was the 2008 Composite Learning Index (CLI), from the Canadian Council on Learning.

Here’s a link to the Maclean’s article, which has some insightful quotes from CCG’s Kevin Stolarick, and some boring ones from me.

The Maclean’s article is a good overview of the ambitious CLI study, but it’s really worth a look in its raw form. Here is the home page for the Composite Learning Index, and the 2008 report itself.

Your time is valuable, so let me just give you my thoughts about the study, having done many similar ones over the last 25 years or so.

  • First, it’s huge in scope - too big, in my opinion, for any valuable insight. By covering so much, it dilutes its results by including sometimes conflicting measures.
  • The study attempts to quantify “learning” in large and small cities and towns across Canada, nearly communities in all. In an apparent effort to value everyone everywhere, all types of learning are included such as use of the Internet; recreation and sports participation; buying and reading printed matter; attending live performing arts; travel time to nearby museums, libraries, and business/civic associations; expenditures on social clubs; attending church; volunteering and socializing with other cultures; as well as the more common measures of high school and university graduation rates and student test scores. These are all valuable metrics, and all worthy of their own study. By mashing them all together into one index, some insights are undoubtedly lost.
  • Many of the metrics are based on estimates of household expenditures for various metrics. I did not find a list of specific sources, but in my experience household expenditure data is based on a national model, and adjusted for each geographic area, usually on the basis of income. It is unlikely that individual differences between communities are revealed, except as a function of income. Rich places spend more, poor places less.
  • Some measure of the quality of the resources should be attempted, not just the proximity to libraries,  schools and universities, museums and art galleries. It’s much different having access to a world-class museum with rotating exhibits, instead of a small-town one-room museum with the usual few bones, muskets, baskets, and pottery (charming though they are.) Use annual attendance figures or budgets to estimate the quality of the experience, or average entrance scores to rank universities.
  • There are four major segments of the study, based on the type of learning – Knowing, Work Experience, Community, and Personal Development. These would best remain segregated. It’s appealing to combine them all into one super-score but, like mixing many colors together, insights are lost.

All in all, the CLI is a wonderfully ambitious attempt to quantify “learning” and provide a road map for the future. But a Swiss Army knife is rarely the best tool for the job, or even any job. By dividing the components of the study into more meaningful sections, better insights may be gained.

Have a look and tell me what you think. Do their rankings fit with your experience?

Best, Bert

4 Responses to “Learning Mega-Study: Needs Focus?”

  1. Elizabeth M Says:

    I completely agree that the quality of the resources should be measured in some way as well. I live outside of D.C. now where the offerings for learning are obviously plentiful and are of a high quality. I have also lived in very small towns where, for that town, the offerings were also plentiful… but of a slightly lower quality. However, much of it is what you do with what you have in front of you. I will say that I was more open and enthusiastic about partaking of cultural activities in the smaller towns merely because their offerings were always convenient to where I lived and you took what you could get when it was offered. Guess I’m a suburb snob now, picking and choosing my cultural outings more carefully… and, as a result, more infrequently.

  2. Bert Sperling Says:

    > more open and enthusiastic about partaking of cultural activities in the smaller towns merely because their offerings were always convenient

    Good point. Sometimes I think we all get paralyzed when we get confronted by overwhelming numbers of choices. If you haven’t already, I suggest checking out “The Paradox of Choice” by Barry Schwartz. There are some good presentations of his on YouTube.

    I like suburbs, in conjunction with the nearby city and metro area of course. You can have a more relaxed lifestyle, while enjoying the resources of the area. The big downside is the cost (time and monetary) of getting to and from the amenities, but at least they are available, and that’s a huge benefit.

    Best, Bert

  3. Dru Frykberg Says:

    Is there something comparable to this that attempts to rank U.S. states based on life-long learning?

  4. Bert Sperling Says:

    Hi Dru,
    No, I know of nothing comparable in the U.S. to rank communities or even states. It would certainly be a great resource.
    Best, Bert