Showing posts with label education. Show all posts
Showing posts with label education. Show all posts

Wednesday, October 21, 2009

Untouchables revisited



Columnist Tom Friedman, in today's New York Times, in a context when another 100 people are being laid off at the Times newsroom, assesses the qualities of "the untouchables" -- those who will keep their jobs when the others are long gone.

I think he misses the point that the sea of others is going to drown the few in that mental model of how a solution might work. I suggest a better way, one that will sound familiar to my regular readers.

Maybe, we can help each other out, and get by with a lot of help from our friends.
=============================

Ann Arbor, MI
October 21st, 2009
4:14 am

Indeed, "Man must wait on corner long time for roast duck to fly into mouth."

We are, sadly, more crippled by our educational system than we are helped by it, as gurus such as W. Edwards Deming have noted. The reason is not that we don't teach enough stuff, but that we teach "the wrong stuff."

We teach math and science and sometimes English and social studies, but all in a context of intense individual competition, as if we are waiting for very bright individual humans to save us. That "roast duck" isn't coming back. No individual is bright enough to grasp our social problems any more, and even if they could grasp their own and succeed, it has lately been at the expense of all of the rest of us, not as our leader and savior. Wealth isn't what's trickling down.

There is a solution, and it is realizing that people, like computers, are a thousand times more powerful in cooperative networks than as isolated "mainframes" or even "super-computers." All the new research on social intelligence and high-performance teams shows that we are at our best, and a best a thousand times better than our worst, when we are in a high-functioning team.

But that is exactly what "do your own work" trains us out of. We need courses in how to make friends, how to ask for help and get it, how to be a team member, how to be a good or great leader and / or follower, how to build relationships, and WHY we need cohesion and synergy far more than bright Rambo-style individuals.

Done correctly this does not dampen or quench the brightest of us -- it lifts and empowers and supercharges the brightest of us. Teams of people working this way are shown repeatedly to have extraordinarily high performance, quality, and productivity.

That's the corner we need to turn, the new model we need to understand, and respond to. Otherwise, we will turn on each other and collapse, like a shattering glass.

---------

(PS - yes it IS possible to have a work place where, when you get a good idea, other people enthusiastically support you instead of thinking, "Damn, there goes my own raise and job." In fact, that type of socially uplifting context is the only place where really good ideas can be nurtured and evolve and where truly creative problem comprehension and solving occurs.)


Related Posts


Houston, we have another problem.

The importance of social relationships.

DOWNSIDE OF MISMANAGED PSYCHOSOCIAL FACTORS: "Negative Deviance"



UPSIDE OF CORRECT PSYCHOSOCIAL FACTORS: - "Positive Deviance"



OECD and International Student Assessment



Tuesday, October 07, 2008

Now what - contemplating the market crash


You say "Americans deserve to hear much more detail about how the candidates would reform the financial system to prevent another crisis like this one."

I think we desperately need to expand the frame in which "this problem" is perceived. That discussion should precede solutions within that frame.

For one thing, this cannot be isolated to be a "financial system" problem. It involves other economic and social systems, including trust, social decision-making, governance, jobs, social safety nets, education, attitudes towards expertise, sources of blindness in how humans see the world, etc.

They are all tangled. They cannot be solved "separately", or put into a priority order. If there are 200 holes in the bottom of the boat, addressing the "three most important ones" doesn't really cut it. Causes, effects, symptoms, are in tangled feedback loops.

Most of all, I don't think that 200 bright people can "solve" this while the rest of the country and world watches TV, or that it will be solved by voting to pick the best of the two solutions they come up with in some back room somewhere.

A billion people are willing to help. How can that work? THAT's the question we should be addressing.

— Raymond, Detroit



See also:

Failure is perhaps our most taboo subject (link to John Gall Systemantics)

Active strength through emergent synthesis

Why more math and science are not the answer.

OECD PISA - Our education system should teach collaboration not competition

US - Economy of arrogance (and blindness)

Virtue drives the bottom line - secrets of high-reliability systems

High-Relability Organizations and asking for help

Secrets of High-Reliability Organizations (in depth, academic paper)

High-Reliability.org web site

Threat and Error Management - aviation and hospital safety

Failure is perhaps our most taboo subject (link to John Gall Systemantics)

Houston - we have another problem (on complexity and limits of one person's mind)

Institute of Medicine - Crossing the Quality Chasm and microsystems (small group teamwork)

Pathways to Peace - beautiful slides and reflections to music on the value of virtues

You say "No system can be smart enough to survive this level of incompetence and recklessness by the people charged to run it."

T.S. Eliot, writing in the last Great Depression, in "Choruses from 'The Rock'", said it well.

"They constantly try to escape
From the darkness outside and within
By dreaming of systems so perfect that no one will need to be good.
But the man that is shall shadow
The man that pretends to be."

===========================

MIT's John Sterman, in his book "System Dynamics - Systems Thinking and Modeling for a Complex World", describes how poor intuition is at predicting the behavior of "complex adaptive systems."

Books like Gene Franklin's textbook for control system engineering, "Feedback Control of Dynamic Systems" describe the universally applicable conditions for any system of any type to be stable, and I don't see them met or even discussed.

The only thing that seems CLEAR to me is that a whole new feedback loop has been added, responding with almost certainly short-range horizons to events that used to be decoupled and now that will be coupled by that unpredictable response.

We are way past the point where well intentioned humans can follow their "insight" and improve things with that strategy.

I have a number of relevant quotes from Sterman's book on my weblog post on the credit crunch that I made in August, 2007: http://newbricks.blogspot.com/2007/08/credit-crunch-reaches-larger.html and this post I made in January, 2007 on Jay Forrester's Law of Unintended Consequences: http://newbricks.blogspot.com/2007/01/law-of-unintended-consequences.html

At risk of running on, I briefly quote that paper: The classic paper in this field is Jay Forrester's congressional testimony: "The Counterintutive Behavior of Social Systems", http://web.mit.edu/sdg/www/D-4468-2.Counterintuitive.pdf

Quoting the abstract: Society becomes frustrated as repeated attacks on deficiencies in social systems lead only to worse symptoms. Legislation is debated and passed with great hope, but many programs prove to be ineffective. Results are often far short of expectations Because dynamic behavior of social systems is not understood, government programs often cause exactly the reverse of desired results.

==============================
=============

Thursday, December 06, 2007

The "togetherness effect"

Yesterday I commented on the OECD's international student assessment, and I'd like to complete that thought. I believe that there is a solid path to the future from here, but it is not paved with math and science. Supercomputers today are actually super-powerful networks of hundreds of thousands of simple individual computers. That design pattern works. We simply need to use the same design pattern socially.

The power we need to manage our society and overcome our obstacles is already here in the "white space" between us, not in making each one of us some sort of all-wise genius.

So we need to learn how to manage the white space. In computer science, this would be called a distributed "operating system." The term "social capital" is related to this. "Emergence" and "synergy" and "teamwork" are related terms.

"Non-linear" is a related term. What that term is trying to convey is that the sum of two things is often greater than you would expect, and is much larger than what you think you'd get by adding up each thing separately.

One example that used to be familiar to every human, but is much rarer now, is a property of actual fires made of actual wood burning, or at least real charcoal in a grill. When it gets to that stage where the visible flame is mostly out and the coals are red-hot, it has a "non-linear" property. If you lay out these red-hot coals in a long row separated by a hand-width, they will probably die out. If you heap them into a pile, where each is near many others, they will glow brightly and keep going. You can do this experiment and see this for yourself. This is a "real fact." And it is a very important fact to keep in mind.

Or, if you're more scientific, you can look up the references to "cavity radiators", which say the same thing. If you take a piece of metal with a hollow space inside it, and drill a small hole into that cavity, and heat the metal until the outside just starts to glow, you'll see that the small hole you drilled is glowing much more brightly than the outside of the metal.

Here's a link to cavity radiation, also known as "black body radiation". Here's a relevant quote from that link:
"Blackbody radiation" or "cavity radiation" refers to an object or system which absorbs all radiation incident upon it and re-radiates energy which is characteristic of this radiating system only, not dependent upon the type of radiation which is incident upon it.
The brightness is a property of the fact that the hole allows each molecule to "see" many more molecules across it that it would "see" if it were just surrounded by the dozen nearest neighbors it has in a solid form. The brightness arises from this interaction, from this mutual encouragement and stimulation. Well, the math gets way more complicated, but that's the net effect.

It's a property of nature, and it's an important one to be sure you know, and be sure you believe in with unshakable faith. Things together burn more brightly than things separately. The "extra" brightness is a property of the "togetherness", not a property of the things.

In fact, the effect of the "togetherness factor" is so powerful that it really doesn't matter what the things are. In the limit, the nature of the "things" simply drops out of the equations, and the "togetherness" takes on a life of its own.

You can read about this. You can try the experiment with charcoal and verify it. This actually works. You can read about today's supercomputers here. This actually works.

So, now here is the huge emotional and intellectual leap: If this "togetherness factor" effect is so real and powerful, why aren't we using it more to solve our social problems?

As I reflected in my last post, why are we still obsessed with trying to make the "things" super powerful (and experts in math and science), when, in the end, what actually matters is the togetherness effect?

In fact, as W. Edwards Deming was so vocal about, our so-called "educational system" seems designed to destroy the togetherness, instead of to encourage it. Our concept of a "school" is a place where students compete to see whose "thing" is bigger, or better, or smarter, and then we can select those with the "best" thingies and boost them up even more with top honors and praise and scholarships and prizes until they have super-hot-shot-great thingies, even better than the Chinese, you betcha. And then, oh boy, then we'll "win" for sure.

Huh? Researchers in computer science gave up that approach 25 years ago, when they discovered that networks were way easier to build than super-cpu's. IBM's "Blue Gene" architecture has 65,000 dual-chip processors all networked together.

Researchers in Artificial Intelligence gave up the idea 25 years ago when they discovered that networks of very simple "rules" produced more "intelligence", way more easily, than some huge "if-then-else" program that turned out to be impossible to write anyway. I was on a panel on Expert Systems in Anaheim at a conference once, at the table with a team that had just redesigned the aiming program for the Hubble Space Telescope. They had reduced one "supercomplex" program with 50,000 lines of FORTRAN to 210 simple rules, which was 1000 times easier to write, and to maintain, and to debug, and took a lot less room to boot. The rules were things like "If the solar panels are out, don't plan to use stars they block as guide stars."

My expert program scheduled students into rooms for the Cornell Business School, while maximizing odds students could get their desired courses, faculty could sleep late, no one had courses Friday afternoons, the women were evenly distributed in different sections of classes, everyone had a section of something with every other person at least once, groups of 20 students had multiple classes together so you only needed to find one friend to get notes for all the classes you missed, etc. It was still being used 8 years after I left, maybe it's been replaced now. I would have never tried to take on those specs with a classical program written in some language like PL/1 or C or even LISP. Using many simple rules instead of one huge program let me write something 100 times more powerful than I could have otherwise.

I picked the idea of using rules because they are so easy to change and evolve over time. If a rule changes in the real world, or someone realizes a new rule or constraint, you just change that one rule in the system and hit the "run again" button. That's it. No logic diagrams or long nights wondering if every possible case has been thought of.

Not surprisingly, in this context, is the fact that biological genes operate exactly the same way. No single gene does one job -- mostly, they all interact with each other and it's the interaction that does the heavy logic and lifting. So, even God / Nature / biology selected this as the design pattern that made sense to use for the long haul. Since I'm a big believer in patterns that transcend any particular level or scale, and can be reused on other levels and scales, I'd say, if it works for genes and it works for computers then it should work for people - or for sure we should look and see if it does or not. It's a really easy solution to really hard problems and we'd be fools not to check it out near the start of our homework assignment.

This is the trick used to pack a human being into a mere 25,000 protein-encoding genes, which is only 5,000 more genes than a roundworm has. That's because the number 25,000 factorial is way larger than 20,000 factorial. It's not the genes that make us human - it's the interaction between the genes. The "program" is in the "white space" between the genes. When our bodies break, much of the time, as with current parallel processing software, the breakdown is "between the lines" not "on a line of code" -- that is, it's the collaboration that's broken.

Note also that our bodies have no such thing as a "master gene" or a "king gene" or a "Rambo gene" that directs all of the other genes and tells them what to do. Fascinating. The same thing is true of our visual system - we have subsystems that detect edges, or color, or texture, or motion, but there is no "king system" that runs all the subsystems -- the subsystems just kind of keep up a continual dialog with each other about "what do you make of THAT?" and the vision "emerges" from that interaction. This is a very, very, very powerful design pattern.

Ditto for large-scale heaps of legacy systems, such as a major medical center might have. All these fragments have to try to talk to each other successfully, and most of the breakdowns are not "in" a system so much as "between" systems. Again, it's the white-space on the chart of "systems" that is the "system" we need to keep an eye on.

I've been pondering this for some time. See Intelligent Agent Infrastructures For Supporting Collaborative Work (Sen, Durfee, and Schuette, 1995 - Computer Science and Engineering graduate project, EECS Department, University of Michigan)

In radio astronomy we can find other examples. The huge 1000 foot "dish" antenna at Arecibo, Puerto Rico, was great, and I have a spot in my heart for it since my then room-mate at Cornell designed the central antenna, but times more on and arrays of many smaller dishes are more powerful and more flexible and way cheaper to build. It's all the same principle. Many things, working together, can always trump one big thing. Always. Supercomputers. Intelligence. Perception of the universe. Always.

The same thing is true of sports teams, or of any kind of team. The teamwork factor, or what I'm calling the "togetherness effect" can be more powerful than any single superstar. Great coaches look for good players that, above all, are good team-players, not egotistical superstars.

The "Rambo" model is dead, or should be. It fights back and tries to stay alive, tries to keep its grip on our consciousness, tries to keep us mesmerized in believing in it.

I could speculate on the role of male psychology and biology on this historical obsession with whose thing is larger, but the honest to God truth is that size doesn't matter. What matters is the togetherness effect. If we could advance past the 1600's into the 21st century and recognize that, we could solve our social problems instead of being perplexed and baffled as to why even our best schools aren't putting out students with thingies so good that they are solving our problems for us.

I mean, come on, guys. Get over it.

"Group work" should not be some sort of after-thought that is tacked on to our "education" if there is time at the end. Group work, and how to make groups work, should be the focus of our entire educational process. Everything else can be "tacked on" if there is time at the end.

There are physical laws involved here. There is no way to make a single computer chip that is so powerful that you can't do ten times better with a network of much smaller chips. Or 100 times. Or an unlimited factor times. The "up" part is in the interaction, not in the thingie.

We have our educational system entirely backwards. That's what Deming said. I agree.

Pouring our national treasure into trying to generate a few more students with super-fantastic math and science understanding is not the answer. "These are not the droids we're looking for." If we did succeed, say, which could take 30-40 years, and every American could score a perfect score on the SAT exam, it wouldn't solve our social problems. Look at Oxford, as I mentioned yesterday - a community of brilliant scholars and they can barely manage to keep the place operating, if that. We'd succeed in making a bigger one of those. Big deal. Whoopie.

Look, reflect, and learn. This is a curve. The road turns here. The future is not in the same direction we were going, even though it is the same road. The cheese has moved.

I just don't know how to say it more vividly. If you open your eyes it's right there. The answer is right there. We can pull our heads out of the sand of cultural depression about the size of our thingies, and get on with life, and solve our problems, and go explore the stars and find really neat stuff.

Also known as "God has a wonderful plan for your life." Look at the center of the neighboring galaxy, where the interactions are millions of times more powerful than "they should be", and feel the power that is right here, waiting for us to accept. There is hope, after all, for even us.


Photo credits:
M31 (Andromeda) Galaxy, Arecibo and Very Large Array radio telescopes are all from Wikipedia.
Cavity radiator pictures are from the textbook Physics by Halliday & Resnick, 2nd ed.

Wednesday, December 05, 2007

PISA - OECD Programme for International Student Assessment


Comparison of students in the OECD countries was in the news today, with the latest report on science and math among 15-year olds. I want to present a contrary view, that "individual" performance that matters today, now, this decade, has little to do with math and science, and a lot to do with how we interact with and relate to each other. That's where we should be looking.

A typical AP news item is here "Other Countries' Students Surpass the U.S. on Tests" and the actual Programme for International Student Assessment report is here. US scores for reading are not included, since, ironically, the printed test in the US was not proofread adequately and was offset a page, making all the references to "the diagram on the facing page" nonsensical.

The report itself is 350 pages, and even the executive summary is 56 pages long. Results for the US are rather dismal, and you can read those yourself. A few highlights that I thought were interesting related to differences between males and females, which I quote further below.

I object to the entire test, not as being "wrong" so much as being misleading and supporting the efforts to "teach to the test" we see in the US, and certainly here in Michigan.
Local news shows that the areas called "social studies", "civics", group music, literature, history, government, and humanities in general, as well as team sports, are being neglected or eliminated in order to improve school rankings and funding. Ratings of schools in New York City recently have created a hornet's nest of debate over "corrective action" required for "bad schools."

I've thought about these issues most of my life. Early in my life, I taught one year at the high-school level in trade school, 10th-12th grade "problem students" from a tri-county area in upstate New York. I taught MBA's for two years at Cornell's Johnson Graduate School of Management. And I've spent most of my adult life in a large university setting, paying attention to educational issues. At Cornell University, at one point, I was the Director of Institutional Planning and Analysis, and very focused on long-term directions in education. I'm currently involved with work involving "leadership training" and quality improvement among teams and executives.

And, my undergraduate major was Physics, heavy on the Math, with a lot of Computer Science thrown in, at which I did very well, so I'm not speaking as one biased against something I can't do, motivated by "sour grapes."

But I have to say that, after a lifetime watching this issue, I don't believe that an increased focus on "science, math, and reading" is where we need to be focusing our attention.
There are two crucial assumptions behind this focus on science and math in this multi-level world we live in. One assumption, on the individual level, is that a child in the US, say, can get the best future for himself or herself by seeking to become excellent in these areas, and in fact to become competitive with international students for good jobs. The other assumption is that, if many or most students succeeded at this goal, things would be much better for the country as a whole -- economically, on a corporate level, militarily, and in terms of the quality of our health and daily lives.

Both assumptions seem patently false to me. They represent the worst of denial, "tooth-fairy" wishful thinking, and unexamined models of how things work.

Regarding the first assumption, the US is so far in the hole at this point, after years of neglect and unjustified self-confidence, that the odds we can make our students individually competitive in a global marketplace are very low, in my judgment. We have a whole generation, if not two, of teachers in place who don't really understand their own subject areas. We have an ethic and status quo of speaking and reading only one language, and being proud of not doing very well at that.

And, we have a hugely anti-intellectual culture in many places, where students attempting to excel are punished by their peers. In fact, the only thing US students seem to rank highest on, based on research studies, is their self-esteem. In other words, there is a disconnect between how they actually perform and how they think of themselves as performing. At that, the USA seems to excel.

This has been a long time coming, and the resistance to the perception of a problem is deep, despite vivid descriptions of this by educators, industrial leaders like Bill Gates and Ross Perot, etc. In the late 1980's, the B-school at Cornell considered setting up an outreach program in Europe, and did a survey of alums living there to get a sense of what we should be teaching. The answers were uniform and startling. Basically, they were a mix between laughter and scorn that the US management education had anything to offer Europe. We weren't even in the running.

Meanwhile, our graduate schools have been making it in science and engineering only by a huge influx of foreign students, in some cases 70% of the graduate student body, because we couldn't find qualified American students. In the life sciences, the ratio seems more like 90% from walking around and peering into labs, but I don't know the exact numbers. It seems clear that, if China stopped sending graduate students and post-docs, the Life Science mission in Michigan would be essentially gutted.

So, the top 10% of our students might be able to compete in that marketplace, but it's just not clear to me that the other 90% of them will stand much of a chance, in the next decade, of catching up. The odds would shift if we could use the power of television and marketing to market multi-lingual, multi-cultural education, familiarity with the world, and an ethic of hard work and putting off present pleasure to invest in the future benefits. Instead, despite whip-cracking from above and jawboning about a need for education, the country seems to be heading towards increased parochialism and isolationism, rejection of science, rejection of reading, and focusing on instant gratification and distracting "entertainment" as the end-point of life.

This seems to me part of a consistent and predictable pattern of denial of inconvenient truth, combined with a helpless/hopeless syndrome, combined with a startling inability, at every level, to carry on reasoned discussion and reach agreement on "hard issues". As I'm writing this, the Michigan government still hasn't sorted out the budget, due last October 1st. The Federal Government is ten days from either a shutdown, or a bitter "showdown", knock-down, screaming public battle over the budget, also due last October 1st. Social security is probably out of control. Health care costs are clearly out of control.

Oh, and the credit markets and home mortgages are out of control. The US debt passed $9 trillion, almost half of which was incurred during the current administration and is accelerating in the wrong direction, out of control, and for that matter almost entirely out of sight of most citizens who either don't know, don't care, or care but feel helpless to do anything about it. It is unmentioned in the political debates. Whatever is going on in the middle East isn't impressing anyone either.

So, I have to ask, what fraction of that mess would be improved if all the participants were simply better at math and science?

Right. Essentially none of it. We are not dying, as a country, because of a lack of math and science. It is something else entirely.


We are dying, I would suggest, from an inability to work together and to reason together and to make hard choices together.

So, now we get to the second assumption I refer to well above, that if only we had more technology, oh boy, then things would be fine for the country, you betcha.

Not.

I'm not a Luddite. We don't have to return our technology to the store and get a refund since it didn't work as advertised, although that's an interesting thought. This "better life" we citizens were promised seems to be less and less likely. The promise of having world control and dominion through advanced technology and weaponry also seems to be surprisingly distant.

Maybe, it is not true that "technology will save us." Either individually or collectively.

If more of the same results in more of the same, I'd say we're going the wrong direction.

So, before we rush off to focus what's left of our national treasure on a solution to our problems, we need to have a serious look at whether we're addressing the right problem, and, if so, are we doing it with an intervention that has any chance at all of working as designed. We need to be alert to signs of wishful thinking and denial and avoiding hard-choices and painful subjects, or subjects which produce high-emotions and social conflict.

What about the argument that if we just had more math and science, that level of logical thinking would fix everything? I have to look at our centers of academic wisdom, our universities, and ask how good a job they do at dealing with internal conflicts and making hard choices. I am not impressed. They don't make the choice that a world composed almost entirely of highly trained people, who are strong in math and science, seems to be any better than the rest of us at making hard choices and managing its own affairs.

I referred in an earlier post to the University of Oxford, which has been in business for over 1100 years now. If there was any place that highly educated people should have had a chance to sort out these issues, you'd expect to find it there. Yet what I read in their on-line documents is that they have spent years arguing over what e-mail system to use, and cannot reach any resolution on the issue.

Would more math and science knowledge help them out? I doubt it. Do they just "need more time" on the exam? I doubt it.

Frankly, I'd suggest doing this. Take technology off the table entirely. Imagine for a moment, as I have, that the problem is not that we have insufficient math and science and engineering to be able to thrive and prosper and be healthy and happy as individuals and as companies and as a society.

Then, hmm, what is the problem? Where is this process of prosperity-reaching breaking down?

Whether it is a symptom or a root-cause, it's clear that our ability to get together, put our heads together, and come to grips with our own problems is not very good. In fact, it probably deserves a failing grade, based on how well the annual budgets are coming along and how civil and rational the discussion is about selection of the next US president.

So, back to my opinion of this whole PISA - Programme for International Student Assessment.

It appears to me that the mental model of that assessment is that only one level matters of the multi-leveled biological world of life that we live in - and that is the "individual." And even there, I find the conclusions unhelpful.

I think we need to take that level off the table as well, keeping technology off it, and say, yes, but what else is needed to make this baby fly?

Very bright individuals, by themselves, can deal with some issues -- fewer these days than you'd think, after accounting for not only internal roadblocks like depression and unexplained fatigue and ill-health, but for external roadblocks in getting almost anything done - which is like trying to get anywhere on an airplane this holiday season in the short 2-3 hours that you'd think a jet aircraft could deliver.

In fact, that's a perfect example. We have jet aircraft, that can go 550 miles per hour, and cross the country, potentially, in 4 hours. Yet, to travel from Detroit to Miami, say, for Christmas, it would be good to leave, oh, 1-3 days for the trip.

Would it help if we had even faster planes? Nope. We've run out of what we can buy with faster individual planes, and need to look at how the system of many planes, interacting, behaves.

This is exactly what's going on with education. We've run out of what we can by with brighter individuals, and need to look at the system of how many individuals, interacting, behaves.

Pouring our remaining bank-account into making faster planes or brighter individuals have equally likely chances of fixing the problems, which are not at the individual level but at the "system" level.

Now, this is nuanced and subtle. The behavior at the system level is dependent on what sort of internal decision-making and behavior-generating rules individuals use. If you change the nature of the individuals, you will definitely change the nature of the emergent system behavior. All research in complex systems shows that.

So, I come full circle. The "problem" has to do with something "wrong" inside individuals that our educational system should strive to make "right' -- but the something has close to nothing to do with math and science, per se.

Yes, maybe if science advanced another 200 years at the speed it's going, you could get to the root problem that direction, but we don't have 200 years, so that's not very helpful.

We need to leap ahead, pull our heads out of the box, climb a tree, and see where this path goes.

It seems to me that a closer first-approximation to where the "wrongness" is that we need to address is suggested by words like: morality, integrity, honesty, humility, sincerity, trust, compassion, civility. In fact, a really big word is this one: maturity.

As a society, in the US, the term "adult" or "mature" seems to have been hijacked to mean "old enough to buy pornography and alcohol and cigarettes and drive a car and generally behave like an adolescent jerk and not have to listen to anyone anymore or take advice about anything."

What the educational situation highlights instead is that the US students are the world leaders in what could be termed pride, arrogance, self-esteem, or conceit. Which means they are also world leaders in unawareness of reality or denial of same.

Which means they are breaking precisely the key feedback loop required for any adaptive entity to, well, adapt to changed conditions in its environment -- namely, it has to be aware of the gap between where it is and where it should be, and it has to be responding to that awareness.

Of course, awareness of a gap produces internal conflict, that seeks to be resolved. It will, in fact, be resolved, come what may. So, if the gap cannot be closed, then the awareness of it will generally be shut off instead. That seems to be what has happened here. We don't want to be so far behind, we don't like being behind, it doesn't reflect well on our leadership to be behind, we can't deal with being behind, so we will effectively agree to ignore it and act as if it doesn't matter one bit to us. And maybe it will go away.

Not.
Summary so far:

  • Houston, we have a serious problem here.
  • It's not going away.
  • In fact, it seems to be getting worse.
  • Pouring another decade of math and science into it looks unlikely to help, on any level.
  • Technology will not save us this time.
and
  • We are going to have to grow up and learn how to act like adults and work with each other and with hard-choices and sacrificing some short-term desires for long-term needs, and some personal desires for some social requirements of continued existence.
In other words, the "individual" performance that matters today, now, this decade, has little to do with math and science, and a lot to do with how we interact with and relate to each other.

That's what we need to develop metrics and tests for, and that's what we need to go back to the drawing board and figure out how to do, since we obviously don't know it now.

And, incidentally, that's why so much of this weblog is devoted to "religion" and "social feedback".

There are things outside science that we need to get good at, whether science can help us with them or not. If you get past the high-profile single-issue religious zealots, a large fraction of what religious people are trying to tell scientists is the above message.

I care less about whether life was created in 7 days or 7 billion years than I do whether people have some basis on which to grow up and deal with each other that doesn't involve killing the other party as the only imagined "solution." All major religions attempt to provide such a basis.

Scientists say that atheistic philosophy can serve the same purpose, but that's not obviously true based on any society that has thrived based on technology, absent some embedding religion.

The problems we face as a society are not "in the box" or "in the org chart" that science is good at dealing with. They are in the context, the "white space" between boxes, where, historically, science and mathematics have not gone. To be fair, science is increasingly aware that there is something important going on in this "complex adaptive living system" space.

Our solutions involve things like "norms" and the word "should", which are areas, again, that science, trying to fight off a legacy of "proof by intimidation or inquisition" thought it could get away from by being scrupulously "objective" and "distant" .

While there can be a lot of debate about which "norm" is "right", I'd suggest that norms which result in the destruction of all life on the planet, or of our own society, are probably worth re-examining. It would seem to be a wiser choice to select our norms from the set of norms that actually generate a future for us.

That issue can be thought about scientifically, maybe even at some point using mathematics or simulation and animation to gain insight about the implications, downstream, of processes too complex for our finite brains to comprehend.

These advances require focusing attention on how people relate, how they work together, what works and what doesn't, what's worked out how in the past, what works in different cultures and countries, etc. But, those are the humanities, the subjects that "science and math" fixations are driving out of our school systems.

We have to address how we "should" treat each other. It's a hard issue. It's a bootstrap issue, because our inability to face and deal well with conflict and emotion and differing perspectives makes it hard to deal with precisely those issues.

So, it's a feedback loop. We need to spiral it towards better mutual understanding, not away from that. We need to take on pain to do that. And face reality. Both of which we cannot do in a single step, but these have to be approached slowly, hesitantly, but insistently.

I saw a bumper sticker the other day that seems relevant. "I will speak the truth, even if my voice shakes."

The answer is over there, I think.

Swarming All Over


==========
I promised some interesting information from the PISA executive summary, so here it is.
Males and females showed no difference in average science performance in the majority of countries, including 22 of the 30 OECD countries. In 12 countries, females outperformed males, on average, while males outperformed females in 8 countries. Most of these differences were small. In no OECD country was the gender difference larger than 12 points on the science scale.

This is different from reading and mathematics where significant gender differences were observed.

However, similarities in average performance mask certain gender differences: In most countries, females were stronger in identifying scientific issues, while males were stronger at explaining phenomena scientifically. Males performed substantially better than females when answering physics questions.

Reading is the area with the largest gender gaps. In all OECD countries in PISA 2006 , females performed better in reading on average than males. In twelve countries, the gap was at least 50 score points.


Photo credits:
Amish barn raising (Swarming) by heyburn3 (click on it to go there).
Team crossing stream photo credit: Ollieda
Houston Graphic by the author.

Sunday, November 04, 2007

New York City Schools get graded

Today the New York City School systems are getting done to them what all our schools been doing to students - ranking them and assigning grades -- and they don't like it one bit.

I've posted before on how some things, like the "magic dice", have no "best" and cannot be put into some kind of rank-order.

The New York Times today has an article "Schools brace to be graded" that runs into this problem head-on and is producing a great deal of social conflict.

The point is an important one and I want to mention it again. I keep on seeing cases where people, absolutely sure that there must be some way to do this, valiantly try new and more complicated ways to "get it right" and rank something.

It is a dangerous concept and we need to grow up and get over it. It is a damaging concept. The whole idea is one of the pillars of intense competition between people, cultures, and nations and one of the ultimate causes of outright warfare - to be "best", to be "number one" - our people are killing themselves or going into deep depression over a quest that can never possibly be achieved because the idea is meaningless.

First they try one measure, which everyone knows is incomplete. Then they try a variety of different measures, which are also incomplete. Then, that's complex and confusing to have some high and some low scores, and they know nothing about "unity in diversity", so they try everything they can to "combine" all that information into a uniform single number or letter.

So, first they'll compute an average, then maybe a "weighted average", then something like the square root of the sum of the squares, then even more complex calculations that raise up so much dust that no one can figure out what they did, like the New York Schools, probably trying to be more "accurate" or possibly hoping that no one can challenge what they can't understand or explain.

But I challenge it, on fundamental grounds, that have nothing to do with how it was "computed" at all. It doesn't matter how it was computed - something as multidimensional and complex as a person or a school cannot be meaningfully reduced to a single number, period. The whole concept is flawed.

There is a direct analog in physics, which we can be confident is simpler than society and life as a whole. Scientists have a concept called "rank", but it is the nature of the beast that some set of measurements can be reduced to, and that is as far as you can reduce it.

So, yes, a few things can be reduced to "scalars", which are single numbers, like "temperature", that don't depend on context or what the observer is doing at the time.

Most physical things, however are more complex than that. The next more complex thing than a scalar is a "vector", which you may vaguely recall from school - a directed arrow kind of thingie, like "velocity". Velocity is different from speed, in that speed can be reduced to a number, like 85 miles per hour, but velocity includes a direction as well, such as "85 miles per hour heading due North." And, of course, physical things have those pesky "units" or "dimensions" that are somehow attached, so that talking about a number without units doesn't get the answer right.

So, most easy classical mechanics requires these "vectors" to write down the equations at all and solve them. You really can't even begin to solve the problems using just scalars, period.

That, however, is just the beginning of complexity. Scalars are the first of a long series of types of things called "tensors", and an be described with a single number. Vectors are the the next one up, described with "arrows", and cannot be reduced to single numbers, period.

Another example would be the torque you want to apply to something. You can't say you want a torque of "2", and skip the direction part. Clockwise or counter-clockwise? It matters a lot!!
The complex part cannot be left off just to make your math "simpler" or because you never felt like doing the work required to learn how to do the math correctly. It will not "come to you" -- you have to go to it.
Then there are things physicists deal with daily that cannot be reduced to vectors, even. An example is the "electromagnetic field". This field requires the next higher level tensor,. a second-dimensional one, to capture it correctly, which needs a matrix of numbers and rules for how it changes depending on where you stand and how you're looking at it.

If you use that math, it is actually relatively "easy" to describe in equations, and you get the "Maxwell equations", and can correctly figure out what's going on. If you don't use that math, you can't get answers that match reality and should stop trying.

Things get more complex than that fairly quickly. To describe gravity requires a mix of tensors up to a 4-dimensional thingie called the Riemann space-time curvature tensor.

Once you stop kicking and screaming in protest and accept that you have to use complex tensors, not scalars, and figure out how to do that, the equations suddenly get much easier, actually. It's like why scientists use metric not feet and pounds -- not because it's more sophisticated, but because it's easier.

Alfred Einstein stated that "All physical equations are tensor equations." That's it. You can't get away from this, if you believe Einstein.

And, the equation for space-time, in that formalism works out to this:
R= zero
Cool. Once you start putting mass and planets in there, it gets messy fast, but in a way you can manage with just careful bookkeeping. If you use tensors, you can write simple equations, and solve the problems. If you don't use tensors, and try to use scalars, forget it.

So, that's our social dilemma here. The description of people, schools, sports-teams, presidential candidates, etc. all require a level of math that we wish wasn't true, so we just go on pretending that we can say something meaningful without going to all that effort.

And, we end up assigning "grades" to students, then trying to aggregate different "grades" into single overall "grades" (grade point averages), and then trying to make meaningful decisions based on those single composite numbers, like rank students or schools -- and discover that we get absurd results.

Then, we punish those with "low scores" and apply pressure for them to "shape up" or "teach to the test", and have a mess on our hands.

The core problem here is that the physical objects we are trying to study - school systems -- are not intrinsic "scalars" but are probably at least level 3 or higher "tensors".

Actually physicists and mathematicians squabble over exactly what kind of complexity is required and whether it should be "tensors" or something else -- but they all would agree instantly that you can't reduce the world to a set of equations using just "scalars", like grades.

The first question we should have asked is "What is the smallest rank tensor we can use to meaningfully capture the complexity of this thingie?" and it would immediately be clear that scalar numbers ("grades") are too simplistic.

We don't like that answer, so we just go on doing the wrong thing, then we wonder why we have so much conflict, and why some well-loved schools end up getting low grades. Then we set social policy, public policy, and feedback based on those "grades".

Evaluate, yes. Try to reduce to single scores using the axe of some magical computation? NO!

Monday, July 30, 2007

So has everyone simply stopped thinking?


A few recent posts have been about my observation in my class that some students weren't engaged, more than I expected. I was aware that I might be over-generalizing.

But, in the last two weeks, while finishing my last paper and dealing with a hospital stay, I ran across two other authors with similar recent observations - one for undergraduates, and one for medical residents. They both are equally puzzled as to whether they are just noticing this, or whether something real has changed in the just last few years.

Since the early Greeks, at least, every generation seems to feel the next generation isn't really doing very well, so we have to start with some skepticism.

But, for what it's worth, here's a brief summary of two recent books.

My Freshman Year - What a Professor learned by Becoming a Student, is by a cultural anthropology professor (pseudonym Rebekah Nathan) who put it this way:

After more than fifteen years of university teaching, I found that students had become increasingly confusing to me. Why don't undergraduates ever drop by for my office hours unless they are in dire trouble in a course? ... How could some of my students never take a note during my big lecture class? ...

Are students today different? Doesn't it seem like they're .. cheating more? Ruder? Less motivated?... Why is the experience of leading class discussion sometimes like pulling teeth? Why won't my students read the assigned readings so we can have a decent class discussion? [emphasis added].
Here' some excerpts from the book How Doctors Think, by Jerome Groopman, M.D. Dr. Groopman "holds the Dina and Raphael Recanati Chair of Medicine at Harvard Medical School and is chief of experimental medicine at Beth Israel Deaconess Medical Center in Boston. He has published more than 150 scientific articles and is a staff writer at The New Yorker."

The idea for his book came to him, as he describes it, in 2004. He continues:

I follow a Socratic method in the discussion, encouraging the [medical ] students and [medical ] residents to challenge each other, and challenge me, with their ideas. But at the end of rounds on that September morning I found myself feeling disturbed. I was concerned about the lack of give-and-take among the trainees....[they] all too often failed to question cogently or listen carefully or observe keenly.... Something was profoundly wrong with the way they were learning to solve clinical puzzles and care for people. [emphasis added]
He also asks himself if this isn't just the same old intergenerational bias, and concludes:
But on reflection I saw that there were also major flaws in my own medical training. What distinguished my learning from the learning of my young trainees was the nature of the deficiency, the type of flaw.
Dr. Groopman goes on to consider whether this is the fault of efforts to follow preset algorithms, like computers, instead of actually thinking, or on "evidence based" thinking that is linear and algorithmic, and incapable of going outside the box when the situation calls for it.

I have further thoughts, but those will wait for another post. At least I am in good company in thinking that something very important has just changed in our youth.

A good epidemiologist would next wonder how widespread is this? Is this also true in Europe? In Asia? In Africa? Only in North America? In Canada? Is this something we can go back and reanalyze existing data sets and trace an "epidemic curve" on to see when it began and if it has peaked or is still rising? And, of course, if real, is this a change in the students, or a change in the way the older generation perceives students?

And, finally, with the "Where?" and "When?" nailed down, we could look at "Why?" and "How?" and then work our way to "What to do to fix it."


Wade