24
Mn, onr 0 NThe Mechanism of Restructuring ; - Geometry Stellan Ohisson The Learning Research and Development Center. University of Pittsburgh, Pittsburgh, PA 15260 Technical Report No. KUL-90-04 May, 1990 LEARNING RESEARCH AND DEVELOPMENT CENTER _DTIC " ELECTE University of Pittsburgh D1ISTR:BUrON S-7AM T] Arr. ,- 114T nu.; c relowwi 90 07 26 06W

The mechanism of restructuring in geometry

  • Upload
    uic

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Mn, onr

0

NThe Mechanism of Restructuring

; -Geometry

Stellan Ohisson

The Learning Research and Development Center.

University of Pittsburgh, Pittsburgh, PA 15260

Technical Report No. KUL-90-04

May, 1990

LEARNING RESEARCH AND DEVELOPMENT CENTER

_DTIC "ELECTE

University of Pittsburgh

D1ISTR:BUrON S-7AM T]

Arr. ,- 114T nu.; c relowwi 90 07 26 06W

The Mechanism of Restructuring

in Geometry

Stellan Ohisson

The Learning Research and Development Center,

University of Pittsburgh, Pittsburgh, PA 15260

Technical Report No. KUL-90-04

May, 1990

To appear in the Proceedings of the Twelfth Annual Conference of the Cognitive

Science Socie Massachusetts Institute of Technology, Cambridge, Massachusetts,

July 25-28, 1990.

DTI CSE' ,. -'

JUL 3 0 1990!

Preparation of this manuscript was supported, in part, by ONR grant N00014-89-J-1681. Approved for

public release; distribution unlimited. The opinions expressed do not necessarily reflect the positions

of the sponsoring agency, and no endorsement should be inferred. This report is a substantially

rewritten version of an earlier technical report: Ohlsson, S. (1983). Restructuring revisited. Iil.

Re-describing the problem situation as a heuristic in geometric problem solving (Technical Report No.

353). Uppsala, Sweden: Department of Psychology, University of Uppsala.

UNCLASSIFIEDSECURITY CLASSIFICATION OF THIS PAGE

SForm Approved

REPORT DOCUMENTATION PAGE OMBNo 0704-.088

la REPORT SECURITY CLASSIFICATION lb RESTRICTIVE MARKINGS

Uncl assified2a. SECURITY CLASSIFICATION AUTHORITY 3 DISTRIBUTION /AVAILABILITY OF REPORT

Approved for public release;2b. DECLASSIFICATION/ DOWNGRADING SCHEDULE distribution unl imi ted

4. PERFORMING ORGANIZATION REPORT NUMBER(S) S MONITORING ORGANIZATION REPORT "*,,BEP(S)

UP ITT/LRDC/ONR/KUL-90-04

6a. NAM OF PERFORMING ORGANIZATION 6b OFFICE SYMBOL 7a. NAME OF MONITORNG ORGANI'ZAT;O%Learning Research & Developmen" (If applicable) Cognitive Science ProgramCenter, University of Pittsbur h Office of Naval Research (Code 1142CS)6c. ADDRESS (City State, and ZIP Code) 7b ADDRESS (City, State, and ZIP Code)

3939 0'Hara Street 800 North Quincy StreetPittsburgh, PA 15260 Arlington, VA 22217-5000

8a. NAME OF FUNDING/SPONSORING 8b OFFICE SYMBOL 9 PROCUREMENT INS7RUMENT D;_NT FiCAI OJ NUMBERORGANIZATION (If applicable) N00014-89-J-1681

8c. ADDRESS (City, State, and ZIP Code) 10 SOURCE OF FuNDING NUMBERSPROGRAM i PROJECT TASK INORK JNITELEMENT NO NO NO ACCESRS6ION NO61153N RR04206 RR04206-01INR442a-523

11 TITLE (Include Security Classification)

The Mechanism of Restructuring in Geometry

12. PERSONAL AUTHOR(S)

Stellan Ohlsson13a. TYPE OF REPORT 13b TIME COVERED 14 DATE OF REPORT (Year,Month Day) " PAGE CO ,NT

Technical FROM TO May 1990Nh SUPPLEMENTARY. NOTATIOis report is a substantially rewritten version of an earlier technical report:Ohlsson, S. (1983). "Restructuring revisited. III. Re-describing the problem situation"

17 COSATI CODES 18 SUBJECT TERMS (Conlnue on reverse if necessary and identify by block numOer)

FIELD GROUP SUB-GROUP Search; Restructuring; Function; Mechanism; Heuristic;05 02 Operators; Path; Initial state; Goal state; Description

space.19 ABSTRACT (Continue on reverse if necessary and identify by block number)

Restructuring consists of a change in the representation of the current search state, a processwhich breaks an impasse during problem solving by opening up new search paths. A corpus of52 think-aloud protocols from the domain of geometry was scanned for evidence ofrestructuring. The data suggest that restructuring is accomplished by re-parsing the geometricdiagram.

20 0ISTRIBUT!ONiAVA:LAB!LITY CF ABSTRACT 2; ABSTRAC. SECURir€ CLASS, C":- 074

U3UNCLASSIF'EDUNLIMITED 0 SAME AS RPT - DTIC USERS Unclassified22a NAME OF RESPONSIBLE INDIVIDUAL 22J2EL)PH(NE (Inclucje Ae, CcdeI 22( -( '.

Susan M. Chipman (202 696-4318 ONR 1142CSDO Form 1473, JUN 86 Previous editions are obsolete SE_(_.

' R IT - C ' ,L__ ( , -,-

S/N 0102-LF-014-6603 UNCLASSIFIED

O hisson 2 Restructuring in Geometry

Knowledge and Understanding in Human Learning

Knowledge and Understanding in Human Learning (KUL) is an umbrella term for aloosely connected set of activities lead by Stellan Ohisson at the Learning Researchand Development Center, University of Pittsburgh. The aim of KUL is to clarify therole of world knowledge in human thinking, reasoning, and problem solving. Worldknowledge consists of concepts and principles, and contrasts with facts (episodicknowledge) and with cognitive skills (procedural knowledge). The long term goal is toanswer six questions: How can the concepts and principles of particular domains beidentified? How are concepts and principles acquired? How can the acquisition ofconcepts and principles be assessed? How are concepts and principles encoded in themind? How are concepts and principles utilized in performance and learning? Howcan instruction facilitate the acquisition and utilization of concepts and principles (asopposed to episodic or procedural knowledge)? Different methodologies are used toinvestigate these questions: Psychological experiments, protocol studies, computersimulations, historical studies, semantic, logical, and mathematical analyses,instructional intervention studies, and so on. A list of KUL reports appear at the backof this report.

Aeoesslon For

9TI" TAB 0Unranomce! 0

Jut !flcntilcn

o By __ __ __ _

__Distri!,ution/

Avn1l.blltty CodesAv tl rr./;r

Dist Special

May KUL-90-04 1990

Ohisson 3 Restructuring in Geometry

Table of Contents

Abstract 4

Introduction 5

Method 6

Results 7

Case 1: Deliberate restructuring 7

Case 2: Goal-driven restructuring 8

Case 3: Hint-driven restructuring 9

Discussion 10

References 11

List of KUL reports 12

May KUL-90-04 1990

Ohisson 4 Restructuring in Geometry

Abstract

Restructuring consists of a change in the representation of the current searchstate, a process which breaks an impasse during problem solving by opening up newsearch paths. A corpus of 52 think-aloud protocols from the domain of geometry wasscanned for evidence of restructuring. The data suggest that restructuring isaccomplished by re-parsing the geometric diagram.

May KUL-90-04 1990

Ohlsson 5 Restructuring in Geometry

Introduction

A wide variety of problem solving processes have been analyzed in terms ofheuristic search (Newell & Simon, 1972). For example, in geometry proofs thegeometric theorems (operators) are applied to the mental representation of thediagram (the knowledge state) until the desired proposition (the goal state) has beenattained (Anderson, 1981). The stepwise character of heuristic search contrasts withthe Gestalt hypothesis that problem solving proceeds through (a) an initial,unsuccessful, attack on the problem, (b) a more or less protracted impasse, and (c) arestructuring of the problem, which is typically, but not necessarily, followed byinsight (Ohlsson, 1984a).

Several attemptz have been made to reconcile the information processing andGestalt hypotheses. Simon (1966) proposed that it helps to sleep on a problem,because goal tree information is forgotten faster than problem information. After apause, a new goal tree is built on the basis of more knowledge about the problem.Langley and Jones (1988) interpret an impasse as a failure to retrieve the relevantproblem solving operator. Insight occurs when some external stimulus causes enoughactivation to spread to that operator to allow its retrieval. A related hypothesisclaims that insight occurs when an appropriate analogy is retrieved (Keane, 1988).Both the differential rate of forgetting hypothesis and the spread of activationhypothesis require that the problem solver moves attention away from the problem,and so cannot explain insight during ongoing problem solving. Greeno and Berger(1987) have proposed that insights occur when a problem solver breaks an impasse byconstructing new functional knowledge, i. e., new problem solving operators. A newoperator is constructed by inferring that an object can fulfill a particular function, e.g., that a screwdriver can be used to complete an electric circuit. This follows from thefact that the screwdriver is made of metal, in conjunction with the general principlethat metallic objects conduct electricity. Several researchers have proposed thatproblem representations can be improved by the construction of macro-operators(Amarel, 1968; Korf, 1985). Koedinger and Anderson (in press) have proposed therelated idea that geometry experts combine geometric theorems into larger inferenceschemas, called diagram configuration schemas, which allow them to find a proofwithout step-by-step search of the proof space. The macro-operator and diagramconfiguration hypotheses explain expert performance, but they do not explaininsights by novices. All of these hypotheses locate restructuring in the processes ofproblem solving.

In contrast, I have proposed that restructuring involves a change in the mentalrepresentation of the current search state (Ohlsson, 1984b). A change in therepresentation implies that objects, relations, and properties which initially are seenas instances of certain concepts are being re-encoded as instances of other concepts.

May KUL-90-04 1990

Ohisson 6 Restructuring in Geometry

For example, an object which is initially encoded as a hammer might in the course ofproblem solving become re-encoded as a pendulum weight, a line may be re-encodedas a triangle side, and so on. Re-encoding a search state changes the set of operatorswhich are applicable in that state, and thus breaks an impasse by opening up newsearch paths. A similar theory has been proposed by Kaplan and Simon (in press) toexplain restructuring in the Mutilated Checker Board Problem. The critique byMontgomery (1988) does not touch those aspects of the theory that are of mainconcern in this paper. The purpose of the present paper is to provide evidence forre-encoding from the domain of geometry, and to propose a mechanism forre-encoding in that domain.

Table 1. Geometric theorems acquired by the subjects.

Theorem 1. Supplementary angles are congruent.

Theorem 2. Vertical angles are congruent.

Theorem 3. The supplementary angle of a right angle is a right angle.I

Theorem 4. If two angles and their common side in one triangle are congruent to thecorresponding angles and their common side in another triangle, thenthe two triangles are congruent.

Theorem 5. If two sides in a triangle are congruent, then their opposite angles arecongruent; and vice versa.

Method

Three undergraduate psychology students participated in an experimentalcourse in elementary geometry. The experimenter saw each subject individually insessions that lasted approximately one hour each. The subjects learned basictheorems of plane geometry, the first five of which are shown in Table 1. A typicalsession began with free recall of previously learned theorems, continued with theintroduction of new theorems, and ended with problem solving practice. The subjectshad the theorems available during problem solving, and they were instructed tothink aloud. The data consist of 52 think-aloud protocols, representing a total ofapproximately nine hours of problem solving effort.

May KUL-90-04 1990

Ohisson 7 Restructuring in Geometry

Results

The protocols were scanned for the occurrence of restructuring events. Ten suchevents were found. The three most informative events will be analyzed below. Theyillustrate deliberate restructuring, goal driven restructuring, and restructuring inresponse to a hint.

Case 1: Deliberate restructuring. Subject S3 was given the problem in Figure 1after she had studied Theorems 1-5 (see Table 1). She began by proving that trianglesAED and BEC are congruent, and then entered an impasse. In fragments F65-F67

(see Table 2) she deliberately sets out to see the problem from many viewpoints. Theprocess of restructuring proceeds through three steps. First, she mentally cuts thefigure along the diagonal CA, forming the triangles CDA and CBA (F68-F70). Shethen mentally cuts the figure along the other diagonal, forming the triangles DCBand DBA (F71-F74). Finally, she keeps one triangle from each pair, as it were, andsets herself the task of proving them congruent (F75-F77). Figure 2 gives adiagrammatic analysis of the process. The geometric objects perceived by the subjectare drawn in bold lines, while the rest of the diagram is drawn in broken lines.Restructuring was not followed by insight in this case. The subject worked on theproblem for twelve minutes without solving it.

.....................................................................................................................

Table 2. Protocol excerpt from Subject S3.

F65. but perhaps one can see this in some other way alsoF66. one can perhaps see this from many viewpoints hereF67. now we shall seeF68. one can see it asF69. CDA and CBAF70. trianglesF71. one can see it onF72. DCB and DBA insteadF73. yes exactly yesF74. those twoF75. wellF76. now I can see this in another wayF77. CDB and CAD ought to be congruent here in some way

May KUL-90-04 1990

Ohisson 8 Restructuring in Geometry

Case 2: Goal-driven restructuring. S1 was given the problem in Figure 1 as hisfirst problem after studying Theorems 1-5 (see Table 1). S1 misunderstood the goal ofthe problem to be to prove that angle ADC is congruent to angle BCD. When theprotocol excerpt in Table 3 begins, he has proved that angles EDA and ECB arecongruent by proving them corresponding parts of the congruent triangles EDA andECB. He then sets himself the goal of proving that the remaining parts, i. e., anglesEDC and ECD, are equal (F43). His plan is to prove that they are equal by provingthat the sides of the triangle EDC are equal (F42-F45).

Table 3. Protocol excerpt from Subject S1.

F42. yes now I am thinking about whether one can prove that these two sides [DE,EC] are equally longF43. because if they are then those two angles [EDC, ECD] which are just theremaining parts of those angles which I want to get [ADE, BCD] must be equally longF44. so then this and that angle [ADE, BCD] must be equally bigF45. and then the problem is solvedF46. so it is now a question of proving that it is isoscelesF47. that triangle [EDC]F48. and that I cannotF49. but perhaps one can do it in some other way(What are you thinking?)F50. well now I am thinkingF51. well it is the same problemF52. but from another angleF53. yes if this oneF54. is those two lines [ED, EC] are equally longF55. I am thinkingF56. yes but they must beF57. since they are parts ofF58. it is congruentF59. these two here are congruent [triangles EDA, ECB]F60. and it is [ED, EC] corresponding sides in the triangles [EDA, ECB]F61. therefore these two sides [ED, EC] are equally long

This goal is reformulated as proving that the triangle EDC is isosceles (F46-F47).This view of the problem leads to an impasse (F48-F49). Prompted by theexperimenter to continue to think-aloud, he states that he is thinking about the same

May KUL-90-04 1990

OhIsson Restructuring in Geometry

D C C

D G

A B A B

Prove angles ECD and CDE congruent. Prove line segments AG and BD congruent.

Figure 1. Problem 1. Figure 4. Problem 2.

C C

>E lop / E<

A B A B

Figure 5. Analysis of S2's re-encoding process. Perceived geometric figuresare drawn in bold lines, the rest of the figures in broken lines.

OhLsson 9 Restructuring in Geometry

problem but from another angle (F50-F52): he has re-encoded ED and EC as lines(F54). The goal is still to prove them congruent (F53-F55). He suddenly realizes thatED and EC are corresponding sides of the two triangles EDA and ECB, which he hasalready proved congruent (F56-F61). Figure 3 shows a diagrammatic analysis of theprocess with perceived geometric objects in bold lines and the rest of the diagram--thebackground--in broken lines. The subject quickly completed the correct solution.

Case 3: Hint-driven restructuring. S2 attempted Problem 2 (see Figure 4) afterhaving learned the five theorems in Table 1, plus four others. She decided to provetriangles AED and BEG congruent and quickly reached an impasse. The protocolexcerpt in Table 4 begins

Table 4. Protocol excerpt from Subject S2.

(What other triangles could be congruent?)F109. what othersFl10 could there be others which are congruentF1ll. huh(That could be. You have now been working the hypothesis that the whole point is toprove that those two triangles [AED, BEG] are congruent.)F112. yes(And just now you reached the conclusion that you cannot do that with theinformation you have. Can you find two other triangles which one can find which onecould believe could be congruent?)F113. congruent exactly alikeF114. no that is impossible there are no othersF115. it cannot beF116. there are only one otherF117. also hypothetically then this line hereF118. then there are two hereF119. and those two here can surely never be congruentF120. these two here can surely never be congruentF121. no I do not understand thatF122. butF123. now I see itF124. I have forgotten this one here [AGB or BDA]

May KUL-90-04 1990

OhIsson Restructuring in Geometry

% %

% IU

%

% %%%4.

I Ir

a4.a I I

* 0

O hisson 10 Restructuring in Geometry

when the experimenter gives her the hint that there are other pairs of triangles in thefigure that might be congruent. She first rejects this suggestion (F113-F115). Shethen runs through the triangles in the figure (F113-F121), and concludes that thereare no other congruent triangles in the figure (F121). She then suddenly sees thetriangles AEG and BDA (F123-F124). Figure 5 shows a diagrammatic analysis of theprocess with perceived geometric objects drawn in bold lines and the rest of thediagram drawn in broken lines. In spite of this restructuring, the subject failed tosolve the problem.

Discussion

The restructuring process revealed in these three protocol excerpts consists inre-encoding the given figure. The diagram--the set of lines on the paper--containswithin it a large number of different geometric objects (angles, sides, triangles, etc.).Only some of those geometric objects are perceived at any one time. The others recedeinto the background. In particular, if a line configuration is perceived in one way,then alternative encodings of that same line configuration recede into thebackground. Restructuring consists of switching to one of the alternative encodings.How does the switching mechanism work? The data suggest that re-encoding is doneby re-parsing the diagram. During initial problem perception complex objects (e. g.,triangles) are constructed out of simpler objects (e. g., lines). This process is a searchthrough a description space (Ohlsson, 1984b). Alternative interpretations of theperceptual information are possible, so some choices are made, resulting in aparticular encoding of the given diagram. When an impasse forces the problem solverto re-encode the problem, he/she backs up in the description space, dismantles his/herprevious encoding, and traverses another path through the description space. Thisprocess breaks an impasse by allowing other operators (geometric theorems) to applyto the current state. Restructuring is a rare event: There was approximately onerestructuring event per hour of problem solving effort in the present study.Restructuring does not necessarily lead to insight: In two of the three excerptspresented above, the subject failed to solve the problem. This study supports the ideathat diagram parsing is central in geometry (Koedinger & Anderson, in press), butthe validity of the re-parsing mechanism for other domains than geometry remainsan open question. For example, a different mechanism seems to be responsible forre-encoding of the Mutilated Checker Board Problem (Kaplan & Simon, in press).

May KUL-90-04 1990

Ohlsson 11 Restructuring in Geometry

References

Amarel, S. (1968). On representations of problems of reasoning about actions. In D.Michie (Ed.), Machine intelligence. Vol 3. (pp. 131-171). Edinburgh, UK:Edinburgh University Press.

Anderson, J. R. (1981). Tuning of search of the problem space for geometry proofs.Proceedings of the Seventh International Joint Conference on ArtificialIntelligence (pp. 165-170). Vancouver, Canada: University of British Columbia.

Greeno, J. G., & Berger, D. (1987). A model of functional knowledge and insight(Technical Report No. GK-1). Berkeley, CA: University of California.

Kaplan, C. A. & Simon, H. A. (in press). In search of insight. Cognitive Psychology.

Keane, M. (1988). Analogical problem solving. New York, NY: Wiley.

Koedinger, K. R. & Anderson, J. R. (in press). Abstract planning and perceptual

chunks: Elements of expertise in geometry. Cognitive Science.

Korf, R. E. (1985). Learning to solve problems by searching for macro-operators.Marshfield, MA: Pittman.

Langley, P. & Jones, R. (1988). A computational model of scientific insight. In R. J.Sternberg (Ed.), The nature of creativity. Contemporary psychological

perspectives (pp. 177-201). Cambridge, MA: Cambridge University Press.

Montgomery, H. (1988). Mental models and problem solving: Three challenges to a

theory of restructuring and insight. Scandinavian Journal of Psychology, 29,85-94.

Newell, A. & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ:Prentice-Hall.

Ohlsson, S. (1984a). Restructuring revisisted. I. Summary and critique of the Gestalttheory of problem solving. Scandinavian Journal of Psychology, 25, 65-78.

Ohlsson, S. (1984b). Restructuring revisited. II. An information processing theory ofrestructuring and insight. Scandinavian Journal of Psychology, 25, 117-129.

Simon, H. A. (1966). Scientific discovery and the psychology of problem solving. InMind and cosmos: Essays in contemporary science and philosophy. Vol. III. (pp.22-40). Pittsburgh, PA: University of Pittsburgh.

May KUL-90-04 1990

Ohisson 12 Restructuring in Geometry

KUL Reports

1985

Ohlsson, S., & Langley, P. (April, 1985). Psychological evaluation of path hypothesesin cognitive diagnosis (Technical Report No. 1985/2). Pittsburgh, PA: LearningResearch and Development Center, University of Pittsburgh.

1986

Ohlsson, S. (January, 1986). Some principles of intelligent tutoring (Technical ReportNo. 1986/2). Pittsburgh, PA: Learning Research and Development Center,University of Pittsburgh.

Ohlsson, S. (June, 1986). Computer simulation and its impact on educational researchand practice (Technical Report No. 1986/14). Pittsburgh, PA: LearningResearch and Development Center, University of Pittsburgh.

Ohlsson, S. (October, 1986). Sense and reference in the design of interactiveillustrations for rational numbers (Technical Report No. 1986/18). Pittsburgh,PA: Learning Research and Development Center, University of Pittsburgh.

1987

Ohlsson, S. (April, 1987). A semantics for fraction concepts (Technical Report No.KUL-87-01). Pittsburgh, PA: Learning Research and Development Center,University of Pittsburgh.

Ohlsson, S. (September, 1987). Trace analysis and spatial reasoning: An example ofintensive cognitive diagnosis and its implications for testing (Technical ReportNo. KUL-87-02). Pittsburgh, PA: Learning Research and DevelopmentCenter, University of Pittsburgh.

Ohisson, S., Nicholas, S., & Bee, N. (December, 1987). Interactive illustrations forfractions: A progress report (Technical Report No. KUL-87-03). Pittsburgh,PA: Learning Research and Development Center, University of Pittsburgh.

Ohlsson, S., & Rees, E. (December, 1987). Rational learning: Deriving arithmeticprocedures from state constraints (Technical Report No. KUL-87-04).Pittsburgh, PA: Learning Research and Development Center, University ofPittsburgh.

May KUL-90-04 1990

Ohlsson 13 Restructuring in Geometry

1988

Ohlsson, S. (February, 1988). Mathematical meaning and applicational meaning inthe semantics for fractions and related concepts (Technical Report No.KUL-88-01). Pittsburgh, PA: Learning Research and Development Center,University of Pittsburgh.

Ohlsson, S. (March, 1988). Principled understanding of subtraction with regrouping:A mathematical analysis (Technical Report No. KUL-88-02). Pittsburgh, PA:Learning Research and Development Center, University of Pittsburgh.

Ohlsson, S., & Rees, E. (August, 1988). An information processing analysis ofconceptual understanding in the learning of arithmetic procedures (TechnicalReport No. KUL-88-03). Pittsburgh, PA: Learning Research and DevelopmentCenter, University of Pittsburgh.

Ohlsson, S. (December, 1988). Towards intelligent tutoring systems that teachknowledge rather than skills: Five research questions (Technical Report No.KUL-88-04). Pittsburgh, PA: Learning Research and Development Center,University of Pittsburgh.

1989

Ohlsson, S. (January, 1989). Knowledge requirements for teaching: The case offractions (Technical Report No. KUL-89-01). Pittsburgh, PA: LearningResearch and Development Center, University of Pittsburgh.

Ohlsson, S. (April, 1989). Cognitive science and instruction: Why the revolution is nothere (yet) (Technical Report No. KUL-89-02). Pittsburgh, PA: LearningResearch and Development Center, University of Pittsburgh.

Robin, S., & Ohlsson, S. (August, 1989). Impetus than and now: A detailedcomparison between Jean Buridan and a single contemporary subject(Technical Report No. KUL-89-03). Pittsburgh, PA: Learning Research andDevelopment Center, University of Pittsburgh.

Ohlsson, S. (Ed.), (October, 1988). Aspects of cognitive conflict and cognitive change(Technical Report No. KUL-89-04). Pittsburgh, PA: Learning Research andDevelopment Center, University of Pittsburgh.

Leinhardt, G., & Ohlsson, S. (November, 1989). Tutorials on the structure of tutoringfrom teachers (Technical Report No. KUL-89-05). Pittsburgh, PA: LearningResearch and Development Center, University of Pittsburgh.

May KUL-90-04 1990

OhIsson 14 Restructuring in Geometry

Ernst, A., & OhIsson, S. (December, 1989). The cognitive complexity of the regroupingand augmenting algorithms for subtraction: A theoretical analysis (TechnicalReport No. KUL-89-06). Pittsburgh, PA: Learning Research and DevelopmentCenter, University of Pittsburgh.

1990

Ohisson, S., & Rees, E. (January, 1990). Adaptive search through constraintviolations. (Technical Report No. KUL-90-01). Pittsburgh, PA: LearningResearch and Development Center, University of Pittsburgh.

Ohlsson, S., & Hall, N. (February, 1990). The cognitive function of embodiments inmathematics instruction (Technical Report No. KUL-90-02). Pittsburgh, PA:Learning Research and Development Center, University of Pittsburgh.

Ohlsson, S., & Rees, E. (March, 1990). Comparative evaluation of knowledge-basedsimulation models of procedural learning (Technical Report No. KUL-90-03).Pittsburgh, PA: Learning Research and Development Center, University ofPittsburgh.

OhIsson, S. (May, 1990). The mechanism of restructuring in geometry (TechnicalReport No. KUL-90-04). Pittsburgh, PA: Learning Research and DevelopmentCenter, University of Pittsburgh.

May KUL-90-04 1990

Distribution LAt

ML. baa B. Achdle Dr. Meryl S. Baker Dr. Jaime G. CarbonellCode 5530 Navy Personnel R&D Center Computer Science DepartmentNava Reserc Lab San Diego. CA 92152-6800 Carnegie-Mellon UniversityOverlook Drive hdenly PartWashington, DC 20375-5000 proC doutL Brunoi G. Bars Pittsburgh, PA 15213

Units di noices diDr. Edith Ackcrsnn intelligenza artiticisle Dr. Gail CarpenterMedia Laboratory Univeraita di Milano Center for Adaptive SystemEIS-311 20122 Milano - via F. Storms 23 111 Cummington St-. Room 24420 Ames Street IT~ALY Boston UniversityCambridge. MA 02139 Boston. MA 02215

Dr. Jonathan BaronDr. Beth Adelaon 80 Glenn Avenue Dr. John M. CarrollDepartment of Computer Science Berwsyn. PA 19312 IBM Watson Research CenterTufts University Usaer Interface InstituteMedford. MA 02155 Dr. Gauts. Biewas P.O. Box 704

Department of Computer Science Yorktown Heights. NY 10598Technical Document Center Box 168&~ Ststion BAFHRLJLRS-TDC Vanderbilt University Dr. Ruth W. ChabayWrighit-Patterson AFB Nuahrille. TN 37235 CDEC, Hamburg HallOH 45Q4336M Carnegie Mellon University

Dr. John Black Pittaburgh, PA 15213Dr. Robert Ahlera Teaicher College Box 8Code N711 Columbia University Dr. Fred ChangHuman Factors Laboratory 525 West 120th Street Pacific BellN"va Training Systems Center New York, NY 10027 2600 Cammno PrtmonOrlando. Fl 32813 Room 3S-450

Dr. Michael Blackburn San Rain CA 94583Dr. Robert M. Aiken Code 943Cocmputer Science Department Naval Ocean Systems Center Dr. DrAvda Charney

038-24 San Diel, CA 92152-5000 English DepartmentTemple University Penn State UniverstyPhiladelpia.s PA P%=2 Dr. Arthur S. Blaiwea University Part PA 16802

Code N712Mr. Tejaisb S. Anand Naval Training System Center Mrs. Ole ClarkePhilips Laboratories Orlando. FL 32813-7100 818 South George Maon Drive345 Scarborough Road Arlington, VA 22204Briarliff Manor Dr. Deborah A. Boehm-DaviNew York. NY 0520 Department of Psycholog Dr. Norman Cliff

George Mason University Department of PsychologyDr. James Anderson 4400 Universty Drive Univ. Of SO. CaliforniaBrown University Fairfax VA 22030 Los Angeles, CA 0061061Department of PsychologyProvidence, RI 02912 Dr. Sue Bogner Dr. Stanley Collyer

Army Research Institute Office of Na"a TechnologyDr. John R. Andersosn ATTN: PERI-SF code m2Deparmn of PsycloUr 5001 Eisenhower Avenue 800 N. Quincy StreetCarnegie-Mellon University Aimsandria. VA 22333.5%M Arlington, VA 2217-50M0Schenley PartPittsburgh, PA 15213 Dr. Jeff Boner Dr. Jere Confrey

Guidance Technology. Inc. Cornell UniversityDr. Thomas H. Anderson 800 Vinial Stree Dept. of EducationCenter for the Study cW Reading Pitsu~rgh, PA 15212 Room 490 Robeirts174 Children's Reseach Center Ithaca, NY 14853SI Gerry Drive Dr. J. C. BoudreauxC~hampaign. IL 61820 Center for Manufacturing Dr. Lynn A. Cooper

Engineering Department of PsychologyDr. Stephen J. Andiocle, Chairman National Bureau of Standarde Columbia UniversityDepartment of Information System Gaithersburg, MD 2M89 New York, NY 10027

and System. EngineeringGeorge Mason University Dr. Lyle E. Bourne. Jr. Dr. Meredith P. Craweford4400 University Drive Department of Psychology 3563 Hamlet PlaceFairfax. VA 22030 Box 345 Chevy Chase, MD 20815

University of ColoradoPrat John Annett Boulder, CO 80309 Dr. HamS F. CiostbagUniverst of Warwick Faculty, of LawDeparmn of P~molog Dr. Hugh Burns University of LimburgCoventry CV4 7AL Department of English P.O. Box 616ENGLAND University of Tese Maastricht

Amitin. TX 7870 The NETH-ERLANDS 6200 MDEdward AtkinsCode 61Z1210 Dr. Robert Calfee Dr. Kenneth B. CrossNa soo Sm ysteim command School of EducOatio Anaicapa Scieno- Inc.Washington. DC 20362-5101 Stanford University P.O. Drawer 0

Stanford. CA 9430 Santa Barbara, CA 93102Dr. Paticiha BawitSchool of Education Dr. Joseph C. Campioine Dr. Cat7 Caichon610 E. Unosensiy Rn 1302D Center for the Study of Reading Intelligent Instructional SystemsUNamy of Nilieligon University of Illinois Texas Instruments Al LabAnn Arbor. MI 491259 51 Gerry Drive P.O. Box 660246

Champaign. IL 61820 Dallas, TX 75266Dr. James D. BakerDirector of Automation and Research Dr. Joanne Capper. Director Brian DallmanAllen Corporation of Amierca Center for Research into Practice Training Technology. Branch209 Madison Strem 3W4 Albemane Street. NW 340 1THTWT1'GxCAlossndiria. VA 22314 Washington DC 2000 Lowry AMR CO 802-10-5000

liveaity of Plau~0~an05/29t9

Mr. John F. Dealpin Dr. Debra Evans Dr. Cadi F. FrederikseChair. Computer Science Dept. Apiplied Science Associate. Inc. Dept. of Educational PsychologyTowson State Utaveit P.O0. Bon )7 McGill UniversityBaltimore, MD 21204 Butler. PA 00 3700 Meravolh Screw

Montreal. QuebecMargaret Day. LA-ia Dr. Lorrane D. Eyde CANADA H3A 1Y2Applied Sciec Associates Oflice of Personnel ManagemetP.O. Box 1072 Office of Eimminetio Develoipmenit Dr. Jobe ft. Frederiltam,Butler. PA NO00 1900 E St.. NW BBN laboratories

Washington. DC 20415 10 Moulton StreetGoary Delaccote Cambid MA 0223Dirctor de L'inforumatiqiue Dr. Jean-Claude Falmagne

Scienthue it Techniue Irtaie Resarchb Unit in Dr. Norman RedorIkienCNRS Mathemsail A Behavioral Sciences Educational Teting Service1S, Quo Anatole France, University Of CalOifoni (05-R)75700 Paris FRANCE Irvine, CA 9277 Princton. NJ 08541

Dr. Denise Delaerom Dr. Beatrice J. Faur Department of Humanitins andPaycholoff Deparmn Army Research Instite social SciencesBM a . Yale Station PERI-IC Harvey Mudd CollegeYale Uiveray 5001 Eisenhomvr Avenue Claremont. CA 91711New Kavem CF 06520-7447 Alemindria, VA 2233

Dr A"fe R. Fre*yDr. Slairon Dorm Dr. MarshailJ. Parr, Consultant APOSRJNl Bldg. 410Flori" sumt Univeraity Cognitive a Instructional Sciencea Boiling AFB. DC 20332-6448Deparmn of Paycholog 2520 North Vernon StreetTallahassee, FL 32306 Arlington. VA Z127 Dr. Afitida Friedman

Deparmn of PaycholovDr. Thomas 2. DeZern Dr. P-A. Federico Univerasity of AlbertaProeat Engineer. Al code 51 Edmonton. AlbertaGeneral Dynamics NPRDC CANADA T6G 2E9PO Box 74&(Mail Zone 2646 San Diego, CA 92152-610Fort Worth. TX 76101 Dr. Michel Friendly

Dr. Jerome A. Feldman Psychology DeparmnDr. Ronm Dillon University of Rocheater Yorit UniverasityDepartment of Guiduto and Computer Science Department Toronto ONT

Educational Psychologr Rochester, NY 14627 CANADA M3J 11 3Southern Illinois UniveraityCarbondale, IL 62901 Dr. Pad Feltneich Col. Dr. Ernst Frue

Southern Illinois University --er --pey --logu--e DienetDr. J. Stur Dom, School of Medicine Mar.s Tereamen-KaserneFaculty of Education Medical Education Depat'tment 1130 WienUnAsmisy of British Columbia PROL Box 3926 AUSTIRIA21±1 Main Mall Sprianhedd. IL 6270Vancouver. BC CANADA WI' 1Z5 Dr. Robert M. Gagne

Dr. Elizabeth Fennem 1456 Mitchell AvenueDefense Technical Curriculum andl Instuuction Tallahassee, FL 32303

Information Center Univeraqt of WaconsinCameron Station. Bldg 5 225 North Milk Stree Dr. C. Lee GilesAlexandria, VA 22314 Madeon. WI 53706 AFOSR/NE. Bldg. 410(2 COPie) Boiling AF8

CAPT J. Fmnelli Wasington. DC 20332Dr. Pioen Duguet Commanidant (G.PTE)Organiatio for Economic US. Coast Guard Dr. Pbilip Gills

Cooperto andl Developmen 2100) Second St.. SW. ARI.Fort Gordon2rue Andre.Pail Waehington. DC 20593 ATTN: PERI.ICD

75016 PARIS Fort Gordon. GA 30905FRANCE Prod. Donald Fagitzead

Univeraity of Now England Mr. Lse GladinnDr. Ralph Dutek Depiitment of Psyrholog 305 Davis AvenueV.P Human Factors Arejidale. Now South Wake 2351 Lembiur VA MMP7IlL, syateum AUSTRALIA1225 Jellerion Davis Hwy. Dr. Robert GlaserSuite 1209 Mr Michael Flanigm Learning ResarchArlington. VA ZZZ Code 52 A Developenrt Center

NPRDC Ulniveraity of PittsburghDr. John Eli San Die@% CA 92152.6100) 3939 O'Har StreetNavy Person-e R&D Center Pittsburgha, PA 13260Coda 51 Dr.J.D. PletcherSan Dkqpk CA 9W22 Institute for Defense Analysms Dr. Marvin D. Gloclt

11111 N. Beauriegard St. 101 Hommstead TerraceDr. Sum Elatmn Alhxmka VA 22311 Ithaca NY 14856144 S Mountain AvenueMontlir NJ 00C Dr. 8ennoh 0. Forte. Dr. Dwighit 3. Goering

Uniaierity of Illo ARI Field UnitERIC Padity-Acqui-ii DePartment of Coimputr Scienc P.O. Box 57172440 Reaearch Blvd. Suite 550 a 1309 West Spmrinel Avowat Presidio, of Monterey. CA 939W45011Roibt. MID 20850323 Urbant IL 61801

Dr. Joseph GogueDr. L. Anders Erlcaao Dr. Barbara A. Fox Computer Scinc LaboratoryU "versity of Coilorado Univeraity of Colorado SRI InternationalDepartmenit of Paydiology Department of Unpistics 333 Ravensw'ood AvenueCampo. Box 345 Boulder, CO 8030 Menlo, Patk. CA 9402Boulder. CO OW063

University Of PitabU1*1JAhlsaon 05r9?90

Mr. Richard Golden Dr. Wayne Harvey Mr. Roland JonesPaycholoVi Department Center for LeAarning Technology Mitre Corp,. K-203Stanford University Education Development Center Burlington RoadStanford. CA 943M 55 Chapel Street Bedford. MA 01730

Newton. MA 02160Mr. Harold Goldmans Dr. Marvel lustUniversty of DC Dr. Barbers Hayes-Rotb Camnege-Mellon UniversityDepartment Civil Engieering Knowledge Systems Laboratory Department of PaychologyBldg 42Z Room U2 Stanfordi University Scheiq Park4200 Czanectics* Avenue, N.W. 701 Wtch Road Pittsburgh, PA 15213Washaigon DC 2DW000d Alto CA 94304Dr A Kne

Dr. Sberi* Gott Dr. Freda%*k HayesRoth University of MinnesotaAFHRIJMOMJ Teitnasledge Deparmn of PsyctIooBrooks AFB. TX 7W25-5601 P.O. BOX 10119 Elliott Haill

1850 Emb'adere Rd. 75 E. River RoodDr. T. Govwianduj Palo Akc, CA 943(0 Minneapoli, MN 55455Georgia Institute of

Technolog Dr. James Hendler Dr. Michael KaplanSchool of Industrial Dept. of Computr Science Office of Basic Research

aid S*-ms Engieering Univemcty of Maryland U.S Army Research InstituteAtlanta. GA.30&V32W College Purt. MD 20742 5001 Pisenhower Avenue

Akwdnla, VA 22333-5600Dr. Wayne Gray Dr. lames HiebertArtifcil Intelligene Laboratory Department of Educational Dr. A. KarmilofY-SmithNYNEX Development MRC-CDU500 Westchester Avenue Universit of Delaware 17 Gordon StraetWhite muama NY 10604 Newark. DE 19716 London

H. Willsam Greenup Dr. Geoffrey Hinton EGADW l A

Dep Amut CiS. Inamictional Computer Science Department Dr. Milto S. KauiManagement (EO3A) University of Toronto European Science Coordination

Education Center. MCCDC Sandford Fleming Building OfficeQuantico. VA 22134-5050 10 King*& College Road U. Army Research Institute

Toronto. Ontario MSS LA4 CANADA Box 65Dr. Dik Gregory FPO New York 09510-L500Admiralty Reaearch Dr. lames E. Hoffman

Eaeablisbment/Aj(B Department of Psycholog Dr. Frank KeilQueens Road University of Delaware Departmenit of PsychologyTeddington Newark. DE 19711 22 Urn HallMkddlesm ENGLAND TI11OLN Cornell University

Dr. Kalbh 3Io~ycik Ithaca NY 14850Dr. Stephen Grouberg Department of PaychologCamte (or Adaptive Syteme Universty of California Dr. Wend KelloggRoom 244 Los Angeles CA 90024 IBM T. J. Watson Research Ctr.III Cummington Stuve P.O. Box 704Boston University ML. Julia S Hough Yorktown Heighta, NY 10598Boston. MA 02213 Cambridge University Press

40 West 2Oth Street Dr. Douglas KellyMichael Habon New York NY 10011 Unpivesity of North CarolinaDORNIER GMBH Department of StatiaticsP.O. Box 1420 Dr. William Hosl Chapel Hill. NC 27514D-7990 Friedr daen I Chief ScientistWVEST GERMANY AFHRUCA Dr. David Kieras

D He M.HlfBrooks AFB, TX 73235.5601 Technical Communication ProgramDr. Heney I. Half TDAL Bldg., 2360 Bonesee BKLvd

Halff Resources. Inc. Dr. Steven Hunka Universty of Michigan4918 33rd RAd" North 3.104 Educ, N. Ann Arbor. MI 48109L2106Atlingoon VA ZZ27 Univesit of Alberta

Edmonton. Alberta Dr. thomas KillionMr. H. Hamburger CANADA T6G 205 AFHR~jOTDepartment of Computer, Scienc Willisasi APB, AZ 85240.6457George Mason Universit Dr. loa HunterFairfax VA 22M 2122 Coolidge Street Dr. Jeremy Kilpatrick

Lansing, MI 4890 Department ofDr. Bruce W. Hamill Mathematica EducationReseach Center Dr. Bonnie E. John 105 Adehold HallThe lohns Hopkis Universit Wean Hall 8124 University of Georgia

Applied Physics .Ahorstory Departen of Computer Science Athens GA 30602Johns Hopkins Road Carneire Mellon UniversityLaurel MD 2M10 Pittsburgh, PA 15213 Dr. J. Peter Kincaid

Army Research InstituteDr. Patrick R. Harito Dr. Daiel B. Jones Orlando Field UnitComputer Sio- Deparmn U.S Nuclear Regulatory cdo PM TRADE-PU.& Nava Aesd"m Comm"=iso Orlando. FL 32813Annepolis. MD 21402-5002 NRRJ1LRB

Wasington. DC 2855 Dr. Walter KintachJanie Hat Departen of PsychologOffice of the Chief Mr. Paul L Jones University of Colorado

of Nava Operations Research Division Boulder. CO 80309-0345OP.11112 Chief of Nava Technical TrainingDapartassant of the Navy Building Pam.I Dr. Ale. KirlktWashbington. D.C. 20350.200 Nava Air Station Mempis Geora Institute of

Millington. IN4 360545056i TechnologyCenter for Human-Machitne

Systes ResearchAtlanta, GA 30332-020

Unitversity of Plizebc~tbhown 0529M

Dr. Janest L Kolodner Dr. Marcoa C. Limn Dr. . MkbieGJeorgia Institute 01 Technology Graduate School The Turing Institute

Sc Oolf looatica of Education. EMS!' George House&Computer Science Tolman Hall 36 Noth Hanover Street

Adlao" GA 30M3 University of Cadafoem Glasgow G I 2ADBerkeley, CA 94720 UNITED KINGDOM

Dr. Stephen Kosl1Harvard Univerit Dr. Robet Ucyd Dr. Vittorio Midoro1fl6 William James HAR Dept. of Geography CNR-IstWuO Torolope Didattucbe33 Kirklad St. University 01 South Carolina Via All Vper Pia 11Cambridge. MA 02138 Colanbia. SC 2920 GENOVA-ITAUA 16145

Dr. Kennseth Kaovosky Dr. Jackt Lodihead Dr. James R. MillerCommuiaty College 01( University 01 MCC

Allegheny Count.y Musadiusetas 3500 w. Baboones Cente- Dr.RSidge Avenue Physics Doertmn Astin. TX 7M79

Pittabwgb, PA t5212 Amherst. MA 01003DrJaoMiln

Dr. Keith Kramer Vent M. Malec Department o1 EducationHO Lab. Code 5530 NPRDC. Code 52 Roberts HaogNovel Research Laboratory Son Diegom CA 92152-6800 Cornell Univaty4445 Overlook Avenue Ithaca NY 14853Washingon. DC 201375-500 Dr. William L. Malay

Code 04 Dr. Chroombe M. MitchellDr. Gary Kress NETPMSA School 01 Indus. and Sys. Eng.628 Spazier Avenue Penasoola. FL 32509-500 Center for Man-MachinePacific Grove. CA 93950 Systems Research

Dr. Mary Marlino Georpa Institute of TechnologyDr. LowaAim Kuntz Director. Educational Technology Atlanta. GA 30532-0203010 S.W. 23rd Terrace HO, USAFA/DFTEApt. No, 00 USAF Academy, CO 8084-500 Dr. Andrew R. MoinarGainesville, FL 32608 Applic. 01 Advanced Technology

Dr. Sandra P. Marshall Science and Engr. EducationDr. David R. L.Ambork Dept. 01 Psychology National Science FoundationNaval Ocon Sysem Center San Diego State University Washington. DC 20550Code 7n2 Sa Diego, CA 92182271 Catalina Boulevard Dr. William MontagueSan Diego, CA 92152-5000 Dr. John H. Mason NPRDC Code 13

Centre for Maths Education San Diego CA 921526800Dr. Pat Langley Mathematica FacultyNASA Atm Research Ci,. Open University Dr. Melvin D. MontemerloMoffett Field CA 9405 Milton Keynes MK7 6AA NASA Headquarters

UNITED KINGDOM Code RCDr. Robert W. Lawler Washington. DC 2054Matthews 118 Dr. Manton M. MattieAnPurdue University Department 01 Com~p- Scinc Prof- John MotonWest Lafayette. IN 47907 Univesity 01 South Carolina MRC Cognitve

Columbia, SC 2920 Development UnitDr. Eugene Lea 17 Gordon ScroetNaval postgraduate School Dr. Richard E Moyer London WCIH OAHMonterey. CA 93943-5M26 Department 01 Psychology UNITED) KINGDOM

University 01 CalifrniaDr. Yub-Jeng Lee Santa Barbara, CA 93106 Dr. Allen MunroDepartment 01 ComPue Scinc Behavioral TechnologyCode 521. Dr. David J. McGinness Laboratories - USCNaval Postgraduate School Gallaudec Universty 250 N. Harbor Dr. Suite 309Montere, CA 93043 800 Florida Avenue. NE Redondo Beach CA 90277

Dr. All P. LehmanWsbngmDC M Dr. Wllisom R. MurraySchool 01 Computer Science Dr. Joseph C. McLachlan FMC CorporationCarnege Mellon Univmusty Code 52 Central Engineering LabsPittsburgh, PA 15213-3890 Navy persone R&D Center 1205 Coleman Avenue

San Diego. CA 92152-6800 Box 580Dr. Ji Levin Santa Olars. CA 95002Department 01 Dr. Douglas L Media

Educational Psyholog Department 01 Psychology Cair. Department 01 Weapons and210 Edacton Bilding Universty o Mthign Systems Engieering1310 South Sixth Stre Amn Arbor, MI 48109 US Naval AcoamyCaep@igt IL 6182049Mr90il emk Annapolis, MD 21402

Dr. John Le9vMn Foravarees Canter for Ledertlab Dr. T. NWbetLeaning R&D Canter chruiuhavns Voape 6 The Turing Institute,Uniest 041"o Ptzabusar 1424 Kobanhavn K George HousePloasbtagl PA 1520 DENMAR 36 North Hanover Street

Glosgow G1 2ADMatu Loam Dr. Arthur Melmed UNITED KINGDOMDeparmn 01 Psychology Computer Arts andCaWrgie-Melon Univert&y Edutcatio Laboratory Library. NPRDCPleatgsl PA 15213 New York University Code 10291L.

719 Broadway. 12Lb floor Sen Diego, CA 921524800Or. Doria K. Luke New York. NY O00Sothwae Productvity Consortium LibrarianISI Campu Commoe, Drive North Dr. Jone Mestre Naval Center for Applied ResearchResin. VA 2209 Department o1 Plyioca in Atificial Intelligence

Hashrouck Laboratr Naval Research LaboratoryUniversity, 01 Massachusetts Code 5510Amherst. MA 01003 Washingon DC 20754M00

Univrity of Pinurimotbisson 05/29/"0

Dr. Herold F. O?4ed Jr. Dept. of Administrative Sciences Dr. Linda 0. RobertsSchool of Education - WPH 801 Code 54 Science. Education, andDepatment of Educational Naval Postgraduate School Transportation Program

Psycholog A Technology Mon"ey CA "0943-5026 Office of Technology AssessmentUniversity of Southern California Congress of the United StatesLoo Angeles. CA 9008W.00I Dr. Peter Pitchi Washington. DC M010

School of EducationDr. Paul Oltorke University of California Dr. Ernst Z. RothkopfInfenintion & computer Science Berkeley, CA 94720 AT&T Bell LaboratoriesUniversity of Caliornia. Irvine, Room ZD-456Irvine, CA 92717 Prot Tomiaso Poggio 600 Mountain Avenue

Massachusetts Instiute Murray Hill. NJ 0394Dr. Stati Ohission of Techology E25-201Learnig Rt A D Center Center for Biological Dr. Alan H. SchoenfeldUniiversity of Pittsburgh Information Processing University of CaliforniaPitiasbiargl, PA 15260 Cambridge MA 02139 Department of Education

Berkeley, CA 94720Dr. James, B. Olaw Dr. Pete PoisonWICAT Systsa University of Colorado, Losell Schoer1875 South Stae Street Deprten of Psycholog Pschological A QuantitativeOrem UT 8400 Boulder CO 8030904W Foundations

College of EducationDr. Gary M. Olson Dr. Steven E. PoltrockL University Of IowaCognitive Science and Boeing Advanced Technology Center Ioas City LA 52242

Machine Intelligenice Lab. PO Box 24346 rn/a 7L-64University of Michigan Seattle, WA 98124 Dr. Janet W. Scho~wld701 Tappani Street 816 LRDC BuildingAnn Arbor, MI 491234 Dr. Joseph Psocka University of Pittsburgh

ATTN: PERI-IC 3939 O'Hara StreetDr. Judith Reitman Olso Army Resarch Institute Pittsburgh. PA 15260Graduate School of Businesa 5001 Eiaenhower Ave.University of Michigan Alendria. VA 2233-560 Dr. Key SchulzeAnn Arbor. MI 48109I234 Computer Science Dept

Mr. Paul SI Rau U1.S. Naval AcademyOffice of Naval Research. Code U1-33 Annapolis. MD 21402-5018

Code 1142CS Naval Surface Weapons CenterS00 N. Quincy, Stree White Oak Laboratory Dr. Miriam Schissack;Arlinpton. VA 221750100 Silver Spring MD 20911 Code 52(6 COPie) Navy Personnel R a D Center

Dr. James A. Regga San Diego, CA 92152-6800Dr. Judith Oraaao University of MarylandBasc Rearch Office School of Medicine Dr. Judith W. SegalArmy ResarchInestitute Department of Neurology OERJ5001 Eisenhower Avenue 22 South Greene Street 555 New Jersey Ave,. NWAlendria. VA 2Z333 Baltimore MD 21201 Washington., DC 2M~

Dr. lese Orianaky Dr. J. Wesley Regian Dr. Robert J. SeidelInstitute for Defense Analse AFHRL41DI US Army Research Institute180M N. Beauregard St. Brooks AFB. TX 78235 500 Eisenhower Ave.Almenrdria. VA 22311 Almandia, VA 22333

Dr. Fred ReifDr. Everett Palmer Physica Deparmet Dr Coleen M. SeifertMail Stop 2.39.3 University of California Institute for Cognitive ScienceNASA-Amws Research Center Berkeley, CA 94720 Mail Code C-01SMoffett Field. CA 94035 Univeraity of California. San Diego

Dr% Charles M. Reigeluth La Jolla. CA 9209Dr. Okchoon Park: 330 Huntington HallArmy Research Institute Syracuse University Dr. Michael G. ShaftoPERI.2 Syracuse. NY 13244 NASA Ames Research tr.5001 Esenhwe Avenue Mail Stop 239-1Aleandrma. VA 22333 Dr. Daniel Reisberg Moffet Field CA 94035

Reed CollegeDr. Roy Pea Deparmet of Psychology Mr. Cohn SheppardInstituto for Rinac Portland, OR 97202 AXC2 Block: 3

on Learning Adwirality Research Establishment2550 Haoe Street Dr. Lauren Resnick Min"sr of Defence PortadownPalo Alto. CA 9430 Learning R A D Center Poetsmouth Hanta PO64AA

University of Piuaburgh UNITED KINGDOMDr. David N. Patina 3939 O'Haa StreetProse Zero Pittsburgh,. PA 15213 Dr. Lee S. ShulmanHarard Graduate School School of Llducaonr

of Educastions Dr. J. Jeffirey Richardson 507 Ceaw7 Appian Way Center for Applied Al Stanford UniversityCambridge. MA 02168 College of Busineaa Stanford. CA 94 -30904

University of Colorado,Dr. C Perrio. Chair Boulder. CO 80309-0419 Dr. Randall SbutnakerDep. of Payeholog Naval Resac LaboratoryMorgan Stats University Dr. Edm L Risaland Code 5510Cold Spring LA-Kitteni Rd. Dept. of Computer and 4555 Overlook Avenue. S.W.Baltimora. MD 21239 Information Scence Washington. DC 20375.5000

University of MaatteaDr. Nancy N. Perry Amherst, MA 01003 Dr. Edward SilverNaval Education ond Training LROCPrnga Support Activity Mr. William A. Rizzo University of PittsburghCod*447 Code 71 3939 O'Hara StreetBuidng 243 Naval Training Systems Center Pittsburgh. PA 13260Painoesioa. FL. 32509500 Orlando, FL 32813

University of Ploaburgbohlaaon 05/29M9

Dr. Herbert A Simori Dr. David E. Suon Dr. Keth T. WacoutDepmlen of Paydiolog Computer Teaching Corporatio FMC CorporationCarnelle-Mello Univarit 1713 South Neil Street Central Enginerig LabeSchenley Part Urbana. IL 61820 12M Colem Ave-. Box 580Pilsbsx6 PA 15213 Saita Clars. CA 9562

Dr. Patrick SupesRobert L Simpson. Jr. Stanford University Dr. Dougias WetzelDARPA/ISTO Institute for Mathematical code 511400 Wilson Blvd. Studies in the Social Sciences Navy Personne R&D CenterArlington. VA ZZ99-2306 Stanford. CA 94305-4115 Son Diego CA 92152-680

Dr. Zito M. Simutla Dr. Perry W. Thorrodyke Dr. Barbara WhiteChief, Techniologies for Skidl FMC Corporation School of Education

Acqluiaition and Retention Central Ennarinwg LAWa Tolmanr Hat. EMSTARI 120S Coleman Avenue. Box 580 Uniest of California5001 Eiseanhower Avenue Sant Clama CA 9%02 Berly CA 947W0Alexndria. VA 22333

Dr. Sharon Tkaac Dr. David WilkinsaDr. Derek Sleean Alaen Corporation University of IlinosComputing Scinc Deparmn 209 Madleon Stroet Department at Comopu'r ScienceThe University Alexndia, VA 2Z314 1304 West Springfield AmnueAbrde ABf9 NX3 Urbana, IL 61801Scotland Dr. Dougas ToamesUNITED KINGDOM Behavioral Teclinolg Labs Dr. Marsha R. Willian.s

University of Southern California Applic. ot Advanced! TedinologiesMe. Gail KC. Slestnon 250 N. Harbor Dr.. Suite 309 National Science FoundationLOCIICON. Inc. Redondo Beach. CA 90277 SEE/MDR]SEP.O. BOX 85158 800 G Street. N.W. Room 635-ASan Diego. CA 92138-5158 Major D. D. Tucker Waahington. DC 20550

HQMC. Code MA Room 4023Dr. Edward I. Smth Waahington, DC 208 S. R WilsonDepuian ot Psychlog Code 5505University of Miduigen Dr. Paul T. TN'ohig Naval Research Laboratory330 Packard Road Army Research Institute Washington. DC 20375.50000Ann Arbor. MI 48103 ATIN: PERIjRL

5001 Eienhwr Avenue Dr. Robert A. WisherDr. Alfred F. Smode Alexndria. VA 22333.5W0 U-1%. Army Institute for theCode 7A Behaviors! and Social SciencesResearch and Development Depit. Dr. Zita P. Tyer 5001 Esienower AvenueNaval Training System Center Department ot Psychololl Alexndia. VA 2233-5600Orlando. FL 32813-7100 George Mason University

4400 University Drive Dr. Merlin C. WitrockDr. OF Soloexy, Fairfax. VA 22W0 Graduate School of EducationYale Unveity" UCLAComputer Science Deparmn Dr. Harold P. Van Cott Los Angeles, CA 90024P.O. BOX 2158 Coimmittee on Humn FactorsNew Haven. CT 06520 National Academy of Sciences Mr. Paul T. Wohag

2101 Constitution Avenue Army Research InstituteLinde B. Sorio Washington. DC 20418 5001 Eisenhower AmeIBM-Los Angeles Scientific Center ATTN: PERI-RL1M~ Wilshire Blvd.. 4th Floor Dr. Kurt Van Lehn Almndia VA 22333-560Los Angeles, CA 9002 Department of Psycbolog

Carnegie-Mellon University Mr. Josephi WobIN. S. Seidharan Seliley Park Alphatedi. Inc.FMC Corporation Pktcbuergb, PA 15213 2 Buiiingco Executiv CenterBOX 580 111 Midlse Turnpike1205 Coleman Avenue Dr. Frank L Vicino Burlington, MA 01803Samt Cars. CA 9W02 Navy Personnel R&D Center

San Diego CA 92152-M80 Dr. Wallace Wulfeack. IIIDr. Marian Stearns Navy Personnel R&D CenterSRI International Dr. Jerry Vogt code 51333 Ravenuirood Ave. Navy Personnel R&D Center San Dieso. CA 921526800Room B.5124 Code 51Menlo Park, CA 9402 San Diego. CA 921526800 Dr. Masoud Yszdaai

Dept. of Computer ScienceDr. Friedric W. Steep Dr. Thomas A. Warm University of EntterBundesminkteium FAA Academy AAC934D Prince a Wale Road

des Verteidipio P.O. Box 2508 Exeter EX44PTPostfardi I=2 Oklahomsa City. OK 73125 ENGLANDD-5300 Bonn 1WEST GERMANY Dr. Beth Warren Dr. Joseph L. Young

BEN Laboratories. Inc. National Scienoe FoundationDr. Frederiek Steinheiuer 10 Moulton street Room 320CIA-ORD Cambridge, MA 022381 80 Stroem. NW.Amews Building Washigton DC 3150Washington. DC 2050 Dr. Diana Wewrne

Department of Educational Dr. Uri ZernikDr. Saul Sternbierg Development General ElectrUniiversity of Pesmalkut University of Delaware Research A Developonmt CenterDaparasi of Psycholo Newark. DE 19711 Artificial Intelligence Propam3815 Walnut St~e P 02 a8Philadelphia. PA 191046196 Dr. Shih-surig Wan Schenectady. NY 12301

Deparmn of PvydxltooDr. Ronal Sternfelle Jackson Stae UniverstOak Ridge Ammoc. Univ. 1400 J. R. Lynch StroetP.O. Ba 117 Jackaon, MS 39217Ook Ridge. TN 37831-0117