8
AsSESSMENT 1997, Volume 4, Number 3, 297-304 Copyright © 1 997 by Psychological Assessmelll Reso urces, Inc. All dgh ts reserved. CONSTRUCT VALIDITY OF THE WISC-III VERBAL AND PERFORMANCE FACTORS FOR BLACK SPECIAL EDUCATION STUDENTS Jos e ph C. Kush Duquesne Universi ty Marl ey W. Watkins Pennsylvania State University The unde rl ying factor structure of the revised e di tio n of the Wechsler Intelligence Scale for Children (WISC-R) was consistently fou nd to be comparabl e between regul ar and special education students as we ll as across Anglo, Bl ack, an d Hispanic popul at ions. A commensurate research base across excep ti onali ty and ethnic group has not been estab- li shed for the recently pu bli shed third edition of the Wec hsler Inte lli ge nce Scale for Children (WISC- III ). making it vita l that info rmati on regarding the psyc hometric proper- ties of the WISC- III among di ve r se groups of children be co ll ected. This study exa min es the factor structu re of the 10 WI SC- III core sub tests among a sample of Bl ack students receiving special education services. Res ul ts provided evidence of a large, first principal factor as we ll as the expected Verbal and Performance factors. Implications for psycholo- gists are presemed, and recommendations for future research are provided. Psyc hol og ists have long bee n aware of the imp o r- tance of no ndi scriminatory tes tin g a nd the con- ce pt of test bias (Reschl y, 1981). Ea rl y cl aims of test bi as pointed to co mmon ly f ound mean score di ff erences bet wee n ma j or i ty and minority po pu- l at ions, but Th orn dik e (1971) an d ot hers delin- eate d th e limi tatio ns of this ap pr oac h a nd pre- se nt ed more so phi sti ca ted de fini tions a nd approac hes to detecting test bi as. O ne fund amen- tal met hod of de termining the fa irness of a test is exa mination of th e evidence for its va lidit y. As tra ditiona ll y categori ze d, there are three types of va lidit y: content , con str uct. a nd cr it er ion-relate d (Cronbach. 1990). Test bias may exist und er any or Co rr esponde n ce co n cer nin g this art i cle should be ad dressed to J osep h C. Kush, 410B Canevin Hall, Duquesne Uni versity, Piusburgh, PA 15282-0502. a ll of th ese divisions of va lidi ty (Reynolds & Kaiser, 1990). A wid ely acce pted empirical method used to in ves- ti gate constru ct va lidi ty is factor anal ys is (Comrey, 1988). This multi va riate tec hniqu e a ll ows for the statistical iso lation of scales th at int er co rrel ate while simult aneo usly re ma in ing se par ate from ot h er scales. Thu s. factor analys is p rese nt s ev i- den ce r ega rdi ng th e und erlyin g co nstru cts or traits meas ured by a test. If a test fa il s to meas ure th e same und erlyin g co n st ru ct ac ro ss various soc i oc ultur al gro up s or if scores from th e test refl ec t diff ere nt traits across e thni c cultu res, then the a ppropriateness of using these test scores for those gro up s b eco mes qu estionable. A co mp ar i- son of factorial simila rit y across et hnic group s is a necessar y, b ut not s ufficient, co ndi tion for the indication of a nonbiased tes t. 29 7

construct validity of the wisc-iii verbal and performance factors for

  • Upload
    votu

  • View
    225

  • Download
    0

Embed Size (px)

Citation preview

Page 1: construct validity of the wisc-iii verbal and performance factors for

AsSESSMENT

1997, Volume 4, Number 3, 297-304 Copyright © 1997 by Psychological Assessmelll

Resources, Inc. All dghts reserved.

CONSTRUCT VALIDITY OF THE WISC-III VERBAL AND PERFORMANCE FACTORS FOR

BLACK SPECIAL EDUCATION STUDENTS

Joseph C. Kush Duquesne Universi ty

Marley W. Watkins Pennsylvania State University

The underlying factor structure of the revised edi tion of the Wechsler Intelligence Scale for Children (WISC-R) was consistently fou nd to be comparable between regular and special education students as well as across Anglo, Black, and Hispanic populations. A commensurate research base across exceptionali ty and ethnic group has not been estab­lished for the recently published third edition of the Wechsler Intelligence Scale for Children (WISC-III ). making it vital that information regarding the psychometric proper­ties of the WISC-III among diverse groups of children be collected. This study examines the factor structure of the 10 WISC-III core subtests among a sample of Black students receiving special education services. Results provided evidence of a large, first principal factor as well as the expected Verbal and Performance factors. Implications for psycholo­gists are presemed, and recommendations for future research are provided.

Psychologists have long been aware of the impo r­tance of nondiscriminato ry testing and the con­cept of test bias (Reschly, 1981). Early claims o f test bias pointed to commonly found mean score differences between majority and minori ty popu­latio ns, but T horndike (197 1) and others delin­eated the limi tatio ns of this ap proach and pre­se nte d m o r e so phi sti ca te d d e fini t io n s a nd approaches to detecting test bias. O ne fundamen­tal method of determining the fairness of a test is examinatio n of the ev idence fo r its va lidity. As traditionally categori zed , there are th ree types of validity: content, construct. and criterion-related (Cro nbach. 1990) . Test bias may exist under any o r

Co rresponde nce co ncer nin g thi s art icle sho ul d be ad dressed to Josep h C. Ku sh, 4 10 B Ca nev in Hall , Duquesne University, Piusburgh, PA 15282-0502.

a ll of th ese d ivisio ns of va lidi ty (Rey no lds & Kaiser, 1990).

A widely accepted empiri cal method used to inves­tigate construct validi ty is factor analysis (Comrey, 1988) . This multivariate technique allows for the stati stica l isolati o n of sca les that inte rco rrelate whil e simultaneously re main ing sep ar ate from other scales. Thus. factor analys is p resents ev i­d ence regardi ng the underlying co nstructs or traits measured by a test. If a test fails to measure th e same underlying co nst ru ct ac ross va ri ous sociocultura l g roups o r if sco res from the tes t reflect different traits across ethnic cultures, then the appropriateness of using these test scores fo r those g roups becomes questio nable. A compari­son of fac torial similarity across ethnic groups is a necessar y, but not suff icient, condi t io n for the indicatio n of a nonbiased test.

297

Page 2: construct validity of the wisc-iii verbal and performance factors for

Kush and Watkins

For the past 20 years, the revised edition of the Wechsler Intelligence Sca le for Children (WISC-R; Wechsler, 1974) has been the most frequently used intelligence tes t for children in school se ttings (Goh, Teslow, & Fuller, 1981; Lutey & Copeland, 1982). Like other Wechsler instruments such as the rev ised edition of the Wechsler Preschool and Primary Scale of Intelligence (WPPSI-R; Wechsler, 1989) and the revi sed edition of the Wechsler Adult Intelligence Scale (WAIS-R; Wechsler, 1984), the WISC-R prov ides an overall measure of gen­eral intellectual functi oning as well as verbal and performance IQs.

Notwithstanding their widespread popularity, the Wechsler tests are often criticized for their lack of an explicit theo retica l formulation (Macmann & Ba rn ett , 1992, 1994; Witt & Gresham, 1985). Despite the fact that the research is based on data that describe the structure of the Wechsler test

rather than a theory that describes the structure of intelligence (Macmann & Barnett, 1994), con­struct va lidity for the verbal and perfo rmance scales of the WISC-R has been well established. A two-factor, verbal-performance solution has been shown to be stable across age (Conger, Conger, Farrell , & Ward , 1979), ge nde r, (Rey no lds & GUlkin, 1980) and ethnicity (Gutkin & Reynolds, 1981; Reschly, 1978) as well as for such diverse populations as gifted students (Sapp, Chissom, & Graham, 1985), deaf and hard-of-hearing students (Sullivan & Schulte, 1992), and students with lim­ited English profi ciency (e.g., Mexican American or Native American children; Taylor, Ziegler, & Pan enio, 1984). Additionally, factori al similarity has been shown between Black and Anglo chil­dren on the WISC-R (Oakland & Feigenbaum, 1979; Reschly, 1978) as well as on other Wechsler tests including the original WISC (Wechsler, 1949; Lind sey, 1967) a nd th e WPPSI (Ka ufm a n & Hollenback, 1974).

Empirical studies examining the factor structure of th e rece ntl y publi shed , third editi o n o f the Wechsler Intelligence Test for Children (WISC-I1I; Wechsler, 1991 ) have provided mixed results. Roid, Prifitera, & Weiss (1993) found support for four WISC-III factors in a regular educati on sample.

298

H oweve r, o th e r researc he r s (Sa lll e r, 1992; Thorndike, 1992) have concluded that a three­factor solution beller describes the data.

The extent to which the factor structure of the WISC-lII will generalize to special education pop­ulati ons remains uncertain . Although some ev i­dence suggests that a four-factor solution is most appro pri a te for spec ia l educati o n childre n (Ko no ld , Ku sh , & Ca nivez, in press), o th e r research (Kush, 1996) has shown suppon for only the Verbal and Performance factors in a sample of learning disabled students. This uncertainty is compounded for minority, disabled children as se pa ra te data for min o rit y stude nts a re not repon ed in the WISC-III technical manual. To d ate, o nl y o ne stud y has exa min ed the fac to r structure of the WISC-III among Black students. Slate and J ones (1 995) examined the WISC-lII fac­tor structure in a small (N = 58) sample of Black students referred for psychological eva luatio n . Preliminary evidence was found for the construct va lidity of th e Full Scal e, Ve rbal sca le , a nd Pe rfo rm a nce sca le fac to rs o f th e WI SC-llI , although psychometric characteristics of their fac­tor analytic technique were not fully prov ided .

To date, factor analyti c ev idence rega rding the WISC-I1I has come from research that included all 13 subtests , 10 required and 3 optional, in the analys is. In actual prac ti ce, however, many psy­chologists do not administer the optional subtests (Blumberg, 1995; Ward , Ward, Halt, Young, & Mollner, 1995). For example, Glutting, Konold , McDermott, Kush , & Watkins (1996) analyzed a large sample of WISC-lII cases gathered from six states and found that only one third of the proto­cols included the optional Digit Span and Symbol Search subtests and only 1 % included the optional Mazes subtest. Thus, the generalizability of studies investigating the number of abilities measured by the WISC-II1 subtests, as applied in general prac­tice, remains unresolved.

Similarly, because Black students comprise a small percentage of the overall WISC-I11 standardization sa mple (1 5.4%), additi ona l research direc ting specific attention to this group is warranted. The primary objective of this study, therefore, was to

Page 3: construct validity of the wisc-iii verbal and performance factors for

WIse -III Factor Structure

examine the factor structure of the 10 mandatory or core WISe-III sub tests in a population of Black special education students. Specific methodologi­cal considerations include a replication of the fac­tor analytic technique utilized with the standard­iza ti o n sa mple and th e inclusion of subtes t s commonly used by practitioners.

Method Participants

A total of 16 1 Black students, who received com­preh ensive psychologica l eva luati o ns during a 3-year peri od , se rved as parti cipants. Student s were part of a larger database, generated as part of a state-wide initiative examining the WISe -III scores of disabled students . The sample included 11 6 males and 45 females in grades I through 11 , with the majority of the sample (60%) enrolled in grades 3 through 8 and a mean age of II years (SD = 15.45) . Students represented the tota l Black special education population from 18 urban and suburban school districts in Arizona. Student eth­nicity was determined by enrollment forms com­pleted by their parents. Special education status included 11 4 students with Learning Disabilities, 10 students with Emoti onal Disabilities, 28 stu­dents with Mild Mental Retardation, 8 students with Moderate Mental Retardation, and I student categori zed as Other Health Impaired. Students referred for psychologica l evaluation but found to be ineligible for special education were excluded from the sample. Students came from primarily low-middle- and lower-class socioeconomic back­grounds, based upon school district eligibility cri­teria fo r reduced lunch programs.

Measure

The WISe-III is an individually administered test of intellectual ability for children aged 6-0 years to 16-11 years. It consists of 10 mandato ry and 3 optional subtests (M = 10, SD = 3) that combine to yield Verbal (VIQ), Performance (PIQ), and Full Scale IQs (FSIQ; M = 100, SD = 15). For this study, the supplementary subtests of Digit Span, Symbol Search, and Mazes were excluded as they do not influence the fo rmation of the FSIQ, VIQ, and PIQ indexes .

Procedure

The WISe-III was administered by state certified school psychologists as part of the legally man­date d multidi sc iplin ary evaluati o n p rocess to de termine e lig ibility for spec ial educa ti on se r­vices . All eva luati ons included an individuall y administered test of academic achievement (M =

100 , SD = 15). Th e re vis e d e diti o n o f th e Woodcock-J ohnson Psycho-Educati onal Bau er y (Woodcock & Johnson, 1989) was the most com­monly admini ste red achi evement batter y (87%) although the Wechsle r Individual Achievement Test (WI AT; Wechsler, 1992) and the Kaufman Tes t of Educati onal Achievement (Kaufman & Kaufman, 1985) were utili zed with II % of the par­ticipants. Special education placements were inde­pendently determined by a multidisciplinar y team based on federal and state special education rules and regulations.

Data Analyses

Sca led sco res fro m the 10 mandato ry WISC-III subtests combined to form a 10 x 10 correlation matrix. An explorato ry factor analysis using maxi­mum likelihood extraction (squared multiple cor­relations on the di agonal ) followed by Varim ax rotation was selected and performed for all factors exceeding the Kaiser crite ri a (Kaise r, 1960) of e igenva lues of 1.0 or g reater. This procedure is consistent with analyses reported in the WISC-III technica l manual on data compri sing the stan­dardization sample. Data were analyzed utilizing the Statistical Package fo r the Soc ial Sc ie nces (S PSS; Norusis, 1994, for the Macintosh).

Because the Kaiser (1 960) rule tends to identify too few facto rs when the number of variables is small (Thorndike, 1990), an examination of the scree plot (Cattell, 1966) and parallel analysis were also utilized. Parallel analysis is a procedure that compares eigenvalues extracted from the sample data with eigenvalues generated from a seri es of random data containing the same sample size and number of variables . Facto rs are considered mean­ingful when they are represented by larger eigen­values than are produced by the random data (Lautenschlager, 1989).

299

Page 4: construct validity of the wisc-iii verbal and performance factors for

Kush and Watkins

Results Descriptive statistics for WISC-III VIQ, PIQ, and FSIQs as well as individual subtests are presented in Table 1, along with reading, math, and written expression achievement scores. As expected in a special edu cation population, academic achi eve­ment was lower than intellectual ability across all academic areas. Additiona ll y, WISC-III subtes t intercor relations are presented in Table 2.

Results of the explo rator y, maximum-likelihood facto r analysis are presented in Table 3. An exami­nation of the first unrotated factor indicates that a substantial percentage of total WISC-III variance (i.e., 55%) was accounted for by a large underlying genera l facto r (g) . T his amount of variance is slightly larger than the 43% attributed to g in the standardi zation sample. When compared with the WISC-II1 standardi zation sample, a coeffi cient of congruence of .99 indicated a high degree of fac­torial similarity on the g factor between the two

Table I

groups. Factor loadings of the individual sub tests on the g factor were uniformly positive with all sub tests except Coding loading above .60 and with 5 of the 10 subtests showing loadings above .70.

As recommended by Gorsuch (1983), multiple cri­teria were considered in determining the number of facto rs to subsequently extr ac t. Consistency among extraction measures was achieved, with the Kaiser, scree, (both employed with the WISC-III standardization sample) as well as addi tional par­allel analysis criteria, a ll suggesting that two fac­tors were needed to adequately represent the data. As expected, the resulting facto rs appeared to reflect the traditional Wechsler verbal and perfor­mance intelligence dimensions. Taken together, these two factors comprised approximately 57% of the total test varian ce, a fi gure slightly higher than that produced in the standardization sample in which they accounted for 43% of WTSC-ITI variance. Subtest loadings were relatively straightfo rward

Standmd Score Means, Standard Deviations, and Ranges Jor WISG-III VIQ, PIQ, FSIQ, VG, PO, and Subtesls JOT Black Special Education Studenls

300

Variable M

VerbalIQ 80.98 Performance IQ 82.08 Full Scale 1 Q 79.84 VC factor 83 .1 6 PO factor 82.70

Picture Comple tio n 7.77 Info rmation 6.49 Coding 7.53 Similari ties 6.92 Picture Arrangement 6.63 Arithmetic 5.78 Block Design 6.35 Vocabulary 6.71 Object Assembly 7.02 Comprehensio n 7.45

Reading 76.67 Math 77.44 Written language 71.33

SD

15.10 16.00 15.45 15.64 16.31

3.39 2.93 3.42 3.34 3. 16 2.58 3.60 3.25 3.40 3.59

15.55 16. 17 13.75

Min Max

48 114 46 126 44 120 50 11 6 50 128

I I I 1

I I

26 39 30

17 12 19 14 15 12 19 16 17 17

129 130 94

Note . \\TlSCllI = third edition of the Wechsler Ime lligcnce Scale for Children; VlQ = verbal IQ; PI Q =

perfo rmance I Q; FSI Q = Full Sca le IQ ; VC = Verba l Co mpre he ns ion ; PO = Perceptu al Organization; Min = minimum; Max = maximum.

Page 5: construct validity of the wisc-iii verbal and performance factors for

WISC-III Factor Structure

Table 2 InlcrcoITelalions Among WISC-1I1 Sublesls for Black Special Educalion Slttdenls

Subtest 1 2 3 4 5 6 7 8 9 10

I. PC .47 .37 .59 .57 .47 .57 .55 .56 .53

2. IN .36 .68 .45 .56 .4 1 .72 .47 .60

3. CD .36 .38 .31 .46 .34 .34 .39

4. SM .51 .45 .52 .75 .46 .72

5. PA .47 .58 .52 .46 .57

6. AR .40 .55 .29 .52

7. BD .48 .61 .47

8. va .47 .70

9.0A .4 1

10. CM

Note. WiSe- ill - third ed itio n of the Wechsler Inte ll igence Scale for Children; PC '" Picture Completion; IN '" Information; CD - Coding; SM - Similari ties; PA : Picture Arrangement; AR -Arithme tic; BO = Block Design; VO - Vocabulary; OA - Object Assembly; eM = Comprehension.

Table 3 Maximum Likelihoodj Varimax Faclor Loadings of lhe WISC-1I1 for Black Special Educalion Sludenls

Subtest

Picture Completion

Information

Coding

Similarities

Picture Arrangement

Arithmetic

Block Design

Vocabulary

Obj ect Assembly

Comprehension

Eigenvalue

% of variance accounted for

g loading

55

.72

.77

.49

.83

.69

.62

.70

.85

.63

.79

Rotated factors

Factor Factor I 2

.43 .60*

.75* .29

.25 .46*

.75* .39

.41 .60*

.54* .33

.25 .81 *

.82* .34

.30 .65*

.71* .37

5.54 1.00

51 6

Note. WISCIU : third edition of the Wechsler Inte lligence ScaJe for Children; g = genera] factor. *Significam factor loading.

and a lig ned closely with their respective latent dimensio ns. Although traditionally conside red per formance subtes ts, Picture Completio n and Picture Arrangement evidenced high loadings on both the Verbal and Performance factors. As with

the g factor, a high degree of factorial simi larity was found between the present sample and th e standardization sample fo r both the Verbal and Performance factors (i.e. , coefficients of congru­ence = .99 and .98, respectively) .

301

Page 6: construct validity of the wisc-iii verbal and performance factors for

Kush and Watkins

Discussion These resul ts provide supportive evidence for the construct validity of the WISC-III in a population of Black special education students. As expected, resu lt s o f the present study indi cate that the WISC-III produces a substantial g loading among these students, which is very similar to findings derived from the standardization sample. Also as expec ted , the Ve rba l and Pe rforma nce sca les remain intact and appear to offer much diagnostic interpretability. The Verbal facto r is derined by ri ve strong subtest loadings (i.e. , Informat ion, Similarities, Arithmetic, Vocabulary, and Compre­hension) as is the Performance factor (i.e., Picture Completion, Coding, Picture Arrangement, Block Design, and Object Assembly).

T he relatively similar VIQ and PIQ sco res were almost identical to the sma ll VIQ-PlQ di fference found in the WISC-R standardization sample for Black students (Kaufman & Doppelt, 1976), but a re no ti ceabl y diffe re nt from th e 8.9-po int WISC-R di sc repancy found for an independent sample of Black children (Taylor et a I. , 1984). Cu r re nt findin gs a re a lso s imil ar to t h ose obtained in a preliminary study of Black students by Slate and Jones (1995).

Additional methodological considerations related to the present study sh ould a lso be d enoted. Although Varimax rotation was perfor med on the present data (to be consistent with analyses fro m the standardization data), an oblique method of rotation (such as direct-oblimin) may, in fact, be more appro pri ate fo r a nalyzing the WISC-III because of the high intercorrelations among the facto rs (Kush, 1996; MaClnann & Barnett, 1994). A subsequent, posthoc analysis was performed using di rect-oblimin rotation techniques. Additionally, as the WISC-lll standardi zation data we re sub­j ected to a number of exploratory facto r analysis procedures (i.e. , principal-component, ite rated principal-axis, as well as maximum-likel ihood), the present data were further factor analyzed with these procedures . These results also consistently supported a two-factor interpretation of the data. The stability of the two-facto r solution ac ross multiple o rthogo na l and oblique approaches se rves to increase the generalizabili ty of these

302

r es u lt s and o ffe rs a good sta rtin g po int fo r researchers who wish to extend these findings to new clinical samples .

Certainly, the current findings allow for no con­clusions about the existence, or absence, of the Freed o m from Distract ibility a nd Process ing Speed factors in the present sample. Because only th e most commo nly administe red , mandato r y WISC-1lI subtes ts were included in the present analysis, it is highly unlikely that a third or fourth factor would have been detected. Future fac tor analytic research that includes the Digit Span and Symbol Search subtests will be able to extend the current findings by determining the existence and ge nerali zability of these hypothesized, additional facto rs in minority and disabled populations.

Results of this study do indicate that psychologists ca n reasonably co ncl ude that WISC-1l1 FSlQ , VIQ, and PIQ can each be thought of as relatively robust indexes of intelligence for Black special education students . When applying a construct validity definition of test fa irness, it appears that the Full Scale, Verbal, and Performance scales of the WISC-III are not biased when used with this minority population. However, these resul ts must be interpreted with some caution as the determi­nation of conSU·uct validity is a necessary, but not sufficient, condition for fairness in test use.

Geographic restriction and participant characteris­tics may limit the generalizability of these results a nd o ffe r suggest io ns fo r future resea rch . Although consistent with other minority cl inica l samples, the mean FSIQ of the present sample was approximately 20 po ints lower than the mean FSIQ from the WISC-III standardization sample. However, the standard dev iation from the present sample suggests adequate variability in the range of scores . Similarly, archiva l data collected from other states may contain students classified on the basis of varying state defini tions for special educa­tion eligibility. Add itionally, WISC-III scores uti­lized in the present study were part of a compre­hensive batter y of tes ts des igned to determine special education eligibility. The isolated adminis­tration of the WISC-Ill may serve to increase con­centration or reduce fatigue that, in turn , may alter lQ profiles.

Page 7: construct validity of the wisc-iii verbal and performance factors for

WISC-III Factor Structure

Table 4 Maximum Likelihood/ Direct-Oblimin Factor Loadings of the WISC-III for Black Special Education Students

Sub test

Picture Completion

Info nnation

Coding

Similarities

Picture Arrangement

Arithmetic

Block Design

Vocabulary

Object Assembly

Comprehension

Eigenvalue

% of variance accounted fo r

g loading

.72

.77

.48

.84

.68

.62

.65

.85

.63

.78

54.7

Rotated factors

Factor Factor 1 2

.22 .58*

.87* -.08

.12 .43*

.79* .09

.24 .52*

.54* .12

-.1 5 .92*

.86* .02

.03 .69*

.78* .03

5.47 1.02

50.5 6.4

Note. WISCIII = third edition of the Wechsler In telligence Scale for Children; g = general faclOr. *Significant factor loading.

The determination of test fairness is an ongoing process o f establi shin g empirical ev ide n ce tha t supports content, criterion, and construct valid ity. Both profession al and societal demands require that empirica l support b e coll ected to demon­strate comparable test validity across ethnic group populations. Future research should continue to examine the possible differential factor structure of the WISC-III ac ross other ethnic groups and spec ia l education classifications as well as with bilingual students. An increased knowledge of the interrelationships among these factors will be criti­ca l fo r p sych o logists who work with ethn ica lly diverse populations. Additionally, future research should begin to examine the predictive power of these indexes in forecasting academic achieveme nt across majority and minority populations.

References Blumbcl-g, T. A. (1995). A practitioner's view of the

WISC-III.Joumat of Sch.ool Psychology, 33, 95-97. Cattell , R. B. (1966). TIle scree lest for the number of

factors. Multivariate Behavioral Research, 1, 245-276.

Comrey. A. L. (1988). Factor-analytic methods of scale development in personality and clinical psychology. Journal of Consulting and Clinical PS)'c/wiogy, 56, 754-76 1.

Conger, A. J., Conger, J. C., Farrell , A. D. , & Ward, D. (1979). What can the WISC-R measure? Applied Psycho· logical Measurement , 3, 421-436.

Cronbach, L. J. (1990). Essentials of psychological testing (5 th edition). New York: Harper Collins.

Glutting, J. J. , Konold, T. R. , McDermott, P. A., Kush, J. C., & Watkins, M. W. (1996). Structure and diagnostic benefits of a normative sublest taxonomy developed f7'01n the WISC-III standardization sample. Manuscript submitted for publication.

Goh, D. S. , Teslow, C. J. , & Fuller, G. B. (198 1). The practice of psychological assessment among school psychol­ogists. Professional Psychology, 12, 696-706.

Gorsuch, R. L. (1983). Factor analysis (2 nd ed.). Hillsdale, NJ: Erlbaum.

Gutkin, T. B., & Reynolds, C. R. (1981). Factorial simi­larity of the WISC·R for White and Black children from the standardization sample. J ournal of Educational Psychology, 73, 227-231.

Kaiser, H. F. (1960). The applicatio n of electronic com· puters to factor analys is. Educational and Psychological Measurement, 20, 141·15 1.

Kaufman, A. 5., & Doppelt,J. (1976). Analysis ofWISC-R standardization data in terms of stratification variables. Child Development, 47, 165-171.

303

Page 8: construct validity of the wisc-iii verbal and performance factors for

Kush and Watkins

Kaufman, A. S., & Hollenback, G. P. ( 1974). Compara­tive structure of the WPPSI for Blacks and Whites. J ournal of Clinical Psychology, 30, 13 16- I 3 I 9.

Kaufman, A. S., & Kaufman, N. L. ( 1985). Manual fo r the Kaufman Test of Educalional Achievement-Comprehensive Form (K.T EA). Ci rcle Pines, MN: American Guidance Service.

Konold, T. R., Kush, J. C., & Canivez, G. L. (in press). Factol" J"cplication of the WISe-III in three indepe ndent samples of children rece iving special education. J ournal of Ps),choeducational Assessment

Kush, J. C. (1996). Facto r structure of the WISC-III fo r studen ts with learning disabilities. J ournal of Psyclwedu­cational Assessment, 14,32-40.

Lautenschlager, C. J. ( 1989). A comparison of alterna­tives to conducting Monte Carlo analyses fo r determining parallel a nalysis criteria. Multivariate Behavioral Research, 24,365-395

Lindsey, J. (1967). The fac tional organiza tion of intelli­gence in children as related to the valiables of age, sex, and subculture. Dissertation Abslmcls International, 27, 3664A-3665A.

Lutey, c. , & Copeland, E. P. (1982). Cogni tive assess­ment of the school-aged child. In C. R. Reynolds & T. B. GUlkin (Eds.), Th, handbook of school psychology (pp. 12 1-155). New York: Wiley.

Macmann, G. M., & Barnett, D. W. (1992). Redefining the WISC·R: Implications fo r pro fess ional prac tice and public policy. The j ournal of Special Education, 26, 139-16 1.

~1acmann , G. M. , & Barnell, D. W. (1994). Structural an alysis o f correlated fac tors: Lessons fro m the ve rbal·per· for m a n ce di c h oto m y of th e Wech sle r sca les. School Psychology Quarterly, 9, 16 1-I 97.

Norusis, M. J. (1994). SPSS 6. 1 base system tlSer's guide. Chicago: SPSS.

Oakland, T. , & Feigenbaum, D. ( 1979). Mul ti ple sources of test bias on the WISC·R and Bender·Gestalt T est. j ournal ofCon.mlting and Clinical Psychology, 47, 968-974.

Reschly, D. ( 1978). WISC·R fac tor s tructure amo ng Anglos, Blacks, Chicanos, and Native American Papagos. j ournal ofCo1lSulting and Clinical Ps)'chology, 46, 4 17-422.

Reschly, D. J. ( 198 I ). Psycho logical teSling in educa­tional classification and placement. American Psychologist, 36, 1094-1102.

Reynolds, C. R., & GUlkin, T. B. (1980). Stabili ty of the WISC·R factor stl"Ucture across sex at two age levels. j ournal of Clinical Psychology, 36, 775-777.

Reynolds, C. R., & Kaiser, S. M. ( 1990). Bias in assess­ment of aptitude. In C. R. Reynolds & R. W. Kamphaus (Eds.), Handbook of psychological and educational assessment of children: Intelligence and achievement (pp. 6 11 ·653). New York: Guilford PI·ess.

Ro id , G. A., Prifile r a , A. , & We iss, L. G. ( 1993). Replication of the WISC·III facto r structure in an inde· pe nde nt sample . j ournal of Psychoeduw tional Assessment, 11 , 6-2 1.

Sapp, G. L , Chisso l11, B., & Graham, E. ( 1985). Faclor analys is of the WISC-R for gi fted students: A replication and compalison. Ps)'chological Reports, 57, 947·951.

304

Sattler, J. M. (1992). Assessment of children: W1SC·JJJ alld WPPSI·R supplement. San Diego, CA: J erome SaLLler .

Slate, j. L. , & J ones, C. H. ( 1995). Prelimina'1' evidence o f the validity of the WISC·III fo r Afl'ican-American stu­d e n ts und e rgo in g sp ec ia l educa t io n eva lu at io n s. Educational and Psychological MeQ.S1lrement , 55, 1039· 1046.

Sullivan, P. M., & Schulte, L. E. (1992). Factor analysis o f WI SC· R wit h d eaf a n d h ard ·of·h ea rin g c hil dre n . Ps)'chological Assessment, 4, 537·540.

Taylo r , R. L. , Ziegler, E. W., & Parte nio, I. (1984). An investiga tio n o f WISC·R verbal-perfo rmance differe nces as a function o f ethnic status. Psychology in the Schools, 2 I , 437-44 I.

Thorndike , R. L. (197 1). Concepts of culture fa irness. j ournal of Educational lVleasurement, 8, 63-70.

Th orndike, R. L. ( 1992, March). Intelligence tests: What we have and what we should have. Pape r presented at the meet· ing of the Na tional Associa tion of School Psycho logists , Nashville, T N.

Thorndike, R. M. (1990). Would the real fac to rs of the Stanford·Binet fourth edition please come fon vard? j ournal of Ps),choeducational Assessment, 8, 4 12-435.

Ward, S. B., Ward, T. J. , Halt, C. V., Young, D. L. , & Mollner , N. R. (1995). The incidence a nd u tili ty of the ACID, ACIDS, and SCAD profiles in a I'efen 'ed population. Psychology in the Schools, 32, 267-276.

Wechsler, D. (1 949). Mamwl for the Wechsler Intelligence ScaleforChildren. New York: The Psychological Corporation.

Wechsler, D. (1974). Manual for the Wechsler Intelligence Scale for Children-Revised. San Antonio, TX: The Psychological Corporation.

Wechsle r , D. ( 198 I ). Manual for the Wechsler Adult Intelligence Scale-Revised. San Antonio, TX: The Psychological Corporation.

Wechsle r , D. (1989). Manual for the Wechsler Preschool and Primary Scale of Intelligence. San Antonio , T X: The Psychological Corporation.

Wechsler, D. (199 1). Manualfor the Wechslet' lnteUigence Scale for Children (3 rd cd.) . Sa n A nto ni o, T X: Th e Psycho logical Corporation.

WechslCl', D. (1992). Manualfor the Wechsler Individual Achievement Test. San An tonio , T X: Th e Psycho logical Corporation.

Wilt , J. C., & Gres h a m , F. M. ( 1985). Rev iew o f Wechsler Intelligence Scale fo r Chi ldren·Revised. In J. V. Mi tchell, Jr. (Ed.), The ninth mental measurement yearbook. ( Vo l. 2 , pp . 171 6· 171 9). Lin co ln , N E: U ni ve rs ity o f Nebraska Press.

Woodcock, R. W., & J ohnson, M. B. (1989). Mall1wlfor the Ps),cho·Educational Battery-Revised. Chicago: Riverside.

Zacha ry, R. A. (1 990). Wechsle r's in telligence scales: T h eo r e ti ca l a nd prac ti ca l co n sid e r at io n s. j ournal of PsychoeduClltional Assessment, 8, 276-289.