《语言测试基础ppt课件.ppt》由会员分享,可在线阅读,更多相关《语言测试基础ppt课件.ppt(38页珍藏版)》请在得力文库 - 分享文档赚钱的网站上搜索。
1、Language Testing Basic principles变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分2022-7-252nTo understand the need for test theory, it is first necessary to understand something about the fundamental nature ofmeasurement ,constructs, and psychological tests. 变电站电气主接线是指变电站的变压器、输电线
2、路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分2022-7-253What are they measuring?Height & weight?physical attributespsychological attributes变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分2022-7-254nUnlike physical attributes, the psychological attributes of an individual cannot
3、be measured directly as can height or weight. nThey are hypothetical concepts - products of the informed scientific imagination of social scientists who attempt to develop theories for explaining human behavior. nThe existence of such constructs can never be absolutely confirmed. nThe degree to whic
4、h any psychological construct characterizes an individual can only be inferred from observations of his or her behavior.变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分What is MeasurementnMeasurement in the social sciences is the process of quantifying the characteristics of pers
5、ons according to explicit procedures and rules.nQuantification: assign numbersnCharacteristics: physical and mental characteristics of persons (abilities/construct)nProcedures and rules: replicable, for other observers, in other contexts and with other individuals.变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而
6、完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分2022-7-256nA well-known classification of measurement scales is given by Stevens (1951). These measurement scales are: n1. the nominal scale On the nominal scale objects are classified according to a characteristic. An example: one can classify persons with respect t
7、o sex, hair color, etc. n2. the ordinal scale An ordinal scale comprises the numbering of different levels of an attribute that are ordered with respect to each other.Example: individuals are ranked first, second, third and so on. n3. the interval scale An interval scale is a numbering of different
8、levels in which the distances, or intervals, between the levels are equal.n4. the ratio scale The ratio scale has a natural origin as well as equal intervals. Length in meters and weight in kilograms are defined on a ratio scale; so is temperature on the Kelvin scale. Ratio scales are relatively rar
9、e in psychology because of the difficulty of defining a zero point. How would persons look like with zero intelligence? 变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分What is Test?nCarroll (1968): a psychological or educational test is a procedure designed to elicit certain beha
10、vior from which one can make inferences about certain characteristics of an individual.nBachman (1990): a test is a measurement instrument designed to elicit a specific sample of an individuals behavior.变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Characteristics that limit me
11、asurement (1/2)nLimitations in specificationTwo levels of specification:Theoretical level Operational level变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Characteristics that limit measurement (2/2)nLimitations in observation and quantificationindirectness IncompletenessImprecis
12、ion (ordinal instead of interval)Subjectivity (test developers choice of items & subjective scoring)Relativeness (no perfect norm of language use)Thus, a major of language test development is to minimize the effects of these limitations.变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重
13、要组成部分Classifying different types of language test (1/3)nIntended UseSelectionEntranceDiagnosticPlacementAchievementResearch 变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Classifying different types of language test (2/3)nContent Proficiency test (theory-based)Achievement test (
14、syllabus-based)Language aptitude test变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Classifying different types of language test (3/3)nFrame of reference Norm-referenced test (test results are interpreted with reference to the performance of a given group.) nTypical norms: mean,
15、 average score, standard deviation.Criterion test (syllabus-based)Difference: Discriminativeness变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分nStandard deviation and normal distributionMeasure of variability变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Tes
16、t qualitiesnReliability: consistency of measurement; minimize error variance变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分(Brown, 1996: 189)图示变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Test qualitiesnConstruct validity: to which extent we can interpret
17、a given test score as an indicator of the construct (ability)Reliability is a necessary but not sufficient condition for construct validity.变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Five types of validitynConstruct validityAn indication of how representative a test is of an
18、 underlying theory of language learning. Construct validation involves in investigation of the qualities that a test measures, thus providing a basis for the rationale of a test. nContent validityDescribes how well the content of the test samples the subject matter that the course of instruction aim
19、ed to teach.nPredictive validityThe degree to which predictions made from the test are confirmed by evidence gathered at some later time.nConcurrent validityConcerned with the relationship between what is measured by a test (usually a newly developed test) and another existing criterion measure, whi
20、ch may be a well-established standardized test. If the two measures function similarly (i.e. they rank candidates in the same way), they are considered to have concurrent validity.nFace validityThe degree to which a test appears to measure the knowledge or abilities it claims to measure, as judged b
21、y an untrained observer.变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Relationship between reliability and validity nIn order for a test to be valid, it first needs to be reliable.nInvestigation of reliability and validity can be viewed as complementary aspects of identifying,
22、estimating, and interpreting different sources of variance in test scores.nReliability is concerned with determining how much of the variance in test scores is reliable variance, while validity is concerned with determining what abilities contribute to this reliable variance.nAlthough it is essentia
23、l to consider both reliability and validity in the development and use of language tests, the distinction between them may not always be clear.图示变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Test qualitiesnAuthenticity: correspondence of the characteristics of a given language
24、test task to the features of a TLU task.nInteractiveness: the extent and type of involvement of the test takers individual characteristics in accomplishing a test task.test takers individual characteristics: language ability, topical knowledge and affect schema.nBoth are relative 变电站电气主接线是指变电站的变压器、输
25、电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分(Li, 1997: 175)变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Test qualitiesnImpact: impact on society, educational systems and the individuals within those systems.Micro level: individuals who are affected by a particular test.Ma
26、cro level: society and educational system.nPracticality: the ways in which the test will be implemented. Human resources , material resources, time变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Quality ControlSix qualities of usefulnessnReliabilitynConstruct validitynAuthenticit
27、ynInteractivenessnImpactnPracticality Goal: To achieve an appropriate balance among the qualities so that the overall usefulness of the test is maximized.变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Describing language ability: language use in language testsnCommunicative lang
28、uage ability model变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Characteristics of individual language usersCommunicative LanguageAbility变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Defining constructnCommunicative language ability nLanguage knowledgenStr
29、ategic competence (metacognitive strategies)变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Bachman (1990)变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分CommentnProvide an overall and updated picture of components of language abilitynLack of acknowledgement o
30、f the interactions between components.变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Strategic competencenGoal setting: deciding what one is going to donAssessment: taking stock of what is needed, what one has to work with, and how well one has done.nPlanning: deciding how to us
31、e what one hasnComment: lack of an operational instruction, thus hard to pin down the actual behavior.变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Other individual CharacteristicsnPersonal Characteristics: age, sex, native language, education,etc.nTopical knowledge: knowledge
32、structure in long-term memory.nAffective schemata: the affective or emotional correlates of topical knowledge.变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Features of communicative language testsnReflecting components of language use competence in particular contextsnAs repres
33、entative as possiblenClear purpose of testingnThe role of context being stressednAuthenticitynDirect and integrated testingnCriterion-referenced nHolistic and qualitative assessment of productive skillsnEstablishing the theoretical and empirical validity of measuresnEnhanced match between teaching,
34、testing and reality Cyril J. Weir (1990) 变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分nOverview of test development变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分Development of language testnDefine constructs theoreticallyThere must be agreement on the the
35、oretical definition upon which the test is based.nDefine constructs operationallynQuantifying observations: establish a scale变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分(Bachman & Palmer, 1996: 87)变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分变电站电气主接线是指变电站的变压器、输电线路怎样与电力系统相连接,从而完成输配电任务。变电站的主接线是电力系统接线组成中一个重要组成部分