Abstracts
Abstract
Following PISA 2000, Switzerland launched a project called HarmoS (Harmonization of obligatory School) to develop binding education standards for compulsory education in the three language regions of the country. These standards for four subject areas are based on models of competence. Part of the development is an empirical study to validate these competence models. The present article describes the design, methods, and some results of this validation study. It also discusses the study’s usefulness for defining the standards and the consequences of some methodological choices, particularly the heuristic application of the Rasch model.
Keywords:
- Validity,
- competence,
- education standards,
- Rasch model,
- dimensionality,
- differential item functioning
Résumé
À la suite de PISA 2000, la Suisse développe des standards de formation contraignants pour la scolarité obligatoire dans les trois régions linguistiques (projet HarmoS: Harmonisation de la scolarité obligatoire). Ces standards pour quatre sujets sont basés sur des modèles de compétence. Une partie du développement consiste en une étude empirique visant à valider ces modèles de compétence. Le présent article décrit la conception, les méthodes et certains résultats de cette étude de validation. Il traite aussi de l’utilité de l’étude dans l’optique d’une définition des standards ainsi que des conséquences de certains choix méthodologiques, en particulier la façon heuristique d’appliquer le modèle de Rasch.
Mots-clés :
- Validité,
- compétence,
- standards de formation,
- modèle de Rasch,
- dimensionnalité,
- fonctionnement différentiel d’items
Resumo
Na sequência de PISA 2000, a Suíça desenvolveu referenciais normativos de formação para o ensino obrigatório nas três regiões linguísticas (Projecto HarmoS: Harmonização da escolaridade obrigatória). Estes referenciais para quatro domínios são baseados nos modelos de competências. Parte do desenvolvimento consistiu num estudo empírico para validar esses modelos de competências. O presente artigo descreve a concepção, os métodos e certos resultados deste estudo de validação. Trata também da utilidade do estudo na óptica de uma definição de referenciais, bem como as consequências de certas escolhas metodológicas, em particular o modo heurístico de aplicar o modelo de Rasch.
Palavras chaves:
- Validade,
- competência,
- referenciais de formação,
- modelo de Rasch,
- dimensionalidade,
- funcionamento diferencial de itens
Download the article in PDF to read it.
Download
Appendices
References
- Andrich, D. (2004). Controversy and the Rasch model: A characteristic of incompatible paradigms? In E.V. Smith & R.M. Smith (Eds.), Introduction to Rasch measurement (pp. 143-166). Maple Grove, MN: JAM Press.
- Asendorpf, J.B. (1995). Persönlichkeitspsychologie: Das empirische Studium der individuellen Besonderheit aus spezieller und differentieller Perspektive. Psychologische Rundschau, 46, 235-247.
- Brennan, R.L. (2006). Perspectives on the evolution and future of educational measurement. In R.L. Brennan (Ed.), Educational measurement (4th ed., pp. 1-16). Westport, CT: American Council on Education.
- Brunner, M., & Süss, H.-M. (2007). Wie genau können kognitive Fähigkeiten gemessen werden? Die Unterscheidung von Gesamt- und Konstruktreliabilitäten in der Intelligenzdiagnostik für den Berliner Intelligenzstrukturtest. Diagnostica, 53, 184193.
- De Pietro, J.-F., Müller, R., & Wirthner, M. (2007). HarmoS-L1: vers des standards de base pour la langue de scolarisation - In Richtung Basisstandards im Bereich der Schulsprache. Babylonia, 15 (4), 40-52.
- EDK/CDIP (2005). Harmonization of obligatory school in Switzerland: the most important projects. Facts - sheet. Bern: Schweizerische Konferenz der kantonalen Erziehgunsdirektoren (EDK/CDIP).
- Embretson, S.E., & Reise, S.P. (2000). Item response theory. Mahwah, NJ: Lawrence Erlbaum.
- Griffin, P. (2007). The comfort of competence and the uncertainty of assessment. Studies in Educational Evaluation, 33, 87-99.
- HarmoS Konsortium Mathematik. (2007). Kompetenzmodell HarmoSMathematik. Papier 4. Bern: Schweizerische Konferenz der kantonalen Erziehungsdirektoren (EDK/CDIP).
- Klieme, E., Avenarius, H., Blum, W., Döbrich, P., Gruber, H., Prenzel, M., et al. (2003). Zur Entwicklung nationaler Bildungsstandards. Expertise. Bonn: Bundesministerium für Bildung und Forschung (BMBF).
- Kolen, M.J. (2006). Scaling and norming. In R.L. Brennan (Ed.), Educational measurement (4th ed., pp. 155-186). Westport, CT: American Council on Education.
- Kubinger, K.D., & Draxler, C. (2007). Probleme bei der Testkonstruktion nach dem RaschModell. Diagnostica, 51, 131-142.
- Mazzeo, J., Lazer, S., & Zieky, M.J. (2006). Monitoring educational progress with groupscore assessments. In R. L. Brennan (Ed.), Educational measurement (4111 ed., pp. 681-699). Westport, CT: American Council on Education.
- National Research Council (2001). Knowing what students know: The science and design of educational assessment. Washington, DC: National Academy Press.
- Network-A/INES/OECD (2004). Review of assessment activities. Network A newsletter, issue 16. Washington, DC: National Center for Education Statistics (NCES).
- OECD (2005). PISA 2003. Technical report. Paris: OECD.
- Ramseier, E., & Moreau, J. (2007). Stichprobendesign und Gewichtung in der HarmoS- Validierungsstudie. Bern: Schweizerische Konferenz der kantonalen Erziehgunsdirektoren (EDK/CDIP).
- Renaud, A. (2006). Harmonisation de la scolarité obligatoire en Suisse (HarmoS). Design général de l’enquête et échantillon des écoles. Neuchâtel: Office fédéral de la statistique.
- Rost, J. (2004). Psychometrische Modelle zur Überprüfung von Bildungsstandards anhand von Kompetenzmodellen. Zeitschrift für Pädagogik, 50, 662-678.
- Scheerens, J., Glas, C., & Thomas, S.M. (2003). Educational evaluation, assessment, and monitoring. A systemic approach. Lisse: Swets & Zeitlinger.
- Tristan, A. (2006). An adjustment for sample size in DIF analysis. Rasch Measurement Transactions, 20, 1070-1071.
- Weinert, F.E. (2001). Concept of competence: A conceptual clarification. In D.S. Rychen & L.H. Salganik (Eds.), Defining and selecting key competencies (pp. 45-65). Göttingen: Hogrefe & Huber.
- Wright, B.D., & Linacre, J.M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8, 370.
- Wu, M.L., Adams, R.J., Wilson, M.R., & Haldane, S. (2007). ACER ConQuest version 2. Generalised item response modelling software. Melbourne: ACER Press.
- Yen, W.M., & Fitzpatrick, A.R. (2006). Item response theory. In R.L. Brennan (Ed.), Educational measurement (4th ed., pp. 111-153). Westport, CT: American Council on Education.
- Zieky, M., & Perie, M. (2006). A primer on setting cut scores on tests of educational achievement. Princeton, NJ: Educational Testing Service.