MAVACO PROJECT
PRESENTATION
Model of Analysis of Context Variable for the educational systems'evaluation
Principal Investigator: Jesús M. Jornet Meliá. (Universitat de València).
Ref. EDU2009-13485 of Ministry of Science and Innovation (projects I + D, announcement 2009)
Duration: 2011 - 2014
The evaluations of educational systems focus a lot on assessing what students learn (product variables). Normally, its utility limit is related to the little attention to the evaluation of the input, process and context variables. These last variables are measured by the so-called context questionnaires.
In the previous project (AVACO Ref. SEJ2005-05995) Project AVACO we could get to design questionnaires of context based on precise measurements of the variables that each audience could evaluate (teachers, students, families, school headmasters, school inspectors and specialists in diversity - counselors or psychologists). In plans of evaluation of Elementary and Secondary Educational Systems, we have established a set of tools optimized that allow us to approach the evaluation of input, process and context variables. Actually, these tools provide measurements for such type of indicators at a reasonable level of quality (reliability and validity), at the same time make possible that in the evaluations of systems we can approach with more security to the identification of variables allowing a better explication of the educational product.
However, its utility will increase to the extent that we reach:
- a) know how the system works, its strengths and weaknesses,
b) refine the base of variables and indicators according to the results obtained, and completing the omissions finded,
c) reduce elements maintaining the maximum levels of reliability andvalidity,
d) confirm the value-utility of the model as system of analysis to identify the education system's strengths and weaknesses, and
e) design report models accessible to the different audiences.
In this project (MAVACO Ref: EDU2099-1385), firstly it is expected to design a
model of evaluation of systems which could respond to the questions that the
audiences affected may be interested in, with the aim to increase the utility of this type of evaluation plans. For this purpose, it takes account of the interests of different audiences, just like the previous research (AVACO, Ref. SEJ2005-05995), in the design of model of evaluation of systhems. This model is based on the measurements developed in AVACO, so it will be reviewed in order to give itself a complete solution. Its explicative value is also analyzed from the confirmatory analysis. And finally, the models of report are developed, which are fit for different audiences as objects of this type of evaluative studies in a diversified way.
The purpose of the project is carrying on the process of evaluation research for designing a model of analysis of the educational quality. This process is based on a system of context questionnaires which is optimized at metric level. In this way itīs possible to improve the utility of the evaluations of systems.
The aim is be able to improve the way in which realize such evaluation and use the information. An essential condition for the configuration of this model is to provide maximum utility to the evaluation system. It's said, we should be aware of the questions that the diverse audiences involved expect that an evaluation of these features could respond them. Thus, although theories of education quality and the previous research on the problem should be considered, it should pay special attention to the questions of the evaluation. And they should be at the service of what the audience involved (managers and administrators of education, teachers and families) expecting an assessment could tell them. Realize an evaluation is meaningless if not provide information to improve the phenomenon evaluated.
