{"id":2834,"date":"2021-04-27T11:51:44","date_gmt":"2021-04-27T10:51:44","guid":{"rendered":"http:\/\/empirijskaistrazivanja.org\/?page_id=2834"},"modified":"2021-04-27T12:04:21","modified_gmt":"2021-04-27T11:04:21","slug":"international_testing","status":"publish","type":"page","link":"http:\/\/empirijskaistrazivanja.org\/en\/international_testing\/","title":{"rendered":"INTERNATIONAL ASSESSMENT OF EDUCATIONAL PROGRESS: FROM THE FIRST TRIAL TO THE SECONDARY ANALYSES"},"content":{"rendered":"<p>Introduction by: Marina Videnovi\u0107<\/p>\n<hr \/>\n<p><span style=\"font-weight: 400;\">THE HAPPIER THE BETTER ACHIEVER OR NOT? EXPLORING THE CONNECTION BETWEEN STUDENTS&#8217; ACHIEVEMENT AND WELL-BEING: PISA 2018 SURVEY<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u00a0<\/span><\/p>\n<p><b>Kristina Duki\u0107<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Department of psychology, Laboratory for Developmental psychology, Faculty of Philosophy, University of Belgrade | <\/span><i><span style=\"font-weight: 400;\">kristinadukic8@gmail.com<\/span><\/i><\/p>\n<p><b>Barbara Bla\u017eanin<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Department of psychology, Laboratory for Developmental psychology, Faculty of<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Philosophy, University of Belgrade<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">Results from PISA 2018 survey showed a curvilinear relationship between students\u2019 reading performance and their subjective well-being (increasingly positive until a certain point, after which as well-being continues to increase performance decreases).\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Study had 2 aims: 1. Test if the curvilinear relationship is present among Serbian students. 2. Explore if self-efficacy, fear of failure and attitude towards learning differentiate the most satisfied but lower performing students from less satisfied but higher performing ones. The sample consisted of 5359 Serbian students who participated in PISA 2018 by taking the reading literacy test and background questionnaire that explored students\u2019 subjective well-being and school experience.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Three groups are defined based on composite score \u201csubjective well-being\u201d that consisted of life satisfaction, meaning in life and positive feelings: 1. the least satisfied 2. moderately satisfied 3. the most satisfied. We hypothesized that the group of students who are the least and moderately satisfied would have the highest performance while those who are the most satisfied would have the lowest performance. ANOVA showed statistically significant differences (<\/span><i><span style=\"font-weight: 400;\">F<\/span><\/i><span style=\"font-weight: 400;\">(2, 5359)= 19.494, <\/span><i><span style=\"font-weight: 400;\">p<\/span><\/i><span style=\"font-weight: 400;\">&lt; .001) and Post Hoc test revealed that students who are the least and moderately satisfied have better performance than those who are highly satisfied (<\/span><i><span style=\"font-weight: 400;\">p<\/span><\/i><span style=\"font-weight: 400;\">&lt; .001), thus confirming hypothesis.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For the second aim of the study, discriminant analysis was conducted. We expected that students with the highest satisfaction and low performance would have better self-efficacy and lower fear of failure, but also that they would value school less compared to students with lower or moderate satisfaction and higher performance. Discriminant analysis revealed one discriminant function (<\/span><i><span style=\"font-weight: 400;\">L<\/span><\/i><span style=\"font-weight: 400;\"> = 0.78, \u03c7<\/span><span style=\"font-weight: 400;\">2<\/span><span style=\"font-weight: 400;\">(10,4879)= 1213.703, <\/span><i><span style=\"font-weight: 400;\">p<\/span><\/i><span style=\"font-weight: 400;\">&lt; .001), that explained 99.6% of variance, canonical R<\/span><span style=\"font-weight: 400;\">2<\/span><span style=\"font-weight: 400;\">=.22. Discriminant function is best at differentiating the most satisfied students from the least satisfied students. Structure matrix showed that the most satisfied students have higher self-efficacy (r=.80) and lower fear of failure (r=-.36). But contrary to our assumption, this group also has a better attitude towards learning (r=.57) and trying hard (r=.58) at school than the less satisfied but better performing students. Further investigation is needed in order to understand which factors prevent the most satisfied students from performing like their less satisfied but more successful peers.\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><b>Keywords<\/b><span style=\"font-weight: 400;\">: PISA 2018, reading literacy, well-being, student\u2019s beliefs, school valuing\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<hr \/>\n<p><span style=\"font-weight: 400;\">PREDICTING ACADEMIC OVERACHIEVEMENT USING QUALITY OF SOCIAL CONNECTIONS AND PERSONAL WELL-BEING: PISA 2018 STUDY<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><b>Nevena Stoji\u0107<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Department of psychology, Laboratory for Developmental psychology, Faculty of Philosophy, University of Belgrade | <\/span><i><span style=\"font-weight: 400;\">nevenastojic6@gmail.com<\/span><\/i><\/p>\n<p><b>Milica Arnautovi\u0107<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Department of psychology, Laboratory for Developmental psychology, Faculty of<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Philosophy, University of Belgrade<\/span><\/p>\n<p><b>Marina Videnovi\u0107<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Department of psychology, Laboratory for Developmental psychology, Faculty of<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Philosophy, University of Belgrade<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">Results from the PISA survey throughout the years show that there is a bond between students\u2019 index of economic, social and cultural status (ESCS) and their academic achievement. To shed light on variables that mediate that relationship, we analyzed data from the PISA 2018 survey. The sample included 6609 15-year-old high school students in Serbia. To examine what makes students&#8217; achievement differ from the expected based on their ESCS, we subtracted predicted values in reading competency (ESCS predictor) from students&#8217; actual achievement. Thus, we created a new variable \u2013 level of overachievement, which was used as a criterion for multiple linear regressions. As mediators we tested 1) students&#8217; perception of relationships with parents and teachers, 2) students&#8217; well-being and self-concept and 3) growth mindset. The first regression included predictors measuring aspects of students\u2019 perception of relationships with parents and teachers: social connection with parents, parents&#8217; emotional support, teacher&#8217;s interest, teacher support in test language lessons, disciplinary climate, teacher feedback, teacher-directed instructions and teacher stimulation of reading engagement. The regression model was significant (<\/span><i><span style=\"font-weight: 400;\">R<\/span><\/i><span style=\"font-weight: 400;\">2<\/span><span style=\"font-weight: 400;\">\u00a0= .125,\u00a0<\/span><i><span style=\"font-weight: 400;\">F<\/span><\/i><span style=\"font-weight: 400;\">(8, 3876) = 69.367,\u00a0<\/span><i><span style=\"font-weight: 400;\">p<\/span><\/i><span style=\"font-weight: 400;\">\u00a0&lt; .001)<\/span><span style=\"font-weight: 400;\">, and all variables were significant predictors (p&lt;.001 all, except teacher support: p&lt;.01). The second regression included variables referring to students\u2019 well-being and self-concept: work mastery, self-concept of reading competence, perceived difficulty of reading, self-efficacy, general fear of failure, attitude towards school, sense of belonging and a variable that consists of a sum of general life satisfaction, meaning in life and positive affect. This regression model was significant as well (<\/span><i><span style=\"font-weight: 400;\">R<\/span><\/i><span style=\"font-weight: 400;\">2<\/span><span style=\"font-weight: 400;\">\u00a0= .111,\u00a0<\/span><i><span style=\"font-weight: 400;\">F<\/span><\/i><span style=\"font-weight: 400;\">(8, 4693) = 73.328,\u00a0<\/span><i><span style=\"font-weight: 400;\">p<\/span><\/i><span style=\"font-weight: 400;\">\u00a0&lt; .001)<\/span><span style=\"font-weight: 400;\">, and all variables except self-efficacy were significant predictors (p&lt;.001 all, except attitude towards school and sense of belonging: p&lt;.05). Surprisingly, variables measuring attitude towards school and subjective well-being had negative values of b ponder. Finally, we explored the differences in level of overachievement between students with a fixed and growth mindset. The t-test was also significant (<\/span><i><span style=\"font-weight: 400;\">t<\/span><\/i><span style=\"font-weight: 400;\">(5818,85) = 8.554, <\/span><i><span style=\"font-weight: 400;\">p <\/span><\/i><span style=\"font-weight: 400;\">&lt; .001), suggesting that students with a growth mindset have a higher level of overachievement. This paper highlights the importance of positive social connections for achievement, but also raises alarm about the well-being and self-concept of overachievers.<\/span><\/p>\n<p><b>Keywords<\/b><span style=\"font-weight: 400;\">: PISA study, ESCS, overachievement, social connections, well-being<\/span><\/p>\n<hr \/>\n<p><span style=\"font-weight: 400;\">SOCIO-EMOTIONAL SKILLS IN PISA-BASED TEST FOR SCHOOLS<\/span><\/p>\n<p><b>Tanja Bastianic<\/b><\/p>\n<p><i><span style=\"font-weight: 400;\">OECD | <\/span><\/i><a href=\"mailto:tanja.bastianic@oecd.org\"><i><span style=\"font-weight: 400;\">tanja.bastianic@oecd.org<\/span><\/i><\/a><span style=\"font-weight: 400;\">\u00a0<\/span><\/p>\n<p><b>Tiago Fragoso<\/b><\/p>\n<p><i><span style=\"font-weight: 400;\">OECD | <\/span><\/i><a href=\"mailto:tiago.fragoso@oecd.org\"><i><span style=\"font-weight: 400;\">tiago.fragoso@oecd.org<\/span><\/i><\/a><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">The PISA-based Test for Schools (PBTS) is the OECD international school-based assessment that measures 15-year-old students\u2019 abilities to think critically, solve problems and communicate effectively in the cognitive areas of reading, mathematics and science. The student questionnaire also collects information on students\u2019 attitudes towards learning and their school\u2019s learning environment, as well as their socio-economic background and their social and emotional skills.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Through the analysis of PBTS data, this paper aims to provide some information on student\u2019s cognitive skills, their engagement and feelings with a special focus on social and emotional skills. Since 2019, the PBTS student questionnaire incorporates 40 items on students\u2019 social and emotional skills from the OECD\u2019s Study on Social and Emotional Skills.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The Survey assesses five broad emotional sub-domains, of which the PBTS incorporated one skill for each of the five sub-domains: Optimism for emotional regulation, Assertiveness for engaging with others, Empathy for collaboration, Self-control for task performance, and Curiosity for open-mindedness.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Data from four countries (Brazil, Russian Federation, Spain and the US) students were collected in 2019 and 2020 as a part of the PBTS project.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Results at school level are reported in two ways:\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">1) average scores for each of the five sub-domains, on a nationally standardized scale, where higher values indicate higher levels of each skill.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">2) association measures between each sub-domain score and school environment (measured by the index of classroom disciplinary climate), student perceived health and student overall life satisfaction<\/span><\/p>\n<p><span style=\"font-weight: 400;\">These relationships are analysed after controlling for the effect of students\u2019 socio-economic status and other demographic differences.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The data shows positive correlation between all five sub-domains and school environment with the highest correlation for Optimism and Self-control. Similarly, the association is significant and positive for five sub-domains and students perceived health and life satisfaction with the highest significantly positive correlation between Optimism and students\u2019 life satisfaction.<\/span><\/p>\n<p><b>Keywords<\/b><span style=\"font-weight: 400;\">: PISA, socio-emotional skills<\/span><\/p>\n<hr \/>\n<p><span style=\"font-weight: 400;\">TIMSS 2019 IN SERBIA: THROUGH THE LENS OF SDG 4<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><b>Ivana \u0110eri\u0107<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Institute for Educational Research, Belgrade| <\/span><i><span style=\"font-weight: 400;\">ivana.brestiv@gmail.com\u00a0<\/span><\/i><\/p>\n<p><b>Nada \u0160eva<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Institute for Educational Research, Belgrade<\/span><\/p>\n<p><b>Smiljana Jo\u0161i\u0107<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Institute for Educational Research, Belgrade<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">UNESCO&#8217;s 2030 Agenda for sustainable development in the field of education aims at &#8220;ensuring inclusive and equitable quality education and promote lifelong learning opportunities for all\u201d <\/span><a href=\"https:\/\/en.unesco.org\/themes\/education2030-sdg4\/timeline\"><span style=\"font-weight: 400;\">by 2030<\/span><\/a><span style=\"font-weight: 400;\">. The paper discusses main findings of the TIMSS 2019 study in Serbia through the lens of the UNESCO&#8217;s Sustainable Development Goal 4 (SDG 4), more specifically targets 4.2., 4.5 and 4.c. The SDG 4 target 4.2 defines &#8220;equal access to quality early childhood development, care and pre-primary education so that they are ready for primary education&#8221;. Results from TIMSS 2019 show that the coverage of children attending a preschool program &#8220;3 years or more&#8221; has increased by 9% compared to the previous 2015 TIMSS cycle. In addition, the positive relationship between years of attending the preschool education and higher average achievement in mathematics and science of 4<\/span><span style=\"font-weight: 400;\">th<\/span><span style=\"font-weight: 400;\"> graders in Serbia was demonstrated. TIMSS 2019 data for Serbia also provide some insights on home learning resources relevant for SDG 4 target 4.5., aimed at establishing equal access to all levels of education for the children from vulnerable groups as well as to diminish gender disparities. A difference of 187 points on average in students&#8217; achievement in mathematics and science was observed between those who have many resources (MAT: 574; SCI: 576) and those who do not have enough of them (MAT: 387; SCI: 389). In Serbia, a statistically significantly higher number of 4<\/span><span style=\"font-weight: 400;\">th<\/span><span style=\"font-weight: 400;\"> grade students with many home learning resources reach low international benchmark of 400 points (99%), compared to peers who have less home learning resources (44%).The SDG 4.c target refers to the increase the percentage of teachers who will dedicate a larger number of hours of in-service training in different areas of mathematics and science. When it comes Serbia, professional development (PD) in the fields of mathematics and science is at relatively low level in comparison to international average. Number of teachers of the 4<\/span><span style=\"font-weight: 400;\">th<\/span><span style=\"font-weight: 400;\"> grade students in Serbia who spent less than 6 hours or none in math and science related PD is high (38% for mathematics and 48% for science). The future PD needs expressed by teachers are in line with the current trends regarding the use of ICT in the field of education, especially in the context of COVID 19 pandemic. The data from TIMSS 2019 allow for policy makers to develop evidence-based strategies in order to accomplish presented SDG 4 targets, especially in the context of the current reforms of educational system in Serbia.\u00a0<\/span><\/p>\n<p><b>Keywords<\/b><span style=\"font-weight: 400;\">: TIMSS 2019, Sustainable Development Goal, Serbia, quality of education, evidence-based policies.\u00a0 <\/span><\/p>\n<hr \/>\n<p><b>TRENDS IN MATHEMATICS ACHIEVEMNET IN THE 4<\/b><b>TH<\/b><b> GRADE OF PRIMARY SCHOOOL: TIMSS 2019 IN SERBIA\u00a0<\/b><\/p>\n<p>&nbsp;<\/p>\n<p><b>Nada \u0160eva<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Institute for Educational research, Belgrade <\/span><span style=\"font-weight: 400;\">| <\/span><i><span style=\"font-weight: 400;\">nadaseva@gmail.com\u00a0<\/span><\/i><\/p>\n<p><b>Smiljana Jo\u0161i\u0107<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Institute for Educational research, Belgrade<\/span><\/p>\n<p><b>Ivana \u0110eri\u0107<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Institute for Educational research, Belgrade<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">Monitoring of changes in students achievement is important in a twofold way: it represents one of the main indicators of impact of current educational policies, at the same time providing information of further steps when it comes to the possible changes in teaching practices and other systemic changes. This paper presents trends in mathematics achievement of the 4th grade primary school students attained in three research cycles of TIMSS in Serbia: TIMSS 2011, TIMSS 2015 and TIMSS 2019.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The main finding from TIMSS 2019 indicates a significant drop in average mathematical achievement by 10 points in comparison to TIMSS 2015 (508 vs. 518 points). Serbian students in TIMSS 2019 maintained on average to be at the level of intermediate international benchmark, same as in previous TIMSS cycles. However, the observed lower achievement resulted in significant change in distribution of the students across different benchmarks, with significantly lower percentages in advance and high level benchmarks. Results across different content and cognitive domains showed that the difference between TIMSS 2019 and TIMSS 2015 was mainly due to the 28 points difference in content domain <\/span><i><span style=\"font-weight: 400;\">Data<\/span><\/i><span style=\"font-weight: 400;\"> (489\/TIMSS 2019 vs. 518\/TIMSS 2015). In addition, there is a significant decline in TIMSS 2019 for cognitive domains <\/span><i><span style=\"font-weight: 400;\">Application of knowledge<\/span><\/i><span style=\"font-weight: 400;\"> (509\/TIMSS 2019 vs. 521\/TIMSS 2015), as well as <\/span><i><span style=\"font-weight: 400;\">Reasoning <\/span><\/i><span style=\"font-weight: 400;\">(503\/TIMSS 2019 vs. 517\/ TIMSS 2015 vs. 514\/ TIMSS 2011).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The observed results will be discussed in the context of relation between three levels of curriculum foreseen within TIMSS framework: intended curriculum (which topics are planned to be thought at the systemic level), implemented curriculum (which topics are taught before or during the year of testing) and attended curricula (which topics students learned). For example for content domain <\/span><i><span style=\"font-weight: 400;\">Data<\/span><\/i><span style=\"font-weight: 400;\">, teachers in TIMSS 2019 reported lower percentages of students that were <\/span><i><span style=\"font-weight: 400;\">Not yet taught or just introduced<\/span><\/i><span style=\"font-weight: 400;\"> to the certain topics in comparison to previous cycle (implemented curriculum). However students in TIMSS 2019 had lower number of correct answers for several tasks repeated in two cycles from <\/span><i><span style=\"font-weight: 400;\">Application of knowledge domain<\/span><\/i><span style=\"font-weight: 400;\"> (attended curriculum), indicating that attention of teachers should be oriented towards higher cognitive domains. Insights from this level of the analysis will provide policy-relevant information to help improve mathematics teaching and learning in the context of the first cycle of education in Serbia.<\/span><\/p>\n<p><b>Keywords<\/b><span style=\"font-weight: 400;\">: TIMSS 2019, trends, mathematics achievements, primary school<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Introduction by: Marina Videnovi\u0107 THE HAPPIER THE BETTER ACHIEVER OR NOT? EXPLORING THE CONNECTION BETWEEN STUDENTS&#8217; ACHIEVEMENT AND WELL-BEING: PISA 2018 SURVEY \u00a0 Kristina Duki\u0107 Department of psychology, Laboratory for Developmental psychology, Faculty of Philosophy, University of Belgrade | kristinadukic8@gmail.com Barbara Bla\u017eanin Department of psychology, Laboratory for Developmental psychology, Faculty of Philosophy, University of Belgrade [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-2834","page","type-page","status-publish","hentry"],"translation":{"provider":"WPGlobus","version":"2.12.2","language":"en","enabled_languages":["rs","en"],"languages":{"rs":{"title":true,"content":true,"excerpt":false},"en":{"title":true,"content":true,"excerpt":false}}},"_links":{"self":[{"href":"http:\/\/empirijskaistrazivanja.org\/en\/wp-json\/wp\/v2\/pages\/2834"}],"collection":[{"href":"http:\/\/empirijskaistrazivanja.org\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/empirijskaistrazivanja.org\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/empirijskaistrazivanja.org\/en\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"http:\/\/empirijskaistrazivanja.org\/en\/wp-json\/wp\/v2\/comments?post=2834"}],"version-history":[{"count":3,"href":"http:\/\/empirijskaistrazivanja.org\/en\/wp-json\/wp\/v2\/pages\/2834\/revisions"}],"predecessor-version":[{"id":2840,"href":"http:\/\/empirijskaistrazivanja.org\/en\/wp-json\/wp\/v2\/pages\/2834\/revisions\/2840"}],"wp:attachment":[{"href":"http:\/\/empirijskaistrazivanja.org\/en\/wp-json\/wp\/v2\/media?parent=2834"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}