Formative Assessment in Math

1. Introduction

When discourses of education are reduced to school level, the educational process can be divided into three steps: first is inputs such as teachers, students, management rules, curriculums, and parental anxiety, second is classroom situation where actual interaction of teaching and learning takes place, and the last is outcomes such as students’ competency, teachers’ job satisfaction, and test results. While investing more resources to inputs and evaluating outputs are objective and visible, handling or promoting intercourse between teachers and students varies in every classroom situation, which are because the inputs and outputs are quantitative and classroom situations are qualitative. Thus, responsibilities for dealing with the experiences each student goes through in school lies all on to teachers. Therefore, in order for educational processes to be effective, it is required that further interests are put upon, and adequate investments and aids are provided to every vital interaction that occurs in classroom between students and teachers, or that between students. Assessing students’ development undertaken by teachers, and by students themselves that provide information to be used as feedback to modify teaching and learning activities is referred to as formative assessment(Black and William, 2005). In contrast to the widely spread concept of effective teaching as achieving high standards measured by test outcomes, formative assessment more focuses on continuous development of each students which is locus of learning. Marking high rank in PISA(Programme for International Student Assessment) among OECD(Organization for Economic Cooperation and Development) countries, Korea has become prominent in mathematics for attaining high national standard. However, though it inspired other countries for its noticeable interests in education, the results acquired from the PISA does not lead to the conclusion that students in Korea develop their Mathematical competency in their school environments. Since it is quite common for Korean students to take Math courses in advance to those of public school curriculum, students’ performance cannot be attributed alone to the learning which took place in school. As a result, it is required, in the context of Korea, to analyze the effect of formative assessment, and to investigate how it affects students’ growth.

1.1. Formative Assessment

The “diagnostic use of assessment to provide feedback to teachers and students over the course of instruction is called formative assessment”(Boston, 2002). By facilitating students’ metacognition from which they learn how to self-assess(Shepard, 2005), it is a way of raising students achievement(Black and William, 2005; Steadman, 1998; Shepard, 2005). According to Steadman(1998, p.26), The objects for making use of formative assessment are 1) to obtain feedback on the effectiveness of and student satisfaction with teaching and classroom activities, 2) to improve teaching, 3) to monitor students’ learning, 4) to improve students’ learning (in terms of retention or learning skills), 5) to improve communication and collaboration with students. However, it can have negative effect on students’ involvement in classroom when students perceive assessment, or feedback, as reproach from teacher or indication of their lack of ability(Black and William, 2005; Steadman, 1998).

1.2. Teacher-Student Relationship

One of the advantages which teachers take from employing formative assessment is improvement in teacher student relationship(Steadman, 1998). Furthermore, in order for formative assessment to be formative, it is required that teachers and students interact and co-operate(Shepard, 2005).

1.3. Self-Efficacy

According to Bandura’s social cognitive theory, self-efficacy refers to one’s judgments of confidence to perform academic tasks or succeed in academic activities. Teacher-student relationship affects students’ self-efficacy(Hughs and Chen, 2011), and it affects their mathematics performance(Pajares and Graham, 1999).

1.4. Research Questions

  1. Does formative assessment have direct positive effect on students’ mathematics performance?
  2. Are there indirect effects of Teacher-Student Relationship and Self-Efficacy on students’ mathematics performance?

2. Method

2.1. Participants

“PISA is the OECD’s Programme for International Student Assessment. PISA measures 15-year-olds’ ability to use their reading, mathematics and science knowledge and skills to meet real-life challenges”(PISA, 2020). The data is retrieved from PISA 2018 dataset. Test subject is mathematics. Among 6650 Korean students who responded questionnaires, 176 students who dealt with the same mathematics test items were selected.

2.2. Variables

2.2.1. Self-Efficacy

CODE Question
ST188Q01HA I usually manage one way or another.
ST188Q02HA I feel proud that I have accomplished things.
ST188Q03HA I feel that I can handle many things at a time.
ST188Q06HA My belief in myself gets me through hard times.
ST188Q07HA When I’m in a difficult situation, I can usually find my way out of it.
  • scale
    • 1 - Strongly disagree
    • 2 - Disagree
    • 3 - Agree
    • 4 - Strongly agree

cronbach’s alpha is 0.7928646

2.2.2. Formative Assessment

CODE Question
ST102Q02TA The teacher asks questions to check whether we have understood what was taught
ST102Q04TA The teacher tells us what we have to learn.
ST104Q03NA The teacher tells me in which areas I can still improve.
ST152Q05IA The teacher encourages students to express their opinion about a text.
ST152Q08IA The teacher poses questions that motivate students to participate actively.
  • scale
    • 1 - Never or hardly ever
    • 2 - Some lessons
    • 3 - Most lessons
    • 4 - Every lesson

cronbach’s alpha is 0.8412273

2.2.3. Teacher - Student Relationship

CODE Question
ST100Q01TA The teacher shows an interest in every student’s learning.
  • scale
    • 1 - Never or hardly ever
    • 2 - Some lessons
    • 3 - Most lessons
    • 4 - Every lesson
CODE Question
ST211Q01HA The teacher made me feel confident in my ability to do well in the course.
ST211Q02HA The teacher listened to my view on how to do things.
ST211Q03HA I felt that my teacher understood me.
ST213Q01HA It was clear to me that the teacher liked teaching us.
  • scale
    • 1 - Strongly disagree
    • 2 - Disagree
    • 3 - Agree
    • 4 - Strongly agree

cronbach’s alpha is 0.8778682

2.2.4. Test Score

CODE Question
CM909Q01S Speeding Fines - Q01
CM909Q02S Speeding Fines - Q02
CM909Q03S Speeding Fines - Q03
CM949Q01S Roof Truss Design - Q01
CM949Q02S Roof Truss Design - Q02
DM949Q03C Roof Truss Design - Q03
CM00GQ01S Advertising Column - Q01
DM955Q01C Migration - Q01
DM955Q02C Migration - Q02
CM955Q03S Migration - Q03
DM998Q02C Bike Rental - Q02
CM998Q04S Bike Rental - Q04
CM905Q01S Tennis balls - Q01
DM905Q02C Tennis balls - Q02
CM919Q01S Fan Merchandise - Q01
CM919Q02S Fan Merchandise - Q02
CM954Q01S Medicine doses - Q01
DM954Q02C Medicine doses - Q02
CM954Q04S Medicine doses - Q04
CM943Q01S Arches - Q01
CM943Q02S Arches - Q02
DM953Q02C Flu test - Q02
CM953Q03S Flu test - Q03
DM953Q04C Flu test - Q04
  • Each question is scaled to have minimum value 0 and maximum value 1. Test score is sum of all questions listed above.

2.3. Analysis

2.3.1. Assumptions

  • Multivariate Outliers

Although 84th and 85th students are detected as possible outliers, after further speculation, it is concluded that their responds are relevant. And thus, included in the dataset.

  • Multicolinearity
Table 1: VIF of indicators
VIF
ST188Q01HA 1.665218
ST188Q02HA 1.494113
ST188Q03HA 1.703493
ST188Q06HA 2.487392
ST188Q07HA 2.115592
ST102Q02TA 2.201015
ST102Q04TA 2.193358
ST104Q03NA 2.247407
ST152Q05IA 2.582861
ST152Q08IA 2.857225
ST100Q01TA 2.234325
ST211Q01HA 3.172893
ST211Q02HA 3.155188
ST211Q03HA 3.528254
ST213Q01HA 2.117494
Sum 1.177941

Since all of the VIF values are less than 10, there is no multicolinearity detected.

2.3.2. Hypothesized Model

  • Mediation model using structural equation modeling.
    • Model
#add image
# blogdown:::insert_image_addin() 


3. Result

3.1. Effect of Formative Assessment on Test Score

Model fits the data since \(\chi^2\) statistic does not reject the null hypothesis. Also, other model fit indices, i.e., RMSEA, CFI, and SRMR, satisfies the rule of thumb. The effect of “Formative Assessment” on “Test Score” is statistically significant with regression coefficient 1.749 with standard error 0.890.

3.2. Mediation Analysis

  • Factor Loadings

  • Model Coefficients

When Mediators “Teacher-Student Relationship” and “Self-Efficacy” are add in the model, both direct effect and indirect effect became non-significant; coefficient from “Formative Assessment” to “Test Score” being 0.922 with standard error 0.946, and Sobel test statistic for indirect effect being 0.0768513.

  • Model Fit Indices

Since some correlation between indicators from different factors were not fully explained by measurement model, the model fit was poor;\(\chi^2\) value being 263.116 with p-value \(\ngtr\) 0.05, RMSEA 0.096 \(\nless\) 0.08, CFI 0.879 \(\ngtr\) 0.95, and SRMR 0.093 \(\nless\) 0.08.

  • Mediation Model Diagram

4. Discussion

In the analysis which has proceeded without mediators, although it was statistically significant, the effect of “Formative Assessment” on “Test Score” was weak. This result reinforces existing studies that formative assessment is not powerful itself to affect on mathematical performance(Pinger et.al., 2018), rather it is effective in assistance of cognitive activation(Yi & Lee, 2017). In mediation analysis, direct effect of “Formative Assessment” on “Test Score” was 0.922 with standard error 0.946, and indirect effect of “Formative Assessment” on “Test Score” was 0.3711883. This results \[{The Mediation Proportion}=\frac{Indirect Effect}{Total Effect}=0.2818035\]. Therefore there is no mediation effect in this model, which does not support those from exsisting studies.

5. Limitations and Future Directions

Since the effect of Formative Assessment on students’ math performance, further studies are required. Effects of formative assessment on test score in other test subjects need to be compared with this study in order to draw meaningful conclusion. In addition, efforts for discovering some mediators or latent variables which account for test score in Mathematics needs to be proceeded. Lastly, it needs to be investigated whether there is interaction between students’ academic competency and formative assessment on test score, which can be found in longitudinal studies.

Reference

  • Black, P., & Wiliam, D. (2005). Inside the black box: Raising standards through classroom assessment. Granada Learning.

  • Boston, C. (2002). The concept of formative assessment. Practical Assessment, Research, and Evaluation, 8(1), 9.

  • Fast L. A., Lewis J. L., Bryant M. J., Bocian K. A., Cardullo R. A., Rettig M., & Hammond K. A. (2010). Does math self-efficacy mediate the effect of the perceived classroom environment on standardized math test performance?. Journal of Educational Psychology. 102(3). 729-740.

  • Hughes, J. N., & Chen, Q. (2011). Reciprocal effects of student–teacher and student–peer relatedness: Effects on academic self efficacy. Journal of applied developmental psychology, 32(5), 278-287.

  • Pajares, F., & Graham, L. (1999). Self-efficacy, motivation constructs, and mathematics performance of entering middle school students. Contemporary educational psychology, 24(2), 124-139.

  • Pinger P., Rakoczy K., Besser M., & Klieme E.. (2018). Implementation of formative assessment – effects of quality of programme delivery on students’ mathematics achievement and interest. Assessment in Education: Principles, Policy & Practice. 25(2). 160-182.

  • PISA (2020, June, 20). What is PISA?. https://www.oecd.org/pisa/

  • Shepard, L. A. (2005). Linking formative assessment to scaffolding. Educational leadership, 63(3), 66-70.

  • Yi H. S., & Lee Y. (2017). A latent profile analysis and structural equation modeling of the instructional quality of mathematics classrooms based on the PISA 2012 results of Korea and Singapore. Asia Pacific Education Review. 18(1). 23-39.

<