The Reliability Analysis for Force Concept Inventory

Authors

  • Mazlena Binti Murshed Ministry of Education, Pusat Pentadbiran Kerajaan Persekutuan, Putrajaya, Malaysia. Author
  • Fatin Aliah Phang Centre for Engineering Education, Universiti Teknologi Malaysia, Malaysia. Author
  • Muhammad Abd Hadi Bin Bunyamin School of Education, Faculty of Social Sciences and Humanities, Universiti Teknologi Malaysia, Malaysia. Author
  • Ibnatul Jalilah Binti School of Education, Faculty of Social Sciences and Humanities, Universiti Teknologi Malaysia, Malaysia. Author

DOI:

https://doi.org/10.61841/f5vf4682

Keywords:

Force Concept Inventory (FCI), Pilot Study, Testing, Rasch Stochastic Model, Force, Motion

Abstract

Force Concept Inventory (FCI) is a diagnostic test that is commonly used to measure the concept of knowledge based on force and motion. This study examines the validity and reliability of FCI using a new item analysis method. The Rasch Measurement Model (RMM) enables the construction of linear scales for individuals (persons) and items from raw test scores. This model can provide valuable insights into the structure and function of the test regarding the difficulty distribution of the test item. It can also predict to what extent it fits the model, and the items can also determine its basic structure. The data for Rasch’s analysis were obtained from a pilot study involving 78 high school students (16 to 17 years old) who took a physics subject. The reliability of FCI items is high, and it is proven that it can measure conceptual understanding. Thus, this test can determine the level of conceptual understanding of force and motion. 

Downloads

Download data is not yet available.

References

[1] Adibah, A. L., Ibnatul Jalilah, Y., Nor Fadila, M. A., Libunao, W. H., & Siti Sarah, Y. (2016). Multiple-choice item analysis using classical test theory and the Rasch measurement model. Man in India, 96(1–2),

173–181.

[2] Ahmad Tarmimi, I., & Shahrul Kadri, A. (2016). Tahap Kefahaman Dan Salah Konsep Terhadap Konsep

Daya Dan Gerakan Dalam Kalangan Pelajar Tingkatan Empat. Jurnal Fizik Malaysia, 37(1), 01090–01101.

[3] Arhin, A. K. (2015). The Effect of Performance Assessment-Driven Instruction on the Attitude and

Achievement of Senior High School Students in Mathematics in Cape Coast Metropolis , Ghana. Journal of

Education and Practice, 6(2), 112–114.

[4] Azrilah, A. A., Mohd Saifudin, M., & Azami, Z. (2013). Asas Model Pengukuran Rasch Pembentukan

Skala & Strktur Pengukuran. Bangi: Penerbit Universiti Kebangsaan Malaysia.

[5] Bond, T. G., & Fox, C. M. (2007). Applying the Rasch Model : Fundamental Measurement in the Human

Sciences (2nd ed.). Mahwah, New Jersey: Lawrence Earlbaum Associates. https://doi.org/10.1111/j.1745-

3984.2003.tb01103.x

[6] Cohen, L., Manion, L., & Morrison, K. (2007). Research Methods in Education (sixth edition). New York:

Routledge.

[7] Emanuela Ene & Ackerson, B. J. (2018). Assessing Learning in Small-Sized Physics Courses. Phys. Rev.

Phys. Educ. Res., 14(010102).

[8] Fadaei, A. S., & Mora, C. (2015). An Investigation About Misconceptions in Force and Motion in High

School. US-China Education Review, 5(1), 38–45.

[9] Flanders, S. T. (2014). INVESTIGATING FLEXIBILITY, REVERSIBILITY, AND MULTIPLE

REPRESENTATIONS IN A CALCULUS ENVIRONMENT. University of Pittsburgh.

[10] Ghafar, M. N. A. (2000). Penyelidikan Pendidikan. Skudai, Johor.: Penerbit Universiti Teknologi Malaysia.

[11] Gothwal, V. K., Wright, T., Lamoureux, E. L., & Pesudovs, K. (2010). Psychometric properties of visual

functioning index using Rasch analysis. Acta Ophthalmologica, 88(7), 797–803.

[12] Hake, R. R. (1997). Evaluating conceptual gains in mechanics: A six thousand student survey of test data.

In AIP Conference Proceedings (Vol. 399, pp. 595–604). AIP.

[13] Hake, R. R. (1998). Interactive-engagement versus traditional methods: A six-thousand-student survey of

mechanics test data for introductory physics courses. American Journal of Physics, 66(1), 64–74.

[14] Heller, K., & Heller, P. (2010). Cooperative Problem Solving in Physics A Use’r’s Manual Can this be

true?

[15] Hestenes, D., & Wells, M. (1992). A mechanics baseline test. The Physics Teacher, 30(3), 159–166.

[16] Hestenes, D., Wells, M., & Swackhamer, G. (1992). Force Concept Inventory. The Physics Teacher, 30(3),

141–158.

[17] Khairani, A. Z., & Abd. Razak, N. (2015). Modeling a Multiple Choice Mathematics Test with the Rasch

Model. Indian Journal of Science and Technology, 8(12). https://doi.org/10.17485/ijst/2015/v8i12/70650

[18] Kumar, R. (2011). Research Methodology: A Step-by-Step Guide for Beginners. SAGE Publication. London.

https://doi.org/http://196.29.172.66:8080/jspui/bitstream/123456789/2574/1/Research%20Methodology.pdf

[19] Lin, S. Y., & Singh, C. (2011). Using isomorphic problems to learn introductory physics. Physical Review Special Topics - Physics Education Research, 7(2), 1–16.

[20] Linacre, J. M. (2012). A user’s guide to WINSTEPS: Rasch Model Computer Programs. https://doi.org/ISBN 0-941938-03-4

[21] Magno, C. (2009). Demonstrating the Difference between Classical Test Theory and Item Response Theory

Using Derived Test Data. Online Submission (May).

[22] McDermott, M. A. (2009). The impact of embedding multiple modes of representation on student

construction of chemistry knowledge by the University of Iowa.

[23] Mohammad Mubarrak, M. Y., Siti Fairuz, D., & Norezan, I. (2013). the Level of Understanding of

Students and Teachers in the Concept of Force and Motion. International Conference on Social Science

Research, ICSSR 2013, (e-ISBN 978-967-11768-1-8), 2013 (June), 1083–1090.

[24] Persson, J. R. (2015). Evaluating the Force Concept Inventory for different student groups at the

Norwegian University of Science and Technology, 1–13.

[25] Planinic, M., Ivanjek, L., & Susac, A. (2010). Rasch model-based analysis of the Force Concept Inventory.

Physical Review Special Topics - Physics Education Research, 6(1), 1–11.

[26] Rosenblatt, R. (2012). Identifying and addressing student difficulties and misconceptions : examples from

physics and from materials science and engineering. Proquest LLC, March.

[27] Savinainen, A. (2005). High School Students ’ Conceptual Coherence of Qualitative Knowledge in the

Case of the Force Concept. Nordic Studies in Science Education (Vol. 1).

[28] Sumintono, B. (2018). Rasch Model Measurements as Tools in Assessment for Learning. In Proceedings of

the 1st International Conference on Education Innovation (ICEI 2017).

[29] Thornton, R. K., & Sokoloff, D. R. (1998). Assessing student learning of Newton’s laws: The Force and Motion Conceptual Evaluation and the Evaluation of Active Learning Laboratory and Lecture Curricula. American Journal of Physics, 66(4), 338–352.

Downloads

Published

31.07.2020

How to Cite

Binti Murshed, M., Aliah Phang, F., Abd Hadi Bin Bunyamin, M., & Jalilah Binti, I. (2020). The Reliability Analysis for Force Concept Inventory. International Journal of Psychosocial Rehabilitation, 24(5), 143-151. https://doi.org/10.61841/f5vf4682