Not stated in source 2025 Needs review

Automating Programming Assignment Grading with a Fine-Tuned Large Language Model

Abstract

Grading programming assignments is a labor-intensive process that requires significant effort from university personnel and is often influenced by subjective biases. Automated grading systems, particularly those leveraging artificial intelligence, could offer a promising solution to these challenges. This thesis examines the potential of large language models to reduce the grading workload while also standardizing the process. The product of this study was a fine-tuned OpenAI GPT model trained on past programming assignment submission-feedback pairings with feedback templates and grading instructions from the Programming 2 course run by Tampere University. The research focused on measuring the feedback given by the fine-tuned model in terms of consistency and differences between the feedback given by the corresponding human graders. The base GPT model was fine-tuned with a small dataset and default settings. Evaluation results suggest that further experimentation with different hyperparameters and larger or alternative datasets is necessary to increase the reliability of the model. While the AI-generated feedback met predefined evaluation metrics in most cases, the results were not yet reliable enough for actual grading.

Keywords

Not available

Specialisations

Similar theses