Automating Programming Assignment Grading with a Fine-Tuned Large Language Model
Abstract
Grading programming assignments is a labor-intensive process that requires significant effort from university personnel and is often influenced by subjective biases. Automated grading systems, particularly those leveraging artificial intelligence, could offer a promising solution to these challenges. This thesis examines the potential of large language models to reduce the grading workload while also standardizing the process. The product of this study was a fine-tuned OpenAI GPT model trained on past programming assignment submission-feedback pairings with feedback templates and grading instructions from the Programming 2 course run by Tampere University. The research focused on measuring the feedback given by the fine-tuned model in terms of consistency and differences between the feedback given by the corresponding human graders. The base GPT model was fine-tuned with a small dataset and default settings. Evaluation results suggest that further experimentation with different hyperparameters and larger or alternative datasets is necessary to increase the reliability of the model. While the AI-generated feedback met predefined evaluation metrics in most cases, the results were not yet reliable enough for actual grading.
Keywords
Not available
Specialisations
Similar theses
- Addressing data heterogeneity, scarcity, and training efficiency in privacy-preserving federated learning Chen, Haokun · Ludwig-Maximilians-Universität München · 2025
- Resources and Applications for Dialectal Arabic: the Case of Levantine Chatrine Qwaider ; Kathrein Abu Kwaik · Gothenburg University · 2022
- On the Safety Alignment of Large Language Models Mengxuan Hu · 2026
- Automating news classification with large language models: Exploring fine-tuning, dataset size, and architecture Yesilyurt, Burcu · 2025
- Vision–Language Models for Zero- and Few-Shot Anomaly Detection in Chest X-Rays Md Ashrafuzzaman · University of Jyväskylä · 2026
- Efficient fine-tuning of Transformer Models Under Hardware Constraints : An Empirical Study of LoRA and Knowledge Distillation Sai Mounika Karasu · Dalarna University Library · 2026
