From Predictive Validation to Bounded EducationalDecision Support:An Uncertainty-Aware Analytics Framework for PerceivedEmployability among Vocational Students in Aceh,Indonesia

Authors

  • Marzieh Jamili * Department of Educational Sciences, Sar.C., Islamic Azad University, Sari, Iran.
  • Yeganeh Sadat Mansourian Department of Mathematics and Physics, University of Campania “Luigi Vanvitelli”, Caserta, Italy.
  • Seyedeh Esmat Rasouli Department of Educational Sciences, Sar.C., Islamic Azad University, Sari, Iran.

https://doi.org/10.48314/isti.vi.52

Abstract

Educational decision support requires more than an accurate model: it must separate predictive usefulness from causal interpretation, quantify uncertainty, and connect model evidence to defensible actions. This study evaluates repeated out-of-the-ordinary prediction of self-reported perceived employability and develops a bounded, uncertainty-aware analytics framework for vocational education. The analysis used the version-4 public workbook containing 266 Grade XII students from 17 schools in seven districts of Aceh, Indonesia. Mean perceived employability was predicted from mean internship experience, 21stcentury competence, and psychological capital. Data integrity, response quality, reliability, and construct separation were audited. A mean-only baseline, ordinary linear regression, Elastic Net, and Random Forest were compared using five-fold cross-validation repeated 20 times; tunable models used nested four-fold inner validation. Linear regression achieved MAE = 0.264, RMSE = 0.350, and R^2= 0.643, reducing MAE by 38.8% relative to the baseline. Elastic Net was effectively equivalent, whereas Random Forest had 9.6% higher MAE. Repeated outoffold dropcolumn analysis showed that competence supplied the clearest unique information: removing it increased MAE by 0.0366 (13.8%; paired-bootstrap 95% CI [0.0162, 0.0562]). Psychological capital provided smaller supportive evidence, while internship experience had a limited unique contribution. Bootstrap item-ranking stability identified project execution and leadership as the strongest curriculum-review priorities. The contribution is an auditable data-to-decision protocol that integrates nested predictive validation, conditional construct evidence, measurement diagnostics, ranking uncertainty, calibration audits, and explicit decision boundaries. The framework supports curriculum and program review, not causal prescriptions, automated placement, or high-stakes individual decisions.

Keywords:

Vocational education, Perceived employability, Educational analytics, Repeated cross-validation, Uncertainty-aware decision support, 21st-century competence

References

  1. [1] Heijde, C. M. Van Der, & Van Der Heijden, B. I. J. M. (2006). A competence-based and multidimensional operationalization and measurement of employability. Human resource management: Published in cooperation with the school of business administration, the university of michigan and in alliance with the society of human resources management, 45(3), 449–476. https://doi.org/10.1002/hrm.20119
  2. [2] Clarke, M. (2018). Rethinking graduate employability: The role of capital, individual attributes and context. Studies in higher education, 43(11), 1923–1937. https://doi.org/10.1080/03075079.2017.1294152
  3. [3] Lo Presti, A., Ingusci, E., Magrin, M. E., Manuti, A., & Scrima, F. (2019). Employability as a compass for career success: Development and initial validation of a new multidimensional measure. International journal of training and development, 23(4), 253–275. https://doi.org/10.1111/ijtd.12161
  4. [4] Pianda, D., Hilmiana, H., Widianto, S., & Sartika, D. (2024). The impact of internship experience on the employability of vocational students: A bibliometric and systematic review. Cogent business & management, 11(1), 2386465. https://doi.org/10.1080/23311975.2024.2386465
  5. [5] Gupta, S. L., Mittal, A., Singh, S., & Dash, D. N. (2024). Demand-driven approach of vocational education and training (VET) and experiential learning: A thematic analysis through systematic literature review (SLR). Asian education and development studies, 13(1), 45–63. https://doi.org/10.1108/AEDS-07-2023-0083
  6. [6] Kain, C., Koschmieder, C., Matischek-Jauk, M., & Bergner, S. (2024). Mapping the landscape: A scoping review of 21st century skills literature in secondary education. Teaching and teacher education, 151, 104739. https://doi.org/10.1016/j.tate.2024.104739
  7. [7] Luthans, F., & Youssef-Morgan, C. M. (2017). Psychological capital: An evidence-based positive approach. Annual review of organizational psychology and organizational behavior, 4, 339–366. https://doi.org/10.1146/annurev-orgpsych-032516-113324
  8. [8] Sulistiobudi, R. A., & Kadiyono, A. L. (2023). Employability of students in vocational secondary school: Role of psychological capital and student-parent career congruences. Heliyon, 9(2), e13214. https://doi.org/10.1016/j.heliyon.2023.e13214
  9. [9] Pianda, D., Hilmiana, H., Widianto, S., & Sartika, D. (2026). A stratified survey dataset on internship experience, competencies, psychological capital, and employability of vocational students in Aceh, Indonesia. Data in brief, 67, 112992. https://doi.org/10.1016/j.dib.2026.112992
  10. [10] Pianda, D., Hilmiana, H., Widianto, S., & Sartika, D. (2026). Dataset of student internship experience, competence, psychological capital and employability’s vocational student (Original data). https://doi.org/10.17632/hmn3b4c6c4.4
  11. [11] Pianda, D., Hilmiana, Widianto, S., & Sartika, D. (2025). The influence employability of vocational students through internship experiences and 21st-century competencies: A moderated mediation model. Cogent education, 12(1), 2476285. https://doi.org/10.1080/2331186X.2025.2476285
  12. [12] Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y. S., Kay, J., ... & Gašević, D. (2022). Explainable artificial intelligence in education. Computers and education: Artificial intelligence, 3, 100074. https://doi.org/10.1016/j.caeai.2022.100074
  13. [13] Saqr, M., & López-Pernas, S. (2024). Why explainable AI may not be enough: Predictions and mispredictions in decision making in education. Smart learning environments, 11(1), 52. https://doi.org/10.1186/s40561-024-00343-4
  14. [14] Hlosta, M., Herodotou, C., Papathoma, T., Gillespie, A., & Bergamin, P. (2022). Predictive learning analytics in online education: A deeper understanding through explaining algorithmic errors. Computers and education: Artificial intelligence, 3, 100108. https://doi.org/10.1016/j.caeai.2022.100108
  15. [15] Lo Presti, A., Costantini, A., Akkermans, J., Sartori, R., & De Rosa, A. (2023). Employability development during internships: A three-wave study on a sample of psychology graduates in Italy. Journal of career development, 50(6), 1155–1171. https://doi.org/10.1177/08948453231161291
  16. [16] Vlachopoulos, D., & Makri, A. (2024). A systematic literature review on authentic assessment in higher education: Best practices for the development of 21st century skills, and policy considerations. Studies in educational evaluation, 83, 101425. https://doi.org/10.1016/j.stueduc.2024.101425
  17. [17] Zhan, Y., Boud, D., & Du, Z. (2025). Designing for authentic assessment: A scoping review. Higher education, 1–18. https://doi.org/10.1007/s10734-025-01588-9
  18. [18] Rehman, N., Huang, X., Mahmood, A., AlGerafi, M. A. M., & Javed, S. (2024). Project-based learning as a catalyst for 21st-Century skills and student engagement in the math classroom. Heliyon, 10(23), e39988. https://doi.org/10.1016/j.heliyon.2024.e39988
  19. [19] Ayala Calvo, J. C., & Manzano García, G. (2021). The influence of psychological capital on graduates’ perception of employability: The mediating role of employability skills. Higher education research & development, 40(2), 293-308. https://doi.org/10.1080/07294360.2020.1738350
  20. [20] Baluku, M. M., Mugabi, E. N., Nansamba, J., Matagi, L., Onderi, P., & Otto, K. (2021). Psychological capital and career outcomes among final year university students: The mediating role of career engagement and perceived employability. International journal of applied positive psychology, 6(1), 55–80. https://doi.org/10.1007/s41042-020-00040-w
  21. [21] Varma, S., & Simon, R. (2006). Bias in error estimation when using cross-validation for model selection. BMC bioinformatics, 7(1), 91. https://doi.org/10.1186/1471-2105-7-91
  22. [22] Cawley, G. C., & Talbot, N. L. C. (2010). On over-fitting in model selection and subsequent selection bias in performance evaluation. The journal of machine learning research, 11, 2079–2107. https://www.jmlr.org/papers/volume11/cawley10a/cawley10a.pdf
  23. [23] Bengio, Y., & Grandvalet, Y. (2004). No unbiased estimator of the variance of k-fold cross-validation. Journal of machine learning research, 5(Sep), 1089–1105. https://www.jmlr.org/papers/volume5/grandvalet04a/grandvalet04a.pdf
  24. [24] Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the academy of marketing science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8
  25. [25] Zou, H., & Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the royal statistical society series b: Statistical methodology, 67(2), 301–320. https://doi.org/10.1111/j.1467-9868.2005.00527.x
  26. [26] Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., ... & Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. The journal of machine learning research, 12, 2825-2830. https://doi.org/10.5555/1953048.2078195

Downloads

Published

2025-12-04

Issue

Vol. 2 No. 4 (2025): Information Sciences and Technological Innovations

Section

Articles

License

Copyright (c) 2024 Information Sciences and Technological Innovations

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

Jamili, M., Mansourian, Y. S. ., & Rasouli, S. E. (2025). From Predictive Validation to Bounded EducationalDecision Support:An Uncertainty-Aware Analytics Framework for PerceivedEmployability among Vocational Students in Aceh,Indonesia. Information Sciences and Technological Innovations, 2(4), 261-274. https://doi.org/10.48314/isti.vi.52

Similar Articles

1-10 of 14

You may also start an advanced similarity search for this article.