Introduction: The integration of artificial intelligence (AI) in higher education presents a dichotomy: a potential tool for enhancing learning or a risk to the development of fundamental cognitive skills. This study investigates AI's impact on university students' higher-order thinking skills (HOTS) during complex problem-solving. While AI offers personalized and efficient solutions, concerns persist regarding its potential to hinder critical thought and independent learning.

Methods: A mixed-methods approach was used to explore this issue. A quasi-experimental design compared a control group of university students solving complex problems without AI to an experimental group utilizing AI tools. Data were collected through pre- and post-test assessments of HOTS, a survey on AI usage, and qualitative semi-structured interviews. Epistemic Network Analysis (ENA) was employed to visualize and quantify the cognitive structures students used during the problem-solving process.

Results: Quantitative analysis revealed that the AI-assisted group demonstrated a statistically significant difference in certain HOTS metrics compared to the control group, though the nature of this difference was complex and depended on the type of task. Qualitative data from interviews highlighted students' perceptions of both the benefits and drawbacks, with many expressing concerns about "AI dependency." The ENA provided visual evidence of differing cognitive approaches, suggesting that AI use may alter the interconnectedness of students' thought processes. Ethical concerns around data privacy, algorithmic bias, and the lack of transparency in AI decision-making were prominent themes.

Discussion: The findings suggest that AI's role is not a simple binary of "facilitator or hindrance." Its impact is nuanced, potentially enhancing some aspects of problem-solving while hindering others, particularly when students become overly reliant on AI-generated solutions. Effective integration of AI requires a pedagogical shift towards scaffolding its use to support, rather than replace, cognitive effort. The study underscores the urgent need for robust ethical frameworks and participatory design in AI development for education to mitigate risks and ensure a human-centric approach.

Higher-Order Thinking Skills, Complex Problem Solving, Artificial Intelligence

Ahmad, K., Qadir, J., Al-Fuqaha, A., Iqbal, W., El-Hassan, A., Benhaddou, D., & Ayyash, M. (2020). Artificial intelligence in education: A panoramic review. https://doi.org/10.35542/osf.io/zvu2n.

Allen, T. (2019). Solving critical design problems: Theory and practice. Routledge.

Al-Othman, F. H. (2014). The impact of good quality instructions of early education on the performance of university newcomers. Journal of Education and Learning, 3(1), 111–121. https://doi.org/10.5539/jel.v3n1p111.

Altaleb, H., Mouti, S., & Beegom, S. (2023). Enhancing college education: An AI-driven adaptive learning platform (ALP) for customized course experiences. In 2023 9th International Conference on Optimization and Applications. IEEE. 1–5. https://doi.org/10.1109/ICOA58279.2023.10308834.

Al-Zahrani, A. M. (2024). Unveiling the shadows: Beyond the hype of AI in education. Heliyon, 10(9), Article e30696. https://doi.org/10.1016/j.heliyon.2024.e30696.

Åman, P., Andersson, H., & Hobday, M. (2017). The scope of design knowledge: Integrating the technically rational and human-centered dimensions. Design Issues, 33(2), 58–69. https://doi.org/10.1162/DESI_a_00439.

Arastoopour, G., Shafer, D., Swiecki, Z., Ruis, A., & Chesler, N. (2015). Teaching and assessing engineering design thinking with virtual internships and epistemic network analysis. International Journal of Engineering Education, 32, 1492–1501.

Aryal, S., Do, T., Heyojoo, B., Chataut, S., Gurung, B. D., Gadhamshetty, V., & Gnimpieba, E. Z. (2024). Leveraging multi-AI agents for cross-domain knowledge discovery. Language Circle Journal of Language and Literature. https://doi.org/10.48550/arXiv.2404.08511.

Aryani, E. J., & Wahyuni, S. (2020). An analysis of higher order thinking skills realization in reading comprehension questions. Language Circle: Journal of Language and Literature, 15(1), 83–89. https://doi.org/10.15294/lc.v15i1.26064.

Baty, S. (2010). Solving complex problems through design. Interactions, 17(5), 70–73. https://doi.org/10.1145/1836216.1836235.

Bergstrom, T., & Karahalios, K. (2007). Seeing more: Visualizing audio cues. In C. Baranauskas (Ed.), IFIP Conference on Human Computer Interaction. Springer.

Brink, P. J., & Wood, M. J. (1998). Advanced design in nursing research. Sage Publications.

Brookhart, S. (2010). How to assess higher-order thinking skills in your classroom. ASCD.

Chandrasekaran, B. (1990). Design problem solving: A task analysis. AI Magazine, 11(4), 59–59.

Chang, C. C., & Kuo, H. C. (2024). “History is like an old story!”: Navigating the trajectories of historical epistemic beliefs through epistemic network analysis in Taiwanese high school students’ perspectives. Thinking Skills and Creativity, 51, Article 101410. https://doi.org/10.1016/j.tsc.2023.101410.