Publisher

RISETPRESSRISETPRESS

Journal Pancasila International Journal of Applied Social SciencePancasila International Journal of Applied Social Science Abstract

This study sought to advance our understanding of the anthropomorphic features of artificial intelligence (AI) and its usability in research and society, in general. Specifically, this study examined how institutional is the interaction between an AI tool (PDFgear Copilot) and the human researcher during an AI-integrative process of a systematic literature review. In the final screening process, a total of 104 publications were found relevant and chatted with PDFgear Copilot for the summarization of the methods, sample, theoretical foundations, and findings. The conversations from these chats were analyzed using the features of institutional interaction by Drew & Heritage (1992). The results revealed that AI exhibits a normative response in 96 research articles and 8 with a disruptive response in the conversation sequence organization. When given follow-up questions, it was observed in 17 research articles that AI showed more anthropomorphic traits with similarity to ordinary conversation when AI expressed a degree of uncertainty and answer limitation. Overall, this study provides implications for information technology professionals in advancing AIs human-like features and for researchers in further exploring the possibility of utilizing AI in research.

Conclusion

The results of the study found that AI exhibits limited human-like features of interaction when the articles being examined are empirical studies.The AI can directly answer the question, but has inadequate word prompts or phrases to encourage the continuous flow of conversation, which may lead to questioning the trustworthiness of AI.However, an opposite observation was noted when the articles being investigated were literature review articles or long research articles.The AI showcased more anthropomorphic features by using words or phrases for clarity of the questions being thrown in the chat box.This study expands research into the usability of large language models (LLMs) such as GPT-powered PDF chat assistants that use natural language processing (NLP) in academic research.

Future Research

Berdasarkan temuan penelitian ini, beberapa saran penelitian lanjutan dapat diajukan. Pertama, penelitian selanjutnya dapat mengeksplorasi perbandingan mendalam antara berbagai alat AI, termasuk PDFgear Copilot, untuk mengidentifikasi kekuatan dan kelemahan masing-masing dalam konteks penelitian. Hal ini dapat membantu peneliti memilih alat yang paling sesuai dengan kebutuhan spesifik mereka. Kedua, penelitian dapat difokuskan pada pengembangan metode untuk mengukur tingkat kepercayaan dan keandalan yang diberikan oleh peneliti terhadap hasil yang dihasilkan oleh AI. Pemahaman yang lebih baik tentang faktor-faktor yang memengaruhi kepercayaan ini dapat membantu meningkatkan desain dan implementasi alat AI yang lebih transparan dan akuntabel. Ketiga, penelitian dapat menyelidiki bagaimana AI dapat diintegrasikan secara lebih efektif dalam proses penelitian, tidak hanya sebagai alat bantu, tetapi juga sebagai mitra kolaboratif. Ini dapat melibatkan pengembangan antarmuka yang lebih intuitif dan kemampuan AI untuk memahami konteks penelitian secara lebih mendalam, sehingga dapat memberikan saran dan wawasan yang lebih relevan dan bermanfaat.

References

1. 0. zmuy ld sb 1x gq ab doi.org/10.3389/fpubh.2022.8501720 zmuy ld sb 1x gq ab doi 10 3389 fpubh 2022 850172
2. How AI Literacy Affects Students’ Educational Attainment in Online Learning: Testing a Structural... doi.org/10.19173/irrodl.v25i3.7720How AI Literacy Affects StudentsAo Educational Attainment in Online Learning Testing a Structural doi 10 19173 irrodl v25i3 7720
3. Institutionality of AI-Human Interaction: A case study of PDFgear Copilot using conversation analytic... risetpress.com/index.php/pancasila/article/view/1935Institutionality of AI Human Interaction A case study of PDFgear Copilot using conversation analytic risetpress index php pancasila article view 1935

Metadata

File size	397.26 KB
Pages	13
DMCA	Report