Author Information
Amit Lal, University of the Pacific, United StatesAbstract
This pilot study explores the comparative effectiveness of ChatGPT versus Traditional Online Search (TOS) methods in supporting novice second-year undergraduates with no prior R or RStudio experience in completing a data visualization assignment. Participants (n = 20) were randomly assigned to two groups (n = 10 each) and given approximately 1 hour and 50 minutes across two class periods to load a built-in dataset, explore its structure, and create visualizations using either ChatGPT or TOS. Assignments were graded on code accuracy, use of RStudio features, visualization quality, documentation, and presentation. Post-assignment surveys assessed perceived ease of use, clarity of guidance, engagement, and understanding of R programming and visualization techniques. Preliminary results indicate the ChatGPT group significantly outperformed the TOS group in assignment scores and survey ratings (e.g., higher means in ease of use and understanding), aligning with expected effects of large language models in reducing cognitive load through personalized guidance. Qualitative feedback underscored ChatGPT's interactivity versus TOS's information overload. Distinct from broader meta-analyses, this pilot provides initial classroom-specific insights into AI advantages for short-term programming learning. Implications include hybrid AI-TOS frameworks to address overreliance, but these frameworks have limitations, including a small sample size and no long-term assessment. Future studies should be scaled with controls and pretests.
Paper Information
Conference: WCE2026Stream: Implementation & Assessment of Innovative Technologies in Education
This paper is part of the WCE2026 Conference Proceedings (View)
Full Paper
View / Download the full paper in a new tab/window
To cite this article:
Lal A. (2026) Comparing ChatGPT and Traditional Online Search for Learning R Programming and RStudio Visualization: A Pilot Study ISSN: 2760-7259 The Washington DC Conference on Education 2026: Official Conference Proceedings (pp. 233-256) https://doi.org/10.22492/issn.2760-7259.2026.21
To link to this article: https://doi.org/10.22492/issn.2760-7259.2026.21
Comments
Powered by WP LinkPress