Artificial Intelligence
Resource Highlight
- Using AI for Students GuideBy UW librarians Je Salvador and Dani Rowland.
- 5 tips for addressing AI in the classroom this fallSeptember 20, 2023, blog post by UW librarians Marisa Petrich and Erika Bailey.
- Guidance for Authors, Peer Reviewers, and Editors on Use of AI, Language Models, and ChatbotsJuly 27, 2023, editorial in JAMA by Annette Flanagin, RN, MA; Jacob Kendall-Taylor, BA; and Kirsten Bibbins-Domingo, PhD, MD, MAS.
- Language Models: A Guide for the PerplexedNovember 29, 2023, PDF guide by Sofia Serrano, Zander Brumbaugh, and Noah A. Smith. arXiv abstract.
Need Help?
What is AI?
Artificial intelligence (AI) is also referred to as machine learning (ML) although they are different. Similarly, Large Language Models (LLMs) are often referred to as AI and fit under the umbrella of AI with ML but neither demonstrates actual intelligence.
AI (Artificial Intelligence) "is the science and engineering of making intelligent machines, especially intelligent computer programs. It is related to the similar task of using computers to understand human intelligence, but AI does not have to confine itself to methods that are biologically observable [emphasis added]." (McCarthy, n.d.)
Intelligence of created systems and algorithms is typically compared to human intelligence. Sometimes LLMs and ML products can appear to have human intelligence, but it is simply the product of coding, not actual intelligence.
ML (Machine Learning) is "algorithms that give computers the ability to learn from data, and then make predictions and decisions". Examples include automatically detecting spam emails, suggesting videos to watch after finishing one, etc. (CrashCourse, 2017)
LLMs (Large Language Models) "can generate natural language texts from large amounts of data. Large language models use deep neural networks, such as transformers, to learn from billions or trillions of words, and to produce texts on any topic or domain. Large language models can also perform various natural language tasks, such as classification, summarization, translation, generation, and dialogue." (Maeda & Chaki, 2023)
GPT (Generative Pre-trained Transformer) "models give applications the ability to create human-like text and content (images, music, and more), and answer questions in a conversational manner." (What Is GPT AI?, n.d.)
Uses & Limitations of LLMs
Large Language Models (LLMs)
While some LLMs are more recognizable than others, there are quite a few options available. Here is an incomplete list of LLMs you may want to investigate. (Staines, 2023)
- ChatGPT
- Consensus
- CORE-GPT
- DataSeer
- GDELT Project
- Hum
- Iris.ai
- LASER AI
- Perplexity.ai
- Prophy
- Scholarcy
- Scite.ai
- SOMA
- Writefull
- Generative AI Product TrackerIthaka S+R lists generative AI products that are either marketed specifically towards postsecondary faculty or students or appear to be actively in use by postsecondary faculty or students for teaching, learning, or research activities.
- There's an AI for ThatThis website aims to categorize LLMs to make finding a resource for your goals easier. They state they are "the largest AI aggregator." Account required.
ChatGPT
- Demystifying ChatGPT for AcademicsApril 9, 2023, 60-minute recorded webinar from the UW with ten panelists and facilitators Mari Ostendorf, Professor, Electrical & Computer Engineering, Vice Provost for Research, and Sofia Serrano, Ph.D. Candidate, Paul G. Allen School of Computer Science & Engineering. Direct link to recording
- What is ChatGPT doing... and why does it work?February 14, 2023, post by Stephen Wolfram.
- Preventing and Detecting ChatGPT-Generated CitationsApril 14 2023, 50-minute recorded webinar by Amy Chatfield, information services librarian at the Norris Medical Library, University of Southern California Libraries.
- I'm a Student. You Have No Idea How Much We're Using ChatGPT.: No professor or software could ever pick up on it.May 12, 2023, article in The Chronicle of Higher Education by Owen Kichizo Terry.
- AI-text detection tools are really easy to foolJuly 7, 2023, MIT Technology Review article by Rhiannon Williams.
Uses and Limitations of LLMs
UW Medicine Office of Research and Graduate Education:
- OpenAI has a call for proposal on their website right now. UW Principal Investigators (PIs) should not apply for these grants.
- OpenAI will claim possession and rights of dissemination for all material in the proposal and all background IP.
- These terms are not acceptable to UW and many other universities.
Please direct any questions regarding the OpenAI call for proposals to rgeadmin@uw.edu.
Uses |
Limitations |
---|---|
|
|
|
|
|
|
Guidance for AI Development and Use
- UW IT: Artificial Intelligence Interim GuidelinesThese interim guidelines serve to help make security and privacy decisions while awaiting the recommendations of the UW AI Task Force.
- Using AI for Students GuideBy UW librarians Je Salvador and Dani Rowland.
- Blueprint for an AI Bill of RightsFrom The White House.
- President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial IntelligenceOctober 30, 2023, Executive Order by President Biden on new standards for AI safety and security, privacy, equity and civil rights, and more.
- Washington State Generative AI GuidelinesWashington Technology Solutions (WaTech) guidelines for using generative AI in the course of state employees' work.
- To Do No Harm — and the Most Good — with AI in Health CareFebruary 22, 2024, NEJM AI opinion article by Carey Beth Goldberg; Laura Adams, R.N., M.S.; David Blumenthal, M.D., M.P.P.; et al for the RAISE Consortium.
- Editors’ Statement on the Responsible Use of Generative AI Technologies in Scholarly Journal PublishingOctober 1, 2023, The Hastings Center Report editorial by Gregory E. Kaebnick, David Christopher Magnus, Audiey Kao, Mohammad Hosseini, David Resnik, Veljko Dubljević, Christy Rentmeester, Bert Gordijn, and Mark J. Cherry.
- Generative AI in Academic Research: Perspectives and Cultural NormsDecember 15, 2023, report by Cornell University Task Force.
Bias in AI and LLMs
Journal and News Articles on Bias in AI and LLMs
- AI Empire: Unraveling the interlocking systems of oppression in generative AI's global orderDecember 13, 2023, Big Data & Society journal article by Jasmina Tacheva and Srividya Ramasubramanian.
- ChatGPT is biased against resumes with credentials that imply a disability — but it can improveJune 21, 2024, UW News article by Stefan Milne.
- Automation Bias and Assistive AI Risk of Harm From AI-Driven Clinical Decision SupportDecember 19, 2023, article in JAMA by Rohan Khera, MD, MS; Melissa A. Simon, MD, MPH; and Joseph S. Ross, MD, MHS.
- Impact of Healthcare Algorithms on Racial and Ethnic Disparities in Health and HealthcareDecember 8, 2023 Systematic Review by Tipton K, Leas BF, Flores E, Jepson C, Aysola J, Cohen J, Harhay M, Schmidt H, Weissman G, Treadwell J, Mull NK, and Siddique SM.
- Study finds bias in AI diagnoses: Suggests doctors not rush to use GPT-4August 7, 2023 Boston Globe article by Katie Palmer.
- Coding Inequity: Assessing GPT-4’s Potential for Perpetuating Racial and Gender Biases in HealthcareJuly 17, 2023, preprint (i.e., not peer reviewed) by Travis Zack, Eric Lehman, Mirac Suzgun, Jorge A. Rodriguez, Leo Anthony Celi, Judy Gichoya, Dan Jurafsky, Peter Szolovits, David W. Bates, Raja-Elie E. Abdulnour, Atul J. Butte, Emily Alsentzer.
- Search algorithms are racistGuide to Conducting Research through an Anti-Racism Lens from the University of Minnesota Libraries.
- Who is making sure the A.I. machines aren't racistMarch 15, 2021, New York Times article by Cade Metz.
How to activate your NYT subscription from the UW. - AI was asked to create images of Black African docs treating white kids. How'd it go?October 6, 2023, NPR article by Carmen Drahl.
Read the essay this article discusses published in The Lancet Global Health: Reflections before the storm: The AI reproduction of biased imagery in global health visuals by Arsenii Alenichev, Patricia Kingori, and Koen Peeters Grietens. - This is how AI image generators see the worldNovember 1, 2023, The Washington Post article by Nitasha Tiku, Kevin Schaul, and Szu Yu Chen.
- Chatbot AI makes racist judgements on the basis of dialectMarch 13, 2024, Nature news article by Elizabeth Gibney.
Classroom Use of AI and LLMs
Using AI in the Classroom
- Washington State Generative AI GuidelinesWashington Technology Solutions (WaTech) guidelines for using generative AI in the course of state employees' work.
- 5 tips for addressing AI in the classroom this fallSeptember 20, 2023, blog post by UW librarians Marisa Petrich and Erika Bailey.
- Teaching@UW: AI+TeachingCourse design recommendations from Teaching@UW.
- Sample syllabus statementsUW Teaching@UW guidance for adding AI statements to your syllabus.
- Collection of Syllabi Policies for AI Generative ToolsGoogle Doc containing more than 150 syllabi policies on use of AI in the classroom, compiled by Lance Eaton.
Use Caution
- Read about Bias in and the Limitations of AI. LLMs, ML, and algorithms.
- Fact Focus: Zoom says it isn’t training AI on calls without consent. But other data is fair gameAugust 9, 2023, AP Fact Check article by Melissa Goldin.
- AI can crack double blind peer review – should we still use it?August 8, 2023, London School of Economics and Political Science blog post by Leonard Bauersfeld, Angel Romero, Manasi Muglikar, and Davide Scaramuzza.
Academic Standards
- UW Community Standards & Student ConductThe UW has added guidance regarding AI, which includes ML and LLMs, to their description of academic standards and misconduct.
- UW Center: Responsible AI Systems and Experiences (RAISE)"The unit provides AI, ML, Human-Centered Computing and Data Science resources, connections, and directions for those working on research and curriculum activities with computational as well as humanistic methods in order to build intelligent and value-sensitive solutions that provide fair and equitable access to information and opportunities to individuals, organizations, and communities."
- UW Center for Teaching and Learning: ChatGPT and other AI-based toolsGuidelines for AI in the classroom.
- U.S. Department of Education Shares Insights and Recommendations for Artificial IntelligenceMay 24, 2023, press release from the U.S. Department of Education.
Rethinking Plagiarism and Cheating
From Ditch That Textbook by Matt Miller.
Alternative Text
It's time to rethink "plagiarism" and "cheating"
As you read through the ordered list, consider these questions:
- Which of these would you consider "cheating"?
- Which of these is relevant to our students' future?
- Which of these would you use in your work as an adult?
Organized on a spectrum from Bot-created (1 on the list below) to Student-created (6 on the list below):
- Student plugged prompt into AI, copied response and submitted it to teacher.
- AI created a response. Student read, edited, adjusted, and submitted.
- Student created multiple AI responses, used the best parts, edited, and submitted.
- Student wrote main ideas. AI generated a draft and offered feedback to improve.
- Student consulted internet/AI for ideas, then wrote and submitted.
- Student wrote all assignment content without consulting AI or the internet.
Ditch That Textbook. Graphic by Matt Miller (@jmattmiller) DitchThatTextbook.com.
(Miller, 2022)
Citing AI and LLMs
- Plan for Using AIGuide by Amanda Wheatley (she/elle), Librarian, McGill Library.
Co-Authorship
Many journals have rules about whether AI and LLMs can be considered a co-author. Investigate the Author Guidelines for any journal in which you are considering publishing before using a LLM to revise or support your work.
- International Committee of Medical Journal Editors (ICMJE): Defining the Role of Authors and ContributorsICMJE guidance for AI-Assisted Technology.
- Guidance for Authors, Peer Reviewers, and Editors on Use of AI, Language Models, and ChatbotsJuly 27, 2023, editorial in JAMA by Annette Flanagin, RN, MA; Jacob Kendall-Taylor, BA; and Kirsten Bibbins-Domingo, PhD, MD, MAS.
Works Cited
Consensus on how or whether to cite AI and LLMs is in progress. Look to your instructor and/or syllabus for specific instructions on whether you may use AI and/or LLMs in your coursework.
Because LLMs are generating sentences based on others' work, err on the side of caution by citing the LLM used.
- Citation Style Guide for AIFrom Dalhousie University Libraries.
- How to Cite ChatGPTGuidance from Sally Neal, Librarian, Butler University.
Copyright
- Library Copyright Alliance Principles for Copyright and Artificial IntelligenceJuly 10, 2023, principles from the Library Copyright Alliance, American Library Association (ALA), and Association of Research Libraries (ARL).
- Library Copyright Alliance (LCA) Statement on AI Training DataJanuary 23, 2024, blog post on behalf of the LCA states that training generative AI models on copyrighted works is fair use.
Learning Forums & Resources
- NEJM AINew England Journal of Medicine (NEJM) Group's monthly journal on research and applications of artificial intelligence in clinical medicine.
Learn the basics with this 12-minute instructional video by CrashCourse produced in collaboration with PBS Digital Studios:
- A Very Gentle Introduction to Large Language Models without the HypeApril 13, 2023, Medium article by Mark Riedl.
- NEJM AI Grand RoundsPodcast hosted by Arjun (Raj) Manrai, Ph.D., and Andrew Beam, Ph.D., about the intersection of AI, ML, and medicine.
- Open Educational Resource (OER): ChatGPT Assignment"The ChatGPT assignment was designed for a Foundations of Educational Technology course to teach about artificial intelligence with an emphasis on understanding the hindrances and benefits of machine learning technologies in educational development. The assignment also emphasizes critical thinking, multimodal representations of knowledge, summative and concise writing, breadth of research, and the gathering and review of diverse perspectives, viewpoints, and literature."
- infoDOCKETCompiled by Gary Price, hosted by Library Journal.
- JAMA Network: AI and LLMsA collection of articles and resources on clinical applications of large language models (LLMs) and other AI technologies.
UW Resources
- AI@UW"The UW Office of Research, the Paul G. Allen School of Computer Science & Engineering, the Information School, the NSF Institute for Foundations of Data Science (IFDS), and the eScience Institute partnered to initiate and support novel collaborations" with seed grant awards.
- Teaching@UW: AI+TeachingCourse design recommendations from Teaching@UW.
- AI and Automation in Systematic Reviews and Other Evidence Synthesis ProjectsGuide to AI in Evidence Synthesis page developed by Dev Wilder and maintained by Teresa Jewell.
- UW Tech Policy LabResources and publications advancing artificial intelligence and robotics in the public interest through research, analysis, and education and outreach.
- U.S. National Science Foundation: UW-led AI Institute in Dynamic SystemsThe "Institute is committed to integrating machine learning and artificial intelligence methods for a broad range of scientific and engineering applications."
Read the announcement of the UW-led AI Institute for Dynamic Systems - UW School of Computer Science & Engineering on AI"The artificial intelligence group studies the computational mechanisms underlying intelligent behavior. We are active in a wide variety of research areas, including machine learning, natural language processing, probabilistic reasoning, automated planning, machine reading, and intelligent user interfaces."
- UW News on AI, ML, and LLMsGoogle Advanced Search of UW News for the following. ai|"artificial intelligence"|"machine learning"|"large language models" site:https://www.washington.edu/news/
Learn more about advanced searching in Google. - AI EbooksList of ebooks about AI curated by Health Sciences Library staff.
- ChatGP-why: When, if ever, is synthetic text safe, appropriate, and desirable?August 8, 2023, 1-hour video with speaker Emily Bender of the UW for GRAILE Sensemaking Lectures.
Library Research Guides
- AI Tools in Your ResearchGuide by Instruction Librarians Michelle Guittar and Jeannette Moss, Northwestern University Libraries.
- Guide to AIGuide by Johanna Goldberg, Reference Services, Memorial Sloan Kettering Cancer Center Library.
- ChatGPT and Generative AIGuide by Jennifer Lau-Bond, Coordinator of Library Instruction, Harper College Library.
Think Pieces
- 2024 EDUCAUSE AI Landscape StudyFebruary 12, 2024, Educause study by Jenay Robert.
- Words In Review: AI or 'stochastic parrots'?June 13, 2023, NPR Network: KUOW.org news story by Bill Radke.
- Generative AI is Disruptive, But More Copyright Isn’t the Answer.May 11, 2023, Public Knowledge blog post by Nicholas Garcia.
- Webinar: Unlocking the Power of AI: How Tools Like ChatGPT Can Make Teaching Easier and More EffectiveMay 2, 2023, webinar recording of Dr. Ethan Mollick, Associate Professor, Wharton School, University of Pennsylvania, and Dr. Lilach Mollick, Director of Pedagogy, Wharton Interactive, hosted by Harvard Business Publishing. Learn more about the webinar's speakers and content.
- Let ChatGPT Be Your Teaching Assistant: Strategies for Thoughtfully Using AI to Lighten Your Workload
April 26, 2023, Harvard Business Publishing blog post by these speakers.
- Why All Our Classes Suddenly Became AI Classes: Strategies for Teaching and Learning in a ChatGPT World
February 8, 2023, Harvard Business Publishing blog post by these speakers.
- Let ChatGPT Be Your Teaching Assistant: Strategies for Thoughtfully Using AI to Lighten Your Workload
- Don’t Ban ChatGPT in Schools. Teach With It.January 12, 2023, New York Times: The Shift article by Kevin Roose.
How to activate your NYT subscription from the UW. - ChatGPT in the Humanities Panel: Researchers Share Concerns, Prospects of Artificial Intelligence in AcademiaMarch 26, 2023, The Cornell Daily Sun article by Julia Senzon.
- Who is making sure the A.I. machines aren't racistMarch 15, 2021, New York Times article by Cade Metz.
How to activate your NYT subscription from the UW.
References
CrashCourse (Director). (2017, November 1). Machine Learning & Artificial Intelligence: Crash Course Computer Science #34. https://www.youtube.com/watch?v=z-EtmaFJieY
Maeda, J., & Chaki, E. (2023, April 3). Concepts Overview for LLM AI. Microsoft Build. https://learn.microsoft.com/en-us/semantic-kernel/concepts-ai/
McCarthy, J. (n.d.). What is AI?: Basic Questions. Professor John McCarthy. Retrieved May 3, 2023, from http://jmc.stanford.edu/artificial-intelligence/what-is-ai/index.html
Miller, M. (2022, December 17). ChatGPT, Chatbots and Artificial Intelligence in Education: How to define "cheating" and "plagiarism" with AI. Ditch That Textbook. Retrieved December 6, 2023, from https://ditchthattextbook.com/ai/
Staines, H., et al. (2023). Charleston In Between: The Future of Scholarly Communication in a ChatGPT World. https://www.charleston-hub.com/the-charleston-conference/welcome/charleston-in-between/
What is GPT AI? - Generative Pre-Trained Transformers Explained - AWS. (n.d.). Amazon Web Services, Inc. Retrieved August 10, 2023, from https://aws.amazon.com/what-is/gpt/