How (not) to use chatGPT as a researcher

How (not) to use chatGPT as a researcher
Prof. David Martens
Faculty of Business & Economics
Co-director Antwerp Center for Responsible AI
Doctoral Day - October 2023
Warning: Presentation of October 2023 –
Likely outdated, given the advances in LLM.

2
"Technological progress is like an axe in
the hand of a pathological criminal."
Einstein’s Warning

Outline
3
▪ What is AI, generative AI and chatGPT
▪ Uses of chatGPT as a researcher
▪ Dangers of using chatGPT

Machine Learning, Data Science and AI
▪ Machine Learning: automatic extraction of patterns from data
▪ Data science: a set of fundamental principles that guide the extraction of
knowledge from data
▪ AI: methods for improving the knowledge or performance of an intelligent agent
over time, in response to the agent's experience in the world
4
AI
AI
Data
Science
Machine
Learning
“99% of AI is prediction” Ng
Genera-
tive AI

Machine Learning, Data Science and AI
5

How does chatGPT work?
6
▪ Deep neural network: Generative Pretrained Transformer
▪ Generative: Next word prediction
▪ Pretrained: using 500 billion words to estimate 175 billion parameters
Input Predicted next word
What are 10 applications of AI? 1.
What are 10 applications of AI? 1. Credit
What are 10 applications of AI? 1. Credit scoring
What are 10 applications of AI? 1. Credit scoring has
What are 10 applications of AI? 1. Credit scoring has been

Outline
7

Main uses of chatGPT
8
1. Content creation
2. Language translation
3. Email and communication
4. Idea generation
5. Coding
6. Data analysis and visualisation
With help of chatGPT

Main uses of chatGPT
9
1. Content creation
2. Language translation
3. Email and communication
4. Idea generation
5. Coding
6. Data analysis and visualisation

Some examples
15
▪ Title
▪ Abstract
▪ Ask for suggestions
▪ Write in the style of [your favorite academic author]
▪ Proposals
▪ Rebuttal
▪ Tailored towarsd call, eg ERC: high risk high gain. Add the call details and evaluation
criteria.

How should I be using it?
16
▪ Writing assistant: author: abstract, title, rephrasing
▪ As grant applicant or reviewer: summarize, rebuttals, rephrasing, etc.
▪ Creative assistant: coming up with ideas for analogies, examples, structure, etc.
▪ Coding assistant: noone is restricted to “knowing someone who can code”
▪ Prereviewing assistent: ask for comments on writing, methodology,
conclusions, etc.
▪ Should never be an author, nor need to mention the use.
▪ BUT be sure not to commit plagiarism, and beware for the risks…
Galit Shmueli, Bianca Maria Colosimo, David Martens, Rema Padman, Maytal Saar-Tsechansky, Olivia R. Liu Sheng, W. Nick Street, Kwok-
Leung Tsui (2023) How Can IJDS Authors, Reviewers, and Editors Use (and Misuse) Generative AI?
INFORMS Journal on Data Science https://doi.org/10.1287/ijds.2023.0007

Let’s “workshop”
17
▪ Open chatGPT
▪ Open your latest draft paper or proposal.
▪ Go through the steps
1. Writing assistant: author: abstract, title, methodology, conclusion, etc.
2. As grant applicant or reviewer: summarize, rebuttals, rephrasing, etc.
3. Creative assistant: coming up with ideas for analogies, examples, structure, etc.
4. Coding assistant: noone is restricted to “knowing someone who can code”
5. Prereviewing assistent: ask for comments on writing, methodology, conclusions,
etc.
Here is the abstract of a paper. Any comments or suggestions
for improvements? Give an example for each suggestion. Also
state what a good title would be.

Microsoft Copilot is coming
18

19
Asked to Bing Chat on October 15th 2023.

20

21

22
Asked to Bing Chat and Google Scholar on October 17th, 2023.

Outline
23

Generative AI risks
24
1. Hallucinations

25

26

Generative AI risks
27
1. Hallucinations
2. Misuse

Generative AI risks
28
Screenhots captured on October 11th, 2023.

Generative AI risks
29
1. Hallucinations
2. Misuse
3. Data leakage

Generative AI risks
30
1. Hallucinations
2. Misuse
3. Data leakage
4. Bias
https://www.brookings.edu/articles/the-politics-of-ai-chatgpt-and-political-bias/
https://arxiv.org/abs/2005.14165
GPT-3: based on
- 60% from internet-crawled material,
- 22% from curated content from the internet,
- 16% from books,
- 3% from Wikipedia.

Should I use chatGPT?
33
▪ Study by Harvard, BCG on 758 consultants
▪ 18 realistic consulting tasks within the frontier of AI capabilities,
consultants using AI:
▪ 12.2% more tasks,
▪ 25.1% more quickly,
▪ significantly higher quality results
▪ For a task selected to be outside the frontier, 19% less likely to
produce correct solutions compared to those without AI.

Do others use chatGPT?
34
▪ Survey among 1,600 researchers (in 2023)
▪ 25% uses AI to help write manuscripts
▪ 15% use AI to help write grant proposals

Can I check whether chatGPT is used?
35

Tips and tricks
36
▪ Tools
▪ Use GPT-4 (“Plus” paid version, 20 US$ per month, ask your supervisor)
▪ Use Edge Bing for images
▪ For now…
▪ How?
▪ Prompt engineering: learn from experience
▪ Experiment!
▪ Avoid chatGPT-lofty style, state the wanted tone
▪ Beware of the risks and be critical
▪ Field evolves fast: discuss among enthusiasts

37
Conclusion
▪ Embrace AI
▪ Age of AI
▪ Fast moving
▪ “AI is not gonna take your job, someone who understands AI
is going to take your job. Get good at it.” Scott Galloway
▪ Be aware of the risks
▪ Not just a chatGPT issue
▪ Need for education
▪ Not for me?

38
Questions
David Martens,
Data Science Ethics: Concepts, Techniques and Cautionary Tales,
Oxford University Press (March 24, 2022),
272 pages.
www.dsethics.com

How (not) to use chatGPT as a researcher

More Related Content

Similar to How (not) to use chatGPT as a researcher (20)

Recently uploaded (20)

How (not) to use chatGPT as a researcher