Registration for a live webinar on 'Precision medicine treatment for anticancer drug resistance' is now open.
See webinar detailsWe noted you are experiencing viewing problems
-
Check with your IT department that JWPlatform, JWPlayer and Amazon AWS & CloudFront are not being blocked by your network. The relevant domains are *.jwplatform.com, *.jwpsrv.com, *.jwpcdn.com, jwpltx.com, jwpsrv.a.ssl.fastly.net, *.amazonaws.com and *.cloudfront.net. The relevant ports are 80 and 443.
-
Check the following talk links to see which ones work correctly:
Auto Mode
HTTP Progressive Download Send us your results from the above test links at access@hstalks.com and we will contact you with further advice on troubleshooting your viewing problems. -
No luck yet? More tips for troubleshooting viewing issues
-
Contact HST Support access@hstalks.com
-
Please review our troubleshooting guide for tips and advice on resolving your viewing problems.
-
For additional help, please don't hesitate to contact HST support access@hstalks.com
We hope you have enjoyed this limited-length demo
This is a limited length demo talk; you may
login or
review methods of
obtaining more access.
Printable Handouts
Navigable Slide Index
- Introduction
- The series
- Review
- Coming up
- Part 2: outline
- Challenges
- Some history
- Meanwhile
- Heuristics and biases
- Anchoring
- Anchoring: example
- Availability
- Overconfidence
- Overconfidence can be overstated
- A first view of SHELF
- The SHELF system
- Meeting the challenges
- Why elicit distributions?
- Too many probabilities!
- A pragmatic approach
- Elicit a few summaries
- The basic SHELF tertile method
- Then fit a distribution
- SHELF 4 package contents
- SHELF templates
- A SHELF template
- Annotated template
- An illustrative example – 1
- An illustrative example – 2
- SHELF slide sets
- Median
- Median, M
- Placement of M: examples
- Challenging your median
- Refining your median
- Recap
Topics Covered
- Fundamentals of elicitation
- Challenges for subjective probability judgments
- Sources of bias
- Anchoring, availability, and overconfidence
- SHELF (Sheffield Elicitation Framework) principles
- Basic SHELF tertile method
- SHELF 4
- SHELF templates
- SHELF slide sets
Talk Citation
O'Hagan, A. (2023, February 28). Expert knowledge elicitation with SHELF: one distribution, one expert [Video file]. In The Biomedical & Life Sciences Collection, Henry Stewart Talks. Retrieved January 23, 2025, from https://doi.org/10.69645/CIMR2243.Export Citation (RIS)
Publication History
Financial Disclosures
- Tony O'Hagan acts as a consultant providing training and advice on the use of SHELF.
Other Talks in the Series: Expert Knowledge Elicitation with SHELF
Transcript
Please wait while the transcript is being prepared...
0:00
Welcome to the second
talk in this series,
Expert Knowledge
Elicitation with SHELF.
This one is entitled 'One
Distribution, One Expert'.
0:13
The course as a whole
- as you know -
has four talks, and this
one is the second one.
The first was 'Uncertainty
and probability',
which we've already done and the
next two are going to be
'Multiple experts' and
'Skills and resources'.
But let's just
recap where we were
after the first one.
0:32
In the first part we dealt
with the uncertainty
and probability,
we saw that expert
knowledge elicitation is
a valuable tool in quantifying
knowledge about
uncertain parameters,
which will help in
decision-making
in many application areas,
such as, for instance,
the pharmaceutical
and healthcare field.
We gave a couple of examples
of that in the first talk.
We also learnt that
expert probabilities
are elicited as
subjective judgements,
which like the many
subjective judgements
that scientists make,
need to be made
carefully, considering
all the available
evidence and using
a recognised and well-designed
protocol such as SHELF.
SHELF is the Sheffield
Elicitation Framework
and it's the subject of
this series of talks.
1:16
In this talk we'll
deal with identifying
challenges for subjective
probability judgements.
These are psychological
heuristics that can lead us to
biased judgements,
and we'll see how
the SHELF protocol
addresses those challenges.
It uses a carefully
constructed sequence of
questions designed to minimise
the potential for bias.
1:38
The outline of this talk
will be, first of
all, the challenges,
heuristics and biases,
and then we'll
take a first look at SHELF,
about eliciting a distribution,
the basic approach
that we use, and
the templates and slide sets
that shelf has
available for use.
Hide