American Society of Functional Neuroradiology
The Challenge
We are challenging you with a unique, carefully curated, gold-standard, test dataset of non-contrast head CTs from the emergency room!
Ready?
Prime-time
Want Neuroradiologists to use your AI algorithm? Come to the ASFNR Annual Meeting in November in San Francisco and convince them using their own dataset!
Set?
Our Dataset
• 1,200 deidentified studies
• From 4 international contributing institutions (Lausanne, Maryland, UC Irvine, Wake Forest) and different types of CT scanners (GE, Siemens, Philips and Toshiba)
• Encompassing a broad variety of clinically relevant pathology: trauma, hemorrhage, stroke, hydrocephalus, mass effect, etc
*Our dataset is for testing only, not for development. For development, please use any publicly available datasets such as: http://headctstudy.qure.ai/dataset, https://www.kaggle.com/felipekitamura/head-ct-hemorrhage. You are of course welcome to use any dataset that you have access to.
Go!
Winners announced at the ASFNR Annual Meeting
We will identify the three best AI algorithms for each of the following:
Normal/abnormal for age
Stroke
Intracranial hemorrhage
Trauma
Mass Effect
Degree of Urgency
The Labels
Our labels:
• All head CT scans were labeled by 5 CAQ neuroradiologists who all previously completed a two-year neuroradiology fellowship training program
• Consensus among the neuroradiologists was > 90% (any disagreements were resolved by consensus review)
• Each CT scan was labeled in three categories:
1. Normal or Abnormal for Age
Presence or absence of intracranial pathology with consideration to patient age.
0 = Normal for age: normal examination with/without incidental findings including:
- Microvascular ischemic changes
- Brain volume loss (appropriate for age)
- Incidental calcification (basal ganglia, etc)
- Sinus mucosal thickening
- TMJ degenerative changes
- Upper C-spine degenerative changes (not severe)
1 = Abnormal for age:
Any intracranial abnormality, especially those explicitly defined in categories below.
Sinus air-fluid levels
2. Category of Abnormality (list as many as you want)
- Acute ischemic stroke (early ischemic sign such as dense artery sign, sulcal effacement, loss of the gray white differentiation)
- Subacute ischemic stroke (hypodensity)
- Acute hemorrhage (or acute on chronic hemorrhage - need to see hyperdense blood)
- TBI
- Ventriculomegaly
- Mass effect: any of midline shift, sulcal effacement, cisternal effacement, herniation, etc
- Brain mass: including both intra-axial and extra-axial lesions; benign or malignant
- Bone lesion (other than fracture, which would go into TBI)
- Sinus, face, temporal bone or mastoid disease or abnormality
- Other
3. Degree of Urgency
- Emergent finding - intervention immediately needed (for instance large acute ischemic stroke or large intracranial hemorrhage, or severe ventriculomegaly or severe mass effect)
- Critical finding - referring clinician should be called urgently - within an hour (for instance subacute stroke, small stroke or small hemorrhage, or TBI, or mild mass effect)
- Actionable finding - significant but not urgent finding - one hour onward (for instance brain tumors or mild ventriculomegaly, need another imaging study)
- Incidental finding - minor abnormality (for instance small meningioma, classic arachnoid cyst)
- Normal for age
Participants
Join these groups in the competition
