Interpretable Multimodal Zero-Shot ECG Diagnosis via Structured Clinical Knowledge Alignment
📝 Abstract
Electrocardiogram (ECG) interpretation is essential for cardiovascular disease diagnosis, but current automated systems often struggle with transparency and generalization to unseen conditions. To address this, we introduce ZETA, a zero-shot multimodal framework designed for interpretable ECG diagnosis aligned with clinical workflows. ZETA uniquely compares ECG signals against structured positive and negative clinical observations, which are curated through an LLM-assisted, expert-validated process, thereby mimicking differential diagnosis. Our approach leverages a pre-trained multimodal model to align ECG and text embeddings without disease-specific fine-tuning. Empirical evaluations demonstrate ZETA's competitive zero-shot classification performance and, importantly, provide qualitative and quantitative evidence of enhanced interpretability, grounding predictions in specific, clinically relevant positive and negative diagnostic features. ZETA underscores the potential of aligning ECG analysis with structured clinical knowledge for building more transparent, generalizable, and trustworthy AI diagnostic systems. We will release the curated observation dataset and code to facilitate future research.
- 🩺 Clinical Grounding: Structured positive/negative observations emulate differential diagnosis, enhancing medical reasoning.
- 🧠 Expert-in-the-Loop Curation: LLM-guided + expert-validated annotation pipeline ensures trustworthy and clinically relevant supervision.
- 📊 Transparent Evaluation: Interpretability metrics and qualitative diagnostics support actionable insights beyond accuracy.
Checkpoint
download “best.pt” to "ZETA/checkpointS/best.pt"