Michael B. Hall $\in$ Iqbal Group @ EMBL-EBI
@mbhall88 | michael.hall2 [at] unimelb.edu.au
Illumina increasingly being used for TB clustering and DST (England, the Netherlands, New York State)
Requires large capital outlay and significant testing volume to be cost-effective and ensure clinically appropriate turnaround times
ONT's MinION device offers solution to these two issues
Error rate has been an obstacle in the past
Some early signs that error rate has sufficiently improved for DST and clustering
Compare Nanopore to Illumina in its ability to: predict drug resistance and identify putative transmission clusters using SNPs
SNP-based requires high-quality SNP calls
Illumina: COMPASS (stampy, samtools, and BCFtools)
Nanopore: Minimap2 and BCFtools (v1.13) with custom filteringSeven isolates with PacBio CCS data over 20x read depth
Assemble with Flye and polish for indels with Illumina
Recall = $\frac{TP}{TP+FN}$ | Precision = $\frac{TP}{TP+FP}$
psdm
to generate distance matrix
Isolates within (Illumina) distance of 20 SNPs
Illumina thresholds of interest 5 and 12
Take Illumina clustering as truth and see how similar Nanopore clustering is
What Nanopore thresholds to use?
How to define similarity?
SACR - sample-averaged cluster recall
$$\frac{\left|C_{n,I}\cap C_{n,N}\right|}{|C_{n,I}|}$$
$C_{n,I}$ - the Illumina ($I$) cluster of isolate $n$
$C_{n,N}$ - the Nanopore ($N$) cluster of isolate $n$
$\cap$ - intersection
$|x|$ - size/length of $x$
SACP - sample-averaged cluster precision
$$\frac{\left|C_{n,I}\cap C_{n,N}\right|}{|C_{n,N}|}$$
Same as SACR, but denominator is size of Nanopore cluster
SACR and SACP don't identify Nanopore clusters solely composed of Illumina singletons
$$XCR = \frac{|S_I-S_N|}{|S_I|}$$
$S_I$ - Illumina singletons
Example: Illumina (left) and Nanopore (right)
sample | A | B | C | D | E | F | G | H | I | J | avg. |
---|---|---|---|---|---|---|---|---|---|---|---|
recall | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.8 | 0.8 | 0.8 | 0.8 | 0.0 | 0.82 |
precision | 1.0 | 1.0 | 1.0 | 0.66 | 0.66 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0 | 0.83 |
20 Illumina singletons - XCR of $2/20=0.1$.
How do Nanopore WGS-based predictions compare to Illumiuna? (Mykrobe)
If different, what do phenotypes say?
Primary focus is genotype concordance - thoroughly validated
One isolate with a 1bp deletion in katG
One isolate with three 1bp deletions in katG
Drug | FN(R) | FP(S) | FNR(95% CI) | FPR(95% CI) | PPV(95% CI) | NPV(95% CI) |
---|---|---|---|---|---|---|
Isoniazid | 0(81) | 1(70) | 0.0% (0.0-4.5%) | 1.4% (0.3-7.7%) | 98.8% (93.4-99.8%) | 100.0% (94.7-100.0%) |
Rifampicin | 0(79) | 0(72) | 0.0% (0.0-4.6%) | 0.0% (0.0-5.1%) | 100.0% (95.4-100.0%) | 100.0% (94.9-100.0%) |
Ethambutol | 0(54) | 0(97) | 0.0% (0.0-6.6%) | 0.0% (0.0-3.8%) | 100.0% (93.4-100.0%) | 100.0% (96.2-100.0%) |
Pyrazinamide | 0(30) | 0(121) | 0.0% (0.0-11.4%) | 0.0% (-0.0-3.1%) | 100.0% (88.6-100.0%) | 100.0% (96.9-100.0%) |
Streptomycin | 0(47) | 1(104) | 0.0% (0.0-7.6%) | 1.0% (0.2-5.2%) | 97.9% (89.1-99.6%) | 100.0% (96.4-100.0%) |
Amikacin | 0(13) | 1(138) | 0.0% (0.0-22.8%) | 0.7% (0.1-4.0%) | 92.9% (68.5-98.7%) | 100.0% (97.3-100.0%) |
Capreomycin | 0(13) | 1(138) | 0.0% (0.0-22.8%) | 0.7% (0.1-4.0%) | 92.9% (68.5-98.7%) | 100.0% (97.3-100.0%) |
Kanamycin | 0(14) | 1(137) | 0.0% (0.0-21.5%) | 0.7% (0.1-4.0%) | 93.3% (70.2-98.8%) | 100.0% (97.3-100.0%) |
Ciprofloxacin | 0(16) | 0(135) | 0.0% (0.0-19.4%) | 0.0% (0.0-2.8%) | 100.0% (80.6-100.0%) | 100.0% (97.2-100.0%) |
Moxifloxacin | 0(16) | 0(135) | 0.0% (0.0-19.4%) | 0.0% (0.0-2.8%) | 100.0% (80.6-100.0%) | 100.0% (97.2-100.0%) |
Ofloxacin | 0(17) | 0(134) | 0.0% (0.0-18.4%) | 0.0% (0.0-2.8%) | 100.0% (81.6-100.0%) | 100.0% (97.2-100.0%) |
@mbhall88 | michael.hall2 [at] unimelb.edu.au