Intrinsic biophysical cell properties hold an enormous potential for cell class and state classification in microfluidics, allowing to avoid the need of cost intensive fluorescence labelling. Several methods can accomplish cell identification, while convolutional neural networks show an outstanding performance compared to other state-of-the-art classification methods, regarding accuracy and speed. In fact, neural networks show high performance for known image class prediction but struggles when unknown (out of distribution) image classes need to be identified. In such a scenario no prior knowledge of the unknown cell class can be used for the model training, which inevitably results in image misclassification. In fact, to distinguish unknown cell classes, a neural network must first construct an in-distribution of known images to afterwards detect out of distribution as unknowns, which is also called open-set classification assumption. Ones, a new cell class is identified, the neural network can be retrained with the obtained knowledge to dynamically update its cell class database. This process can be simply repeated for each new detected cell class. We applied this open-set idea to scattering pattern snapshots of different classes of living cells obtained in microfluidics. Our outcome shows a proof-of-concept for open-set based convolutional neural network for cell image classification, which can be applied to a wide range of single cell classification approaches to reduce uncertainty in machine learning based technologies.

Out of distribution detection in deep learning-based scattering pattern classification / Dannhauser, D.; Netti, P. A.; Causa, F.. - 12622:(2023). (Intervento presentato al convegno Optical Methods for Inspection, Characterization, and Imaging of Biomaterials VI 2023 tenutosi a deu nel 2023) [10.1117/12.2670208].

Out of distribution detection in deep learning-based scattering pattern classification

Dannhauser D.
;
Netti P. A.;
2023

Abstract

Intrinsic biophysical cell properties hold an enormous potential for cell class and state classification in microfluidics, allowing to avoid the need of cost intensive fluorescence labelling. Several methods can accomplish cell identification, while convolutional neural networks show an outstanding performance compared to other state-of-the-art classification methods, regarding accuracy and speed. In fact, neural networks show high performance for known image class prediction but struggles when unknown (out of distribution) image classes need to be identified. In such a scenario no prior knowledge of the unknown cell class can be used for the model training, which inevitably results in image misclassification. In fact, to distinguish unknown cell classes, a neural network must first construct an in-distribution of known images to afterwards detect out of distribution as unknowns, which is also called open-set classification assumption. Ones, a new cell class is identified, the neural network can be retrained with the obtained knowledge to dynamically update its cell class database. This process can be simply repeated for each new detected cell class. We applied this open-set idea to scattering pattern snapshots of different classes of living cells obtained in microfluidics. Our outcome shows a proof-of-concept for open-set based convolutional neural network for cell image classification, which can be applied to a wide range of single cell classification approaches to reduce uncertainty in machine learning based technologies.
2023
Out of distribution detection in deep learning-based scattering pattern classification / Dannhauser, D.; Netti, P. A.; Causa, F.. - 12622:(2023). (Intervento presentato al convegno Optical Methods for Inspection, Characterization, and Imaging of Biomaterials VI 2023 tenutosi a deu nel 2023) [10.1117/12.2670208].
File in questo prodotto:
File Dimensione Formato  
126220F.pdf

solo utenti autorizzati

Licenza: Non specificato
Dimensione 581.82 kB
Formato Adobe PDF
581.82 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11588/954488
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact