In-process defect monitoring is critical for guaranteeing the integrity of Gas Metal Arc Welding (GMAW) joints. Conventional non-destructive testing (NDT) delivers high-quality diagnostics only after the weld has finished, precluding immediate corrective action. We present the Multi-modal BiFPN Gate Network (MBGN), a deep-learning framework that fuses two complementary data streams: (i) time-synchronized welding current and voltage waveforms processed by a one-dimensional CNN, and (ii) high-speed molten-pool imagery processed by a ResNet backbone. The two modalities are merged through a Bidirectional Feature Pyramid Network (BiFPN), and a lightweight Gate module adaptively recalibrates cross-modal interactions before a final classifier. Experiments on an industrially collected multimodal dataset demonstrate that MBGN achieved 0.748 accuracy and 0.719 macro-F1 on the held-out evaluation set. Compared with the strongest task-matched multimodal baseline, MWFN, MBGN improved macro-F1 by 0.120 while maintaining comparable accuracy. These results indicate the potential of multimodal fusion for in-process GMAW defect monitoring under the investigated industrial conditions, while broader deployment still requires validation across additional materials, joint types, and online system configurations.

MBGN: multimodal BiFPN gate network for in-process GMAW defect detection / Zhao, X., She, Y., Mattera, G., Hu, L., Sun, Z., Li, Y., Yu, X.. - In: MECHANICAL SYSTEMS AND SIGNAL PROCESSING. - ISSN 0888-3270. - 258:(2026). [10.1016/j.ymssp.2026.114696]

MBGN: multimodal BiFPN gate network for in-process GMAW defect detection

Mattera, Giulio;
2026

Abstract

In-process defect monitoring is critical for guaranteeing the integrity of Gas Metal Arc Welding (GMAW) joints. Conventional non-destructive testing (NDT) delivers high-quality diagnostics only after the weld has finished, precluding immediate corrective action. We present the Multi-modal BiFPN Gate Network (MBGN), a deep-learning framework that fuses two complementary data streams: (i) time-synchronized welding current and voltage waveforms processed by a one-dimensional CNN, and (ii) high-speed molten-pool imagery processed by a ResNet backbone. The two modalities are merged through a Bidirectional Feature Pyramid Network (BiFPN), and a lightweight Gate module adaptively recalibrates cross-modal interactions before a final classifier. Experiments on an industrially collected multimodal dataset demonstrate that MBGN achieved 0.748 accuracy and 0.719 macro-F1 on the held-out evaluation set. Compared with the strongest task-matched multimodal baseline, MWFN, MBGN improved macro-F1 by 0.120 while maintaining comparable accuracy. These results indicate the potential of multimodal fusion for in-process GMAW defect monitoring under the investigated industrial conditions, while broader deployment still requires validation across additional materials, joint types, and online system configurations.
2026
MBGN: multimodal BiFPN gate network for in-process GMAW defect detection / Zhao, X., She, Y., Mattera, G., Hu, L., Sun, Z., Li, Y., Yu, X.. - In: MECHANICAL SYSTEMS AND SIGNAL PROCESSING. - ISSN 0888-3270. - 258:(2026). [10.1016/j.ymssp.2026.114696]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11588/1060699
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact