The characteristic electron-phonon coupling time in unconventional superconductors and implications for optical detectors