Parallel Budget Network for Longitudinal Data Analysis