Spectral characterizations of graphs with small spectral radius