This study assessed sperm quality declining on relation to paternal age and its impact on in vitro fertilization (IVF) outcomes in order to estimate the APA (Advanced Paternal Age) cutoff. For this, 83 couples undergoing IVF treatment for male factor infertility were enrolled. The women age was ≤39 years, whereas the men were divided in two groups: APA (n = 41; age ≥ 40 years) and young (Y) (n = 42; age < 40 years). Conventional semen parameters (volume, concentration, motility, vitality, and morphology) were analyzed in the collected sperm samples. Furthermore, sperm genome decays (SGD) was assessed by TUNEL assay (DNA fragmentation), aniline blue staining (chromatin decondensation), and fluorescent in situ hybridization (aneuploidy). No significant difference was found concerning the conventional semen parameters between APA and Y groups. Conversely, SGD analysis showed increased DNA fragmentation; chromatin decondensation and sperm aneuploidy rates in the APA group (respectively, 41%, 43%, and 14% vs. 25%, 23%, and 4% in Y group). IVF outcomes also were affected by paternal age as indicated by the rates of cancelled embryo transfers, clinical pregnancy and miscarriage in the two groups APA and Y (29%, 17%, and 60% vs. 10%, 32%, and 42%). Finally, statistical analysis of the results suggests that the age of 40 should be considered as the APA cutoff during ART attempts