Prolonging garment longevity is a well-recognized key strategy to reduce the overall environmental impact in the textile and clothing sector. In this context, change or degradation in esthetic or visual appeal of a garment with usage is an important factor that largely influence its longevity. Therefore, to engineer the garments for a required lifetime or prolong longevity, there is a need for predictive systems that can forecast the trajectory of visual degradation based on material/structural parameters or use conditions that can guide the practitioners for an optimal design. This paper develops a deep learning based predictive system for washing-induced visual change or degradation of selected garment areas. The study follows a systematic experimental design to generate and capture visual degradation in garment and equivalent fabric samples through 70 cycles in a controlled environment following guideline from relevant washing standards. Further, the generated data is utilized to train conditional Generative Adversarial Network-based deep learning model that learns the degradation pattern and links it to washing cycles and other seam properties. In addition, the predicted results are compared with experimental data using Frechet Inception Distance, to ascertain that the system prediction are visually similar to the experimental data and the prediction quality improves with training process.