This study aims to analyze the prevalence of low muscle mass (LMM) and its associated factors among community-dwelling patients with type 2 diabetes (T2D). A retrospective design was employed to analyze the body composition of 2404 adults with T2D aged 18 years and older. LMM was defined as a skeletal muscle index < 7.0 kg/m2 for males and skeletal muscle index < 5.7 kg/m2 for females by bioelectrical impedance analyzer (InBody 770, Korea). Multivariable logistic regression was used to identify the factors related to LMM. The overall prevalence of LMM was 28%. After adjusting for multivariate odds ratios, factors significantly associated with LMM in patients with diabetes include being older than 75 years, female, having a body mass index of <18 kg/m2, and increased percent body fat. We recommend regular LMM evaluations for T2D patients with the previously mentioned characteristics as part of diabetes care.