Cancer survivors with diabetes tend to have worse glycemic control after their cancer diagnosis, which may increase the risk of cardiovascular diseases. We aimed to investigate whether glycemic control differs between colorectal cancer (CRC) survivors and those without cancer, among patients with type 2 diabetes being treated in the Dutch primary care. The Zwolle Outpatient Diabetes project Integrating Available Care database was linked with the Dutch Cancer Registry (n = 71,648, 1998–2014). The cases were those with stage 0–III CRC, and the controls were those without cancer history. The primary and secondary outcomes were the probability of reaching the glycated hemoglobin (HbA1c) target and the mean of HbA1c during follow-up, respectively. Mixed linear modeling was applied, where the status of CRC was a time-varying variable. Among the 57,330 patients included, 705 developed CRC during follow-up. The mean probability of reaching the HbA1c target during follow-up was 73% versus 74% (p = 0.157) for CRC survivors versus those without cancer, respectively. The mean HbA1c was 51.1 versus 50.8 mmol/mol (p = 0.045) among CRC survivors versus those without cancer, respectively. We observed a clinically comparable glycemic control among the CRC survivors without cancer, indicating that glycemic control for CRC survivors can be delegated to primary care professionals.