It has been suggested that high altitude can reduce the infectivity and case fatality rate of COVID-19. We investigated the relationship between altitude and the COVID-19 pandemic in Colombia. Epidemiological data included the number of positive cases, deaths, and the case fatality rate of COVID-19. In particular, we analyzed data from 70 cities with altitudes between 1 and 3,180 m. Correlations and linear regression models adjusted to population density were performed to examine the relationship and contribution of altitude to epidemiological variables. The case fatality rate was negatively correlated with the altitude of the cities. The incidence of cases and deaths from COVID-19 had an apparent correlation with altitude; however, these variables were better explained by population density. In general, these findings suggest that living at high altitude can reduce the impact of COVID-19, especially the case fatality rate.