Globally, anemia is a public health problem affecting mostly women of reproductive age (WRA, n = 452) and children aged 6-59 months (n = 452) from low- and lower-middle-income countries. This cross-sectional study assessed the prevalence and determinants of anemia in WRA and children aged 6-59 months in rural Zimbabwe. The venous blood sample was measured for hemoglobin utilizing a HemoCue machine. Anthropometric indices were assessed and classified based on World Health Organization standards. Socioeconomic characteristics were assessed. The median (±inter quartile range (IQR)) age of WRA was 29 ± 12 years and that for children was 29 ± 14 months. The prevalence of anemia was 29.6% and 17.9% in children and WRA, respectively, while the median (±IQR) hemoglobin levels were 13.4 ± 1.8 and 11.7 ± 1.5 g/dl among women and children, respectively. Multiple logistic regression analysis was used to assess determinants of anemia. Anemia in children was significantly associated with maternal anemia (odds ratio (OR) = 2.02; 95% CI 1.21-3.37; p = .007) and being a boy (OR = 0.63; 95% CI 0.41-0.95; p = .029), while anemia in WRA was significantly associated with the use of unimproved dug wells as a source of drinking water (OR = 0.36; 95% CI 0.20-0.66; p = .001) and lack of agricultural land ownership (OR = 0.51; 95% CI 0.31-0.85; p = .009). Anemia is a public health problem in the study setting. The positive association between maternal and child anemia reflects the possibility of cross-generational anemia. Therefore, interventions that focus on improving preconceptual and maternal nutritional status may help to reduce anemia in low-income settings.