BACKGROUND: Developing age-appropriate medications remains a challenge in particular for the population of infants and toddlers, as they are not able to reliably self-report if they would accept and consequently take an oral medicine. Therefore, it is common to use caregivers as proxies when assessing medicine acceptance. The outcome measures used in this research field differ and most importantly lack validation, implying a persisting gap in knowledge and controversy in the field. The newly developed Caregiver-administered Children's Acceptance Tool (CareCAT) is based on a 5-point nominal scale, with descriptors of medication acceptance behavior. This cross-sectional study assessed the measurement properties of the tool with regards to the user's understanding and its intra- and inter-rater reliability. METHODS: Participating caregivers were enrolled at a primary healthcare facility where their children (median age 6 months) had been prescribed oral antibiotics. Caregivers, trained observers and the tool developer observed and scored on the CareCAT tool what behavior children exhibited when receiving the medicine (n = 104). The video-records of this process served as replicate observations (n = 69). After using the tool caregivers were asked to explain their observations and the tool descriptors in their own words. The tool's reliability was assessed by percentage agreement and Cohen's unweighted kappa coefficients of agreement for nominal scales. RESULTS: The study found that caregivers using CareCAT had a satisfactory understanding of the tool's descriptors. Using its dichotomized scores the tool reliably was strong for acceptance behavior (agreement inter-rater 84-88%, kappa 0.66-0.76; intra-rater 87-89%, kappa 0.68-0.72) and completeness of medicine ingestion (agreement inter-rater 82-86%, kappa 0.59-0.67; intra-rater 85-93%, kappa 0.50-0.70). CONCLUSIONS: The CareCAT is a low-cost, easy-to-use and reliable instrument, which is relevant to assess acceptance behavior and completeness of medicine ingestion, both of which are of significant importance for developing age-appropriate medications in infants and toddlers.