To effectively monitor bird populations, accurate identification of species is critical. However, the reliability of species identification is rarely taken into account or quantified. For this study, bird call data was collected using automated acoustic recording devices (ARDs) over a 3-year period. We then compared the results from experienced ornithologists who independently identified bird calls from the same samples. Results were highly variable.