Is a cell a battery?

A single cell produces a fixed voltage; a battery is two or more cells combined for higher voltage/current. In everyday use, "AA battery" is technically a single cell.