Hmm, not necessarily true in 1906, when the story was published. Two-cent coins were minted until 1873, only 33 years before. It is easy to imagine they were still in circulation, given that it is not at all rare to see a 33-year old coin nowadays.
Added: three-cent coins seem to have been...