Yes. It's the same tax treatment that applies to gold bullion or barrels of oil - volatile commodities that are at least partly speculative investments rather than stable mediums of exchange.
Country-specific, but often you don't have to account for them up to a certain limit, and/or you can treat anything you buy in a foreign national currency as having been bought at what you originally paid for that currency.
That's definitely unfriendly tax treatment. Is it different from the tax treatment that applies to national currencies?