It does seem like Sweden is quite a bit easier to start up a business, cost-wise and regulation-wise, than the rest of Scandinavia.

I looked into starting a company in Denmark and was quickly put off.

The regulation is still pretty high compared to the US though. Especially once you plan to start employing people. Not that that'd a bad thing.