Yeah, “orthogonal” here just means “not diagonal”. Since GoL configurations don’t have a distinguished orientation (you can rotate and/or mirror them however you like), it wouldn’t make sense to specify up/down/left/right, at least not without first fixing an (arbitrary) orientation.
I was a bit confused by that wiki page because it says "Direction Orthogonal" but like you said that can't be.