Yes ... mine is both (a switch -- 4 in; a splitter -- 2 out).
I would suggest you choose a powered unit, one capable of supporting HDMI 1.3 or 1.4 HDCP, and full HD 1080P.
And yes ... they can be finiky. So order from somewhere you can return and order a different brand if you find the one you get doesn't happen to like your TV's (and if you need to troubleshoot, try silly things like using different cables or plugging the TV's into the a different port on the splitter).