The deeper the rabbet is, the more support it provides. The vertical side also makes it easier to align the pieces of wood ...

It has a bottom and one side, leaving the other side open. A rabbet's profile resembles a capital 'L' cut into the wood.