This phrase describes something that's directly in front of a building on the other side of the the street.

You can also use it to talk about somewhere that's very close by, but not literally right across the street.