The Tower is where all the Ravens meet up for rest and to take on new quests.
Most of the time, these actually are Towers, as a structure that can go high in the sky is required to send ravens out to scout the area.
However, the building being tall isn't necessary, as there are towers that extend deep into the ground instead of the sky, the New York tower being a good example of this.