Clicking the Apply to drop-down menu provides you with options to apply the border to the currently selected page, the first page only, and all pages but the first page.
By default, the borders are applied to the whole document, meaning every page has the same border.
