reftex-file-boundary-face

reftex-file-boundary-face is a variable defined in `reftex-vars.el'.
Its value is

font-lock-comment-face

Documentation:
Face name for file boundaries in selection buffer.

You can customize this variable.