reftex-index-header-face

reftex-index-header-face is a variable defined in `reftex-vars.el'.
Its value is

font-lock-comment-face

Documentation:
Face name for the header of an index buffer.

You can customize this variable.