X uses its own locale files to specify locale-specific things, and even worse its own shared libraries to implement them.
The --with-xlocale flag allows you to pack those files.
Of course if the application you are about to pack
is not an X application,
there is no point in using --with-xlocale.