How can I configure the Command Prompt to display French correctly?

Try changing the code page with the chcp command. For example:

chcp 1252

and change the command prompt font properties to "Lucida Console"