It isn't case sensitive. (At least in the plain authentication method.)
See:
https://github.com/splitbrain/dokuwiki/blob/master/inc/auth/plain.class.php#L323 - The 'i' appendix in the regexp field tell the function to ignore case sensitivity.
Are you using another authentication backend?