I would be good if the horizontal login function had the "Aria-label="Username" and "Aria-label="forgot password" and such present. I'm working on a site (klasusers.com) that is specifically geared for folks uses screen readers.
This is easy to add. I've added the issue to our tracker and checked in the code for the next release. When we updated the login for J4/5, it was based off the templates in mod_login, which didn't have those elements.