There is no such issue with any other guests regardless of their OS type.
Does this mean that you have another Windows 10 guest (not made using Converter) and that one works?
Also did you try this workaround Re: Caps Lock not working after upgrade to 15.5.5 build-16285975 yesterday that helped several users having keyboard problems?