This is fine, just pad it. Low gain / padding is a good thing, because whatever noise is already present in the output of the drums will be turned down / padded by this same amount, using any gain would just increase that noise along with the signal.
Here’s an example, works just the same with any two gains stages.
https://kb.musictribe.com/musickb/view/article/klarkteknik/en_US/How-should-I-set-the-gain-on-my-Active-Splitter-system
Clipping doesn’t really matter if it isn’t audible, but it’s worth making sure it really isn’t audible on a record feed for exmaple, where someone might be using headphones and have a drier mix. The red light isn’t the problem, the audible distortion is. Also keep in mind that the GLD clip indicator lights 3dB before anything actually clips, so you may not be hearing it because it isn’t happening.
If it’s getting within 3dB of clipping with the pad engaged then it’ll be clipping by at least 17dB without the pad, I’d struggle to believe that this isn’t audible. Regarding the quality difference, do an analog Y slpit into two inputs, pad one and apply -20dB digital trim to the other and see if he can tell you which is which.
Chris