I do something similar. I keep a separate carabiner with rings for lesser-used keys. For example, I have house keys for my parents' house and grandmother's house in my home town, which I only visit a couple times a year. There are definitely some dead weight keys on there, but I haven't been able to sort all of them.

This giant carabiner stays in a jug with my passport. The jug sits next to the underwear drawer, so I can grab what I need for a trip very easily.