I don’t think collection lightboxes are a thing yet. Sorry! There is a custom code option you should be able to find through the search here on the forum.
ah, sorry. I know there’s another way of doing it with extra javascript. I couldn’t find it at the moment but I know it’s been mentioned on the forum.
EDIT: this is the topic I mentioned. Full CMS Lightbox!. It’s a bit over my head so I can’t help with setting this up but it seems to work for people