Show HN: Rubbrband – Evaluating generated images at scale
3 comments
Nice! What kinds of companies are generating enough AI images that they need automated image assessment? Is it only AI companies doing image galleries, or are there some more enterprise style companies
That astronaut with a coffee cup in space still looks very silly to me, apart from the eyes, just because the cup handle is facing the wrong way while the hand is positioned as if holding it by the handle.
He's also got six fingers on his right hand and his index finger on the left hand is way too long.
Hm that's true.
We're working on ways to evaluate if an image looks "off" - but its a hard problem because a lot of it is subjective
We're working on ways to evaluate if an image looks "off" - but its a hard problem because a lot of it is subjective
Yeah, I didn't mean that as a criticism, it's probably impossible to account for everything, and what is off in one context might be fine in another. Filtering out images that contain messed up objects and body parts still hugely reduces the amount of images a human has to look at, so that's valuable either way.
I have no clue about SD other than toying with it, so forgive if this is naive, but do you have any plans to maybe feed this back into the generation, e.g. jiggle the the seed or other parameters around a little until no fingers are malformed?
I have no clue about SD other than toying with it, so forgive if this is naive, but do you have any plans to maybe feed this back into the generation, e.g. jiggle the the seed or other parameters around a little until no fingers are malformed?
Yeah I think it's a great idea! Right now because the models are so finnicky changing the seed often does lead to an image with desirable qualities(ie: good hands) so this makes sense.
I do think over time the feedback loops will look much different, as the models get more solid.
I do think over time the feedback loops will look much different, as the models get more solid.
Is the first image under "realistic hands" intended to have six fingers on one hand?
[deleted]
Yes it is. That caption is indeed confusing - pushed a fix!
That makes more sense now :) Although now all the images in that first row appear distorted to me.
We’ve worked with several companies leveraging generative image models in production, and found that one of the main problems is that it’s hard to filter images for good quality sample at scale. Typically, teams will have to manually look through the images for these samples, which is slow and expensive.
We wanted to build a monitoring solution that lets you to see all of the images you’ve generated, and to automatically be alerted when an image was generated with a deformity.
We’ve started by building evaluators that detects deformities in human features, like face and hands. We’re focused on expanding rapidly into build evaluators for other types of images, like gaming and design assets.
We charge using a storage-based pricing model. Rubbrband costs 5¢ per image to use, with your first 1000 images uploaded free.
We’d love to hear your thoughts and critiques, if you have any feature requests please let us know!