Build your own eval tools, pretty much always
(hypernatural.substack.com)
Invest in eval tooling early! We built our own quality evaluation system to dramatically improve our video outputs. It’s not that hard, and if you’re building a service that outputs video or uses multiple generative models simultaneously, you should probably build your own system too.
Invest in eval tooling early! We built our own quality evaluation system to dramatically improve our video outputs. It’s not that hard, and if you’re building a service that outputs video or uses multiple generative models simultaneously, you should probably build your own system too.