Product Launch
anonymous
6 points
2 comments
Posted3 months agoActive2 months ago
Show HN: Narada – Open-source secrets classification model
secrets detectionAI in securityopen-source
Discussion (2 comments)
Showing 2 comments
I'm curious how Kingfisher would do against the proprietary dataset:
https://github.com/mongodb/kingfisher
Any chance you could try and share results? Full disclosure, I built Kingfisher
2 months ago
Jai here, from Autofix Bot team. We've published results of the initial benchmark run[1] comparing Gitleaks, detect-secrets and trufflehog ~3 weeks ago. In the meantime, we've put together a significantly improved dataset, and we're planning to rerun those benchmarks shortly; will include Kingfisher to the list, and share the results here.
Btw, we use Kingfisher's validation system internally for generating request/expected_response pairs for a given secret, as the last step of the pipeline. We don't run/call the validation queries ourselves, due to rate limit issues. But, we add this information in a structured format as part of the response which can be executed on the client side (or) by the user who is integrating via the API. Thanks for building it :)
[1] https://autofix.bot/benchmarks/#benchmarks-secrets-detection