Feat/bot leaderboard/v2.3#4435
Conversation
|
Important Review skippedDraft detected. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
🚀 Preview EnvironmentYour preview environment is ready!
Details
ℹ️ Preview Environment InfoIsolation:
Limitations:
Cleanup:
|
Metac bots with metac_bot metadata but used as internal agents (metac-azimuth, metac-agent) should not be included in leaderboard calculations. Co-authored-by: Cursor <cursoragent@cursor.com>
lsabor
left a comment
There was a problem hiding this comment.
Nothing looked out of place to me in what @colesussmeier added. I'm the initial author, so I can't approve, but feel free to merge as is or address the tiny nit I added.
| ) -> float: | ||
| include_discrimination: bool = False, | ||
| min_matches_per_question_for_disc: int = 30, | ||
| ) -> float | tuple[float, float]: |
There was a problem hiding this comment.
Nit: I would avoid conditionally returning different structure outputs. just return tuple[float, float | None], only populating the second float conditionally
No description provided.