Skip to content

Commit 1a68d78

Browse files
authored
Merge branch 'main' into category/code-review
2 parents e1b0b93 + 4a054c3 commit 1a68d78

3 files changed

Lines changed: 28 additions & 2 deletions

File tree

.github/actions/setup-python-uv/action.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ runs:
1111
using: composite
1212
steps:
1313
- name: Install uv
14-
uses: astral-sh/setup-uv@v7
14+
uses: astral-sh/setup-uv@cec208311dfd045dd5311c1add060b2062131d57
1515
with:
1616
enable-cache: true
1717

.github/workflows/copilot-setup-steps.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ jobs:
2121
uses: actions/checkout@v5
2222

2323
- name: Install uv
24-
uses: astral-sh/setup-uv@v7
24+
uses: astral-sh/setup-uv@cec208311dfd045dd5311c1add060b2062131d57
2525
with:
2626
enable-cache: true
2727

src/bcbench/types.py

Lines changed: 26 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -163,6 +163,32 @@ def summary_class(self) -> type[EvaluationResultSummary]:
163163

164164
raise ValueError(f"Unknown evaluation category: {self}")
165165

166+
@property
167+
def result_class(self) -> type[BaseEvaluationResult]:
168+
from bcbench.results.bugfix import BugFixResult
169+
from bcbench.results.testgeneration import TestGenerationResult
170+
171+
match self:
172+
case EvaluationCategory.BUG_FIX:
173+
return BugFixResult
174+
case EvaluationCategory.TEST_GENERATION:
175+
return TestGenerationResult
176+
177+
raise ValueError(f"Unknown evaluation category: {self}")
178+
179+
@property
180+
def summary_class(self) -> type[EvaluationResultSummary]:
181+
"""Returns the EvaluationResultSummary subclass for this category."""
182+
from bcbench.results.summary import ExecutionBasedEvaluationResultSummary
183+
184+
match self:
185+
case EvaluationCategory.BUG_FIX:
186+
return ExecutionBasedEvaluationResultSummary
187+
case EvaluationCategory.TEST_GENERATION:
188+
return ExecutionBasedEvaluationResultSummary
189+
190+
raise ValueError(f"Unknown evaluation category: {self}")
191+
166192
@property
167193
def pipeline(self) -> EvaluationPipeline:
168194
from bcbench.evaluate import BugFixPipeline, CodeReviewPipeline, TestGenerationPipeline

0 commit comments

Comments
 (0)