Evaluation with GitHub Copilot #15
haoranpbcopilot-evaluation.yml
on: workflow_dispatch
get-entries
/
get-entries
13s
Matrix: evaluate-with-copilot-cli
summarize-results
/
Results
Annotations
6 errors and 2 warnings
|
bcbench.evaluate.evaluation_pipeline
Failed to process microsoftInternal__NAV-188438: 'charmap' codec can't encode character '\u2713' in position 163: character maps to <undefined>
|
|
bcbench.agent.copilot.copilot_agent
Unexpected error running Copilot CLI: 'charmap' codec can't encode character '\u2713' in position 163: character maps to <undefined>
|
|
microsoftInternal__NAV-224009
The run was canceled by @haoranpb.
|
|
microsoftInternal__NAV-224009
The operation was canceled.
|
|
bcbench.evaluate.evaluation_pipeline
No result generated for microsoftInternal__NAV-224009
|
|
Evaluation with GitHub Copilot
The run was canceled by @haoranpb.
|
|
bcbench.results.evaluation_result
Creating result for microsoftInternal__NAV-188438 with no agent metrics - performance data will be unavailable
|
|
microsoftInternal__NAV-224009
No files were found with the provided path: evaluation_results. No artifacts will be uploaded.
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
evaluation-results-19224178377-microsoftInternal__NAV-188438
Expired
|
481 Bytes |
sha256:d85b4eeb48bf0c2c4573cfc036071ccc2016a40f0d143b2aba54c0737bd2a7f7
|
|