Skip to content

Add SCML arena#100

Merged
Muhtasham merged 6 commits into
CodeClash-ai:mainfrom
Muhtasham:feat/scml-arena
May 5, 2026
Merged

Add SCML arena#100
Muhtasham merged 6 commits into
CodeClash-ai:mainfrom
Muhtasham:feat/scml-arena

Conversation

@Muhtasham
Copy link
Copy Markdown
Contributor

@Muhtasham Muhtasham commented May 5, 2026

Summary

  • add an SCML OneShot arena backed by the upstream scml package
  • include a Docker/runtime adapter for the upstream scml package that runs multiple SCML2024 OneShot simulations and maps SCML agent scores back to CodeClash players
  • register the arena, add an example config, and document SCML in README and reference docs
  • add unit coverage for SCML validation and result parsing

Validation

  • uv run pytest -> 178 passed
  • uv run pytest tests/test_integration.py -> 2 passed
  • uv run pytest tests/arenas/test_scml.py -> 5 passed
  • uv run ruff check codeclash/arenas/scml tests/arenas/test_scml.py codeclash/arenas/__init__.py -> passed
  • local SCML runner smoke with scml==0.8.2 produced valid average-score JSON
  • CodeClash SCML smoke via main.py configs/examples/SCML__dummy__r1__s2.yaml completed successfully
  • GitHub Actions markdown-link-check and test are passing on the latest PR head

Notes

SCML itself remains an upstream dependency maintained outside this repository. This PR only adds the CodeClash adapter, runtime bridge, scoring integration, docs, and tests.

The arena uses the latest released scml==0.8.2 package and its exposed SCML2024OneShotWorld API. A future migration should track newer SCML world classes if upstream exposes them.

@Muhtasham Muhtasham marked this pull request as ready for review May 5, 2026 08:08
@Muhtasham Muhtasham merged commit f854939 into CodeClash-ai:main May 5, 2026
2 checks passed
@Muhtasham Muhtasham mentioned this pull request May 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant