Multi-SWE-Bench Integration

[neubig]

What problem or use case are you trying to solve?

It would be good to know OpenHands's performance on Java and other major languages.

Describe the UX of the solution you'd like

Multi-SWE-Bench makes this possible: https://multi-swe-bench.github.io/#/
We should incorporate it into our evaluation harness.

[JohnsterID]

I see ByteDance on the charts using OpenHands: https://github.com/multi-swe-bench/MopenHands

[neubig]

Yeah, so I expect that OpenHands will do a reasonable job at this, but we need to have benchmarks in our eval harness in order to iterate on them as OpenHands improves.