Improve docs: quickstart guide, standardize README, add results table

[rajkumar42]

Summary

Make this benchmark repo more accessible to new contributors by adding a quickstart guide, standardizing the README structure, and including a results summary table.

What needs to happen

Quickstart ("Run your first benchmark in 5 minutes")

• Add a short section at the top of README with minimal steps to run the benchmark
• Include: clone, install deps, set API key, run a small subset
• Example: python run_benchmark.py --limit 5 to run just 5 tasks

Standardize README

• Follow a consistent structure: Overview → Quickstart → Full Setup → Results → Contributing
• Align with other OpenSymbolicAI benchmark repos for consistency
• Include badges (Python version, license, etc.)

Results summary table

• Add a markdown table showing results per model/provider
• Columns: Model | Pass Rate | Avg Tokens | Avg Cost | Date
• Keep the table updated as new provider results come in

Acceptance criteria

• A newcomer can go from clone to first benchmark result in under 5 minutes
• README follows the standardized structure
• Results table is present with at least one row of data

[TaniaW777]

Hi @rajkumar42, I'd like to take on this task! I'm planning to:

Standardize the README structure as requested.

Add the Quickstart section.

Create the Results summary table.

Quick question: For the results table data, should I use the latest logs from the results/ folder or do you have specific values you'd like me to include for the first row?

Thanks! I'll start working on a PR.

[rajkumar42]

Thanks for picking it up @TaniaW777!

Quick question: For the results table data, should I use the latest logs from the results/ folder or do you have specific values you'd like me to include for the first row?

As for this, observe the current output pick the column names as suggested. Once this PR is merged I'll add some runs I have.

[TaniaW777]

Hi @rajkumar42, thanks for the feedback! I've already submitted the PR #9 with the standardized structure and the results table using the suggested columns. I included a baseline row for GPT-4o based on current outputs as a placeholder. Let me know if you need any adjustments before merging!