-
Notifications
You must be signed in to change notification settings - Fork 11
Expand file tree
/
Copy pathbenchmarks.html
More file actions
116 lines (111 loc) · 8.13 KB
/
Copy pathbenchmarks.html
File metadata and controls
116 lines (111 loc) · 8.13 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>Toonify MCP Structured Data Benchmarks</title>
<meta name="description" content="Structured-data benchmark summary for Toonify MCP, including current measured results and reproduction steps.">
<meta name="robots" content="index,follow,max-snippet:-1,max-image-preview:large,max-video-preview:-1">
<meta name="author" content="PCIRCLE AI">
<meta name="theme-color" content="#2563EB">
<link rel="icon" href="favicon.svg" type="image/svg+xml">
<link rel="canonical" href="https://toonify.pcircle.ai/benchmarks.html">
<link rel="alternate" hreflang="en" href="https://toonify.pcircle.ai/benchmarks.html">
<link rel="alternate" hreflang="zh-TW" href="https://toonify.pcircle.ai/benchmarks-zh.html">
<link rel="alternate" hreflang="x-default" href="https://toonify.pcircle.ai/benchmarks.html">
<meta property="og:type" content="article">
<meta property="og:site_name" content="Toonify MCP">
<meta property="og:locale" content="en_US">
<meta property="og:url" content="https://toonify.pcircle.ai/benchmarks.html">
<meta property="og:title" content="Toonify MCP Structured Data Benchmarks">
<meta property="og:description" content="Measured structured-data benchmark results, observed range, and reproduction steps for Toonify MCP.">
<meta name="twitter:card" content="summary">
<meta name="twitter:title" content="Toonify MCP Structured Data Benchmarks">
<meta name="twitter:description" content="Measured structured-data benchmark results, observed range, and reproduction steps for Toonify MCP.">
<link rel="stylesheet" href="assets/tailwind.css">
<link rel="preconnect" href="https://fonts.googleapis.com">
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
<link href="https://fonts.googleapis.com/css2?family=IBM+Plex+Sans:wght@300;400;500;600;700&family=JetBrains+Mono:wght@400;500;600;700&display=swap" rel="stylesheet">
<style>
body { font-family: 'IBM Plex Sans', system-ui, sans-serif; background: #f8fafc; color: #0f172a; }
.heading-mono { font-family: 'JetBrains Mono', monospace; }
.code-block { background: #0f172a; color: #e2e8f0; border-radius: 0.75rem; padding: 1rem 1.25rem; overflow-x: auto; }
.card { background: white; border: 1px solid #e2e8f0; border-radius: 1rem; padding: 1.5rem; }
.pill { display: inline-block; padding: 0.25rem 0.6rem; border-radius: 9999px; background: #dbeafe; color: #1d4ed8; font-size: 0.875rem; font-weight: 600; }
</style>
</head>
<body>
<div class="max-w-5xl mx-auto px-4 py-12">
<div class="mb-8">
<a href="index.html" class="text-blue-600 hover:text-blue-700 text-sm font-medium">← Back to Home</a>
</div>
<header class="mb-10">
<span class="pill">Structured Data</span>
<h1 class="text-4xl md:text-5xl font-bold heading-mono mt-4 mb-4">Toonify MCP Structured Data Benchmarks</h1>
<p class="text-lg text-slate-700 max-w-3xl">
This page summarizes the current structured-data benchmark snapshot for Toonify MCP. It exists to show measured results, how to reproduce them, and where they fit in the broader product story.
</p>
</header>
<section class="grid grid-cols-1 md:grid-cols-3 gap-6 mb-10">
<div class="card">
<div class="text-sm text-slate-500 heading-mono mb-2">STRUCTURED DATA SUITE</div>
<div class="text-3xl font-bold heading-mono text-blue-600 mb-2">12 fixtures</div>
<p class="text-slate-700">JSON-style structured-data benchmark cases covering small, medium, large, nested, multilingual, CSV-like, and API-shaped payloads.</p>
</div>
<div class="card">
<div class="text-sm text-slate-500 heading-mono mb-2">LOCAL VERIFICATION RUN</div>
<div class="text-3xl font-bold heading-mono text-blue-600 mb-2">48.1%</div>
<p class="text-slate-700">Average savings from the most recent local run performed on April 30, 2026.</p>
</div>
<div class="card">
<div class="text-sm text-slate-500 heading-mono mb-2">OBSERVED RANGE</div>
<div class="text-3xl font-bold heading-mono text-blue-600 mb-2">24.5-66.3%</div>
<p class="text-slate-700">Minimum to maximum savings observed in that same run.</p>
</div>
</section>
<section class="card mb-10">
<h2 class="text-2xl font-bold heading-mono mb-4">Reproduction</h2>
<p class="text-slate-700 mb-4">
The benchmark numbers above come from the checked-in Jest benchmark suite below.
</p>
<div class="code-block mb-4"><code>NODE_OPTIONS=--experimental-vm-modules npx jest tests/benchmarks/quick-stats.test.ts --runInBand</code></div>
<div class="flex flex-wrap gap-4 text-sm">
<a href="https://github.com/PCIRCLE-AI/toonify-mcp/blob/main/tests/benchmarks/quick-stats.test.ts" class="text-blue-600 hover:text-blue-700">Open benchmark suite on GitHub</a>
<a href="https://github.com/PCIRCLE-AI/toonify-mcp/blob/main/tests/benchmarks/token-savings.test.ts" class="text-blue-600 hover:text-blue-700">Open extended token benchmark file</a>
<a href="https://github.com/PCIRCLE-AI/toonify-mcp/blob/main/tests/benchmarks/code-compression-benchmark.ts" class="text-blue-600 hover:text-blue-700">Open code compression benchmark source</a>
</div>
</section>
<section class="card mb-10">
<h2 class="text-2xl font-bold heading-mono mb-4">Current Verified Results</h2>
<div class="overflow-x-auto">
<table class="w-full text-left border-collapse">
<thead>
<tr class="border-b border-slate-200">
<th class="py-2 pr-4">Category</th>
<th class="py-2 pr-4">Average</th>
<th class="py-2">Notes</th>
</tr>
</thead>
<tbody class="text-slate-700">
<tr class="border-b border-slate-100"><td class="py-2 pr-4">Small</td><td class="py-2 pr-4">48.1%</td><td class="py-2">2 cases</td></tr>
<tr class="border-b border-slate-100"><td class="py-2 pr-4">Medium</td><td class="py-2 pr-4">65.0%</td><td class="py-2">2 cases</td></tr>
<tr class="border-b border-slate-100"><td class="py-2 pr-4">Large</td><td class="py-2 pr-4">42.6%</td><td class="py-2">2 cases</td></tr>
<tr class="border-b border-slate-100"><td class="py-2 pr-4">CSV-like</td><td class="py-2 pr-4">24.5%</td><td class="py-2">1 case in quick suite</td></tr>
<tr class="border-b border-slate-100"><td class="py-2 pr-4">Nested</td><td class="py-2 pr-4">48.2%</td><td class="py-2">1 case</td></tr>
<tr class="border-b border-slate-100"><td class="py-2 pr-4">Multilingual</td><td class="py-2 pr-4">46.3%</td><td class="py-2">English + Chinese cases</td></tr>
<tr><td class="py-2 pr-4">API-shaped</td><td class="py-2 pr-4">50.3%</td><td class="py-2">2 cases</td></tr>
</tbody>
</table>
</div>
</section>
<section class="card">
<h2 class="text-2xl font-bold heading-mono mb-4">Related Evidence</h2>
<ul class="list-disc list-inside text-slate-700 space-y-2">
<li>Current package version: <a class="text-blue-600 hover:text-blue-700" href="https://github.com/PCIRCLE-AI/toonify-mcp/blob/main/package.json">package.json</a></li>
<li>Release history: <a class="text-blue-600 hover:text-blue-700" href="https://github.com/PCIRCLE-AI/toonify-mcp/blob/main/CHANGELOG.md">CHANGELOG.md</a></li>
<li>Main docs: <a class="text-blue-600 hover:text-blue-700" href="index.html">landing page</a></li>
</ul>
</section>
</div>
</body>
</html>