Skip to content

v1.3.0

Latest
Latest

Choose a tag to compare

View all tags
@nielspeter nielspeter released this 24 Nov 10:33
· 2 commits to main since this release
v1.3.0
3a4ada1
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Added

  • Adaptive Per-Model Capability Detection - Complete refactor replacing hardcoded patterns (#7)
    • Automatically learns which parameters each (provider, model) combination supports
    • Per-model capability caching with CacheKey{BaseURL, Model} structure
    • Thread-safe in-memory cache protected by sync.RWMutex
    • Debug logging for cache hits/misses visible with -d flag
  • Zero-Configuration Provider Compatibility
    • Works with any OpenAI-compatible provider without code changes
    • Automatic retry mechanism with error-based detection
    • Broad keyword matching for parameter error detection
    • No status code restrictions (handles misconfigured providers)
  • OpenWebUI Support - Native support for OpenWebUI/LiteLLM backends
    • Automatically adapts to OpenWebUI's parameter quirks
    • First request detection (~1-2s penalty), instant subsequent requests
    • Tested with GPT-5 and GPT-4.1 models

Changed

  • Removed ~100 lines of hardcoded model patterns
    • Deleted IsReasoningModel() function with gpt-5/o1/o2/o3/o4 patterns
    • Deleted FetchReasoningModels() function and OpenRouter API calls
    • Deleted ReasoningModelCache struct and related code
    • Removed unused imports: encoding/json, net/http from config.go
  • Refactored capability detection system
    • Changed from per-provider to per-model caching
    • Struct-based cache keys (zero collision risk vs string concatenation)
    • GetProviderCapabilities() → GetModelCapabilities()
    • SetProviderCapabilities() → SetModelCapabilities()
    • ShouldUseMaxCompletionTokens() now uses per-model cache
  • Enhanced retry logic in handlers.go
    • isMaxTokensParameterError() uses broad keyword matching
    • retryWithoutMaxCompletionTokens() caches per-model capabilities
    • Applied to both streaming and non-streaming handlers
    • Removed status code restrictions for better provider compatibility

Removed

  • Hardcoded reasoning model patterns (gpt-5*, o1*, o2*, o3*, o4*)
  • OpenRouter reasoning models API integration
  • Provider-specific hardcoding for Unknown provider type
  • Unused configuration imports and dead code

Technical Details

  • Cache Structure: map[CacheKey]*ModelCapabilities where CacheKey{BaseURL, Model}
  • Detection Flow: Try max_completion_tokens → Error → Retry → Cache result
  • Error Detection: Broad keyword matching (parameter + unsupported/invalid) + our param names
  • Cache Scope: In-memory, thread-safe, cleared on restart
  • Benefits: Future-proof, zero user config, ~70 net lines removed

Documentation

  • Added "Adaptive Per-Model Detection" section to README.md with full implementation details
  • Updated CLAUDE.md with comprehensive per-model caching documentation
  • Cleaned up docs/ folder - removed planning artifacts and superseded documentation

Philosophy

This release embodies the project philosophy: "Support all provider quirks automatically - never burden users with configurations they don't understand." The adaptive system eliminates special-casing and works with any current or future OpenAI-compatible provider.

Installation

Download the appropriate binary for your platform:

macOS (Apple Silicon)

wget https://github.com/nielspeter/claude-code-proxy/releases/download/${VERSION}/claude-code-proxy-darwin-arm64
chmod +x claude-code-proxy-darwin-arm64
sudo mv claude-code-proxy-darwin-arm64 /usr/local/bin/claude-code-proxy

macOS (Intel)

wget https://github.com/nielspeter/claude-code-proxy/releases/download/${VERSION}/claude-code-proxy-darwin-amd64
chmod +x claude-code-proxy-darwin-amd64
sudo mv claude-code-proxy-darwin-amd64 /usr/local/bin/claude-code-proxy

Linux (x86_64)

wget https://github.com/nielspeter/claude-code-proxy/releases/download/${VERSION}/claude-code-proxy-linux-amd64
chmod +x claude-code-proxy-linux-amd64
sudo mv claude-code-proxy-linux-amd64 /usr/local/bin/claude-code-proxy

Linux (ARM64)

wget https://github.com/nielspeter/claude-code-proxy/releases/download/${VERSION}/claude-code-proxy-linux-arm64
chmod +x claude-code-proxy-linux-arm64
sudo mv claude-code-proxy-linux-arm64 /usr/local/bin/claude-code-proxy

Windows

Download claude-code-proxy-windows-amd64.exe and add to your PATH.

Verify Installation

claude-code-proxy --help

Quick Start

See README.md for configuration instructions.

Assets 8
Loading