The latest release of Cognify (v0.1.2) now supports latency as an optimization objective, in addition to quality and cost. Users can also select between different optimization objectives. Our experiments show we can reduce end-to-end request latency by up to 2.7x.
It can be installed by the following command: pip install cognify-ai==0.1.2