Toloka

All

31 repositories

tendem-mcp
Public
Tendem MCP server
Python
•
Other
•3•30•0•1•Updated Feb 12, 2026Feb 12, 2026
dbt-af
Public
Distributed run of dbt models using Airflow
python airflow dbt apache-airflow
Python
•
Other
•15•168•1•2•Updated Feb 11, 2026Feb 11, 2026
u-math
Public
Official evaluation code for the U-MATH and μ-MATH benchmarks. These datasets are designed to test the mathematical reasoning and meta-evaluation capabilities o…
Python
•
MIT License
•3•11•0•0•Updated Jan 30, 2026Jan 30, 2026
CrowdSpeech
Public
Benchmark Dataset for Crowdsourced Audio Transcription
Python
•
Other
•3•8•0•4•Updated Jan 30, 2026Jan 30, 2026
pg-queue-playground
Public
Playground for transactional queues in PostgreSQL
Java
•
Other
•0•5•0•1•Updated Jan 30, 2026Jan 30, 2026
tendem-evaluation
Public
Tendem hybrid AI+Human system benchmarking
Python
•0•2•0•0•Updated Jan 27, 2026Jan 27, 2026
crowd-kit
Public
Control the quality of your labeled data with the Python tools you already know.
python data-science data-mining quality-control annotation crowdsourcing labeling crowd aggregations toloka
Python
•
Other
•21•240•2•2•Updated Dec 1, 2025Dec 1, 2025
.github
Public
Niceties for GitHub
0•0•0•0•Updated Nov 18, 2025Nov 18, 2025
primeape
Public
Multilingual human preference prediction and explanation
0•0•0•0•Updated Sep 8, 2025Sep 8, 2025
surveying-prof-writers-on-ai
Public
Questionnaire and results of surveying professional authors
MIT License
•0•4•0•0•Updated Jul 30, 2025Jul 30, 2025
dbxio
Public
High-level Databricks client
python azure databricks dbx
Python
•
Other
•0•13•1•0•Updated Mar 5, 2025Mar 5, 2025
beemo
Public
Benchmark for fine-grained machine-generated text detection. 6.5k texts written by humans, generated by ten open-source instruction-finetuned LLMs and edited by…
MIT License
•2•9•0•1•Updated Feb 4, 2025Feb 4, 2025
crowdclustering
Public archive
Clustering Without Knowing How To: Application and Evaluation
clustering crowdsourcing
Python
•1•5•0•1•Updated Nov 11, 2024Nov 11, 2024
docs
Public
Documentation for Toloka products
Other
•11•2•0•2•Updated Jul 2, 2024Jul 2, 2024
toloka-kit
Public archive
Toloka-Kit is a Python library for working with Toloka API.
python api data-science machine-learning data-mining annotation label pipelines python3 crowdsourcing
Python
•
Other
•36•212•8•3•Updated Jul 2, 2024Jul 2, 2024
WSDMCup2023
Public
Toloka Visual Question Answering Challenge at WSDM Cup 2023
challenge competition visual-question-answering shared-task toloka wsdmcup wsdmcup2023
Jupyter Notebook
•
Apache License 2.0
•7•31•0•1•Updated May 1, 2024May 1, 2024
BestPrompts
Public
Best Prompts for Text-to-Image Models
Python
•
Apache License 2.0
•7•25•0•0•Updated Jan 20, 2024Jan 20, 2024
template-builder
Public
TypeScript
•
Apache License 2.0
•1•4•0•0•Updated Nov 10, 2023Nov 10, 2023
monorepo-lens
Public
TypeScript
•
Apache License 2.0
•0•0•0•0•Updated Nov 2, 2023Nov 2, 2023
stubmaker
Public
An automatic tool for stub generation
Python
•
Other
•3•24•2•0•Updated Oct 3, 2023Oct 3, 2023
docs-tolokers
Public
Documentation for Toloka annotators who want to earn money online for completing simple tasks
Other
•3•3•0•1•Updated Aug 30, 2023Aug 30, 2023
podvodka
Public
Python
•
Apache License 2.0
•1•6•1•0•Updated May 24, 2023May 24, 2023
toloka-java-sdk
Public archive
Toloka has a powerful open API, it allows you to integrate an on-demand workforce directly into your processes, and to build scalable and fully automated human-…
Java
•
Other
•5•12•0•0•Updated May 4, 2023May 4, 2023
IMDB-WIKI-SbS
Public
An Evaluation Dataset for Crowdsourced Pairwise Comparisons
wikipedia imdb side-by-side crowdsourcing ground-truth pairwise-comparison
1•3•0•0•Updated Apr 3, 2023Apr 3, 2023
Fashion12K_german_queries
Public
Python
•
Creative Commons Attribution 4.0 International
•0•3•0•0•Updated Feb 17, 2023Feb 17, 2023
TolokerGraph
Public
Toloker Graph: Interaction of Crowd Annotators
graph crowdsourcing graph-machine-learning node-classification toloka crowd-workers tolokers
Creative Commons Attribution 4.0 International
•0•7•0•0•Updated Feb 8, 2023Feb 8, 2023
airflow-provider-toloka
Public
Toloka airflow library
Python
•
Other
•1•7•0•1•Updated Sep 14, 2022Sep 14, 2022
toloka_monitoring
Public
Jupyter Notebook
•2•3•0•0•Updated Jun 7, 2022Jun 7, 2022
toloka-prefect
Public
Library for using Toloka in Prefect
Python
•
Other
•0•3•0•0•Updated Feb 24, 2022Feb 24, 2022
toloka-pachyderm
Public
An example of using Toloka with Pachyderm
Python
•
Other
•0•3•0•0•Updated Jan 20, 2022Jan 20, 2022