Kf/eschatology processing#88

Draft

KasperFyhn wants to merge 50 commits intomainfrom

kf/eschatology-processing

Commits on Nov 21, 2024

Caching embeddings during clustering + fewer clusters by default
Kasper Fyhn
committed
visualizer: prettier and switching double-click and hold ops
Kasper Fyhn
committed
More caching during clustering
Kasper Fyhn
committed
Removing the long tail of entities upfront and reducing cluster sizes
Kasper Fyhn
committed

Commits on Nov 25, 2024

Without embedding-based clustering, only label overlap
Kasper Fyhn
committed

Commits on Nov 26, 2024

Better frequency slider for nodes and edges on visualizer
Kasper Fyhn
committed
Also filtering edges on dates in visualizer
Kasper Fyhn
committed
Trying multiprocess offloading to GPU
Kasper Fyhn
committed
First steps towards storing binary files of SpaCy docs
Kasper Fyhn
committed
Trying fastcoref's LingMessCoref instead of AllenNLP which is sluggishly slow
Kasper Fyhn
committed
Adding fastcoref to dependencies
Kasper Fyhn
committed
Adding a error recovering wrapper of the fastcoref component
Kasper Fyhn
committed
Configurable DocBin size and specified cuda for fastcoref component
Kasper Fyhn
committed
Fixing stream collected to list from debugging
Kasper Fyhn
committed

Commits on Nov 27, 2024

Output path for pipeline instead of project name
Kasper Fyhn
committed
Resolving text in safe fastcoref component
Kasper Fyhn
committed
More proper continuation of already processed docs
Kasper Fyhn
committed
fixing bug in SafeFastCoref which led to empty texts
Kasper Fyhn
committed
Union notation instead of | for compatibility with Python 3.9
Kasper Fyhn
committed

Commits on Dec 4, 2024

Fixing reading/writing DocBins, fixing safe fastcoref pipe and introducing subclustering
Kasper Fyhn
committed
Deduplicating docs in doc bins
Kasper Fyhn
committed
Big hackathon for the visualizer commenced
Kasper Fyhn
committed

Commits on Dec 5, 2024

Hacking away for visualizer: now showing docs in a very ugly way
Kasper Fyhn
committed

Commits on Dec 6, 2024

Only targeting visualizer files with prettier
Kasper Fyhn
committed
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committed
Showing documents with triplets marked up
Kasper Fyhn
committed

Commits on Dec 9, 2024

Introducing database for entities, relations, triplets and documents
Kasper Fyhn
committed
Fixing failing test after last commit
Kasper Fyhn
committed
Changing DB models slightly and optimizing DB population
Kasper Fyhn
committed

Commits on Dec 11, 2024

Work-in-progress on DB models
Kasper Fyhn
committed

Commits on Dec 18, 2024

Fundamental restructuring of visualizer architecture
Kasper Fyhn
committed

Commits on Dec 19, 2024

Working backend and frontend, but not much functionality yet
Kasper Fyhn
committed
Work-in-progress: continued work on visualizer backed by a database
Kasper Fyhn
committed

Commits on Dec 20, 2024

Close to being on the previous level of functionality, just much better
Kasper Fyhn
committed

Commits on Jan 3, 2025

Refactoring and optimizations of document retrieval by entity or relation
Kasper Fyhn
committed
Adding support for date filtering via DB
Kasper Fyhn
committed
A first implementation of whitelisting/focusing entities in graph fetching
Kasper Fyhn
committed

Commits on Jan 6, 2025

Blacklist functionality and optimization of graph query
Kasper Fyhn
committed
Fixing ORM test and removing a redundant test
Kasper Fyhn
committed

Commits on Jan 8, 2025

Quick fix of Electron packaging; bloated dist to be fixed later
Kasper Fyhn
committed

Commits on Jan 9, 2025

Somewhat functional supernode mechanisms
Kasper Fyhn
committed

Commits on Jan 10, 2025

Better styling of components
Kasper Fyhn
committed

Commits on Jan 13, 2025

Forcing documentation workflow to run on Ubuntu 22.04 after failed runs on GitHub actions
Kasper Fyhn
committed

Commits on Jan 14, 2025

Some clean-up and editing of whitelist and blacklist in visualizer
Kasper Fyhn
committed
Clean-up and minor fixes
Kasper Fyhn
committed

Commits on Jan 15, 2025

Using ncc for packaging backend
Kasper Fyhn
committed

Commits on Jan 20, 2025

Doing a postbuild substitution of sqlite3 binary for visualizer distributable
Kasper Fyhn
committed

Commits on Jan 21, 2025

Grouping entity labels as it produced over-grouping; instead trimmed lemma phrases are used
Kasper Fyhn
committed
Prioritizing edges between focus nodes in visualizer backend
Kasper Fyhn
committed
Fixing failing tests
Kasper Fyhn
committed