Skip to content

Conversation

@ziadhany
Copy link
Collaborator

@ziadhany ziadhany commented Dec 30, 2025

@ziadhany ziadhany changed the title Add initial migration to Gentoo importer v2 Migrate Gentoo importer to advisory V2 Dec 30, 2025
@ziadhany ziadhany marked this pull request as ready for review January 1, 2026 13:58
@ziadhany
Copy link
Collaborator Author

ziadhany commented Jan 1, 2026

gentoo importer logs:

Importing data using gentoo_importer_v2
INFO 2026-01-13 11:27:36.319779 UTC Pipeline [GentooImporterPipeline] starting
INFO 2026-01-13 11:27:36.319927 UTC Step [clone] starting
INFO 2026-01-13 11:27:36.319984 UTC Cloning `git+https://anongit.gentoo.org/git/data/glsa.git`
INFO 2026-01-13 11:27:46.573434 UTC Step [clone] completed in 10 seconds
INFO 2026-01-13 11:27:46.573552 UTC Step [collect_and_store_advisories] starting
INFO 2026-01-13 11:27:46.601640 UTC Collecting 3,809 advisories
INFO 2026-01-13 11:27:50.572009 UTC Progress: 10% (381/3809) ETA: 36 seconds
INFO 2026-01-13 11:27:54.984944 UTC Progress: 20% (762/3809) ETA: 34 seconds
INFO 2026-01-13 11:27:59.580987 UTC Progress: 30% (1143/3809) ETA: 30 seconds
InvalidVersion constraints version: 3.24.48:3 error:'3.24.48:3' is not a valid <class 'univers.versions.GentooVersion'>
InvalidVersion constraints version: 3.24.48:3 error:'3.24.48:3' is not a valid <class 'univers.versions.GentooVersion'>
INFO 2026-01-13 11:28:03.483176 UTC Progress: 40% (1524/3809) ETA: 25 seconds
INFO 2026-01-13 11:28:07.808373 UTC Progress: 50% (1905/3809) ETA: 21 seconds
INFO 2026-01-13 11:28:12.143645 UTC Progress: 60% (2286/3809) ETA: 17 seconds
InvalidVersion constraints version: 6.9.3:6 error:'6.9.3:6' is not a valid <class 'univers.versions.GentooVersion'>
InvalidVersion constraints version: 6.9.3:6 error:'6.9.3:6' is not a valid <class 'univers.versions.GentooVersion'>
INFO 2026-01-13 11:28:16.432883 UTC Progress: 70% (2667/3809) ETA: 13 seconds
INFO 2026-01-13 11:28:20.883399 UTC Progress: 80% (3048/3809) ETA: 9 seconds
INFO 2026-01-13 11:28:25.291890 UTC Progress: 90% (3429/3809) ETA: 4 seconds
INFO 2026-01-13 11:28:29.297571 UTC Progress: 100% (3809/3809)
INFO 2026-01-13 11:28:29.311853 UTC Successfully collected 3,809 advisories
INFO 2026-01-13 11:28:29.311944 UTC Step [collect_and_store_advisories] completed in 43 seconds
INFO 2026-01-13 11:28:29.311971 UTC Step [clean_downloads] starting
INFO 2026-01-13 11:28:29.311991 UTC Removing cloned repository
INFO 2026-01-13 11:28:29.353128 UTC Step [clean_downloads] completed in 0 seconds
INFO 2026-01-13 11:28:29.353249 UTC Pipeline completed in 53 seconds

Process finished with exit code 0
from vulnerabilities.models import AdvisoryV2
from django.db.models import Count
duplicates = (
    AdvisoryV2.objects
    .values('avid')
    .annotate(count=Count('id'))
    .filter(count__gt=1)
)
len(duplicates)
Out[2]: 0
AdvisoryV2.objects.count()
Out[3]: 3809

@ziadhany
Copy link
Collaborator Author

ziadhany commented Jan 1, 2026

Update the Gentoo get_safe_and_affected_versions function in advisory v2

Signed-off-by: ziad hany <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant