feat: add Confluence auto-collector as new data source - #106
Open
leecoder wants to merge 1 commit into
Open
Conversation
Add Confluence Cloud and Server/Data Center support for collecting colleague data (pages, comments) via REST API with CQL search. - New tool: tools/confluence_auto_collector.py - Cloud auth (email + API Token) and Server auth (PAT / Basic) - User search via /rest/api/search/user with accountId for CQL - Page collection (creator + contributor) with space filtering - Comment collection with long/short classification - Rate-limit retry, HTML-to-text conversion, unified output format - SKILL.md: add Option B2 (Confluence) in both CN and EN versions - README.md: add Confluence to data source table and project structure - INSTALL.md: add Confluence setup guide and troubleshooting - requirements.txt: note requests is also used by Confluence collector
titanwings
added a commit
that referenced
this pull request
Apr 15, 2026
Set up the community-facing infrastructure a maintained OSS project needs: - GitHub Actions CI: py_compile on tools/, unittest discover (no-op until tests/ exists), and a non-blocking ruff lint job. Runs on push to main and on pull_request, matrix over Python 3.9 and 3.11. - Pull request template with bilingual EN/CN prompts, a testing checklist, and a security reminder about secrets. - Issue templates for bug, feature, and question, plus a config.yml that disables blank issues and links to Discord and the skill gallery. - CONTRIBUTING.md covering branch naming, commit style (Conventional Commits), dev setup, test expectations, security rules (no secrets, 0600 perms on credential files), and docs/i18n expectations. This is prep work so future PRs (e.g. #106 Confluence collector) can be reviewed against a consistent bar.
3 tasks
titanwings
added a commit
that referenced
this pull request
Apr 15, 2026
Set up the community-facing infrastructure a maintained OSS project needs: - GitHub Actions CI: py_compile on tools/, unittest discover (no-op until tests/ exists), and a non-blocking ruff lint job. Runs on push to main and on pull_request, matrix over Python 3.9 and 3.11. - Pull request template with bilingual EN/CN prompts, a testing checklist, and a security reminder about secrets. - Issue templates for bug, feature, and question, plus a config.yml that disables blank issues and links to Discord and the skill gallery. - CONTRIBUTING.md covering branch naming, commit style (Conventional Commits), dev setup, test expectations, security rules (no secrets, 0600 perms on credential files), and docs/i18n expectations. This is prep work so future PRs (e.g. #106 Confluence collector) can be reviewed against a consistent bar.
Owner
|
Thanks for the contribution @leecoder — code is well-structured, retry/pagination is solid, and all 3 auth modes look correct. Two things before merge: 1. Add the test files. The PR description mentions unit tests but they're not in the diff. Please commit them under
See CONTRIBUTING.md. CI now runs tests automatically on push. 2. Bug at u = data2["results"][0].get("u", {}) # typo — should be "user"Compare line 313. This breaks the Cloud email-fallback path in Once those are in, happy to merge. Thanks! |
titanwings
added
needs-tests
This was referenced Apr 15, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add Confluence Cloud and Server/Data Center support as a new data source for collecting colleague knowledge (pages, comments).
Changes
New file
tools/confluence_auto_collector.py— Confluence auto-collector/rest/api/search/userwith accountId for CQL (Cloud)--setup,--name,--output-dir,--doc-limit,--comment-limit,--space-keyModified files
SKILL.md— Add Option B2 (Confluence) in both CN and EN versions, tool table, detailed usageREADME.md— Add Confluence to data source table, project structure, dependency noteINSTALL.md— Add Confluence Cloud/Server setup guide, usage examples, troubleshootingrequirements.txt— Noterequestsis also used by Confluence collectorTesting
Verified against live Confluence Cloud instance (
tmobi.atlassian.net):docs.txt,messages.txt,collection_summary.json