bkinnightskytw
/
agent-orchestrator
mirror of https://github.com/ComposioHQ/agent-orchestrator.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
agent-orchestrator/.changeset
History
Ashish Huddar 2306078761
feat: add SQLite-backed activity event logging layer (#1528) 
* feat: add SQLite-backed activity event logging layer

Implements a structured diagnostic event trail for the orchestrator.
When unexpected behavior occurs (stuck sessions, silent CI failures,
missed PR transitions), operators can now reconstruct timelines with
`ao events` rather than guessing from logs.

Key design decisions driven by Codex review:
- FTS5 external-content table uses INSERT/DELETE triggers so search
  actually works without manual rebuild
- ts_epoch (epoch ms) used for all time comparisons to avoid text vs
  SQLite datetime() ambiguity near cutoff
- PRAGMA busy_timeout=3000 handles WAL lock contention across
  CLI/lifecycle/web processes
- user_version schema versioning for future migrations
- EventType renamed to ActivityEventKind to avoid collision with
  existing types.ts export
- Event names match existing vocabulary (ci.failing, review.pending)
- ActivityStateCache (Map) tracks previous activity state so
  lifecycle-manager can emit activity.transition diffs
- session.spawn_failed captures failed spawns via wrapper try/catch
- better-sqlite3 in optionalDependencies: AO keeps working if native
  build fails; getDb() returns null and writes become no-ops

New files:
- packages/core/src/events-db.ts — lazy DB init, WAL, schema+triggers
- packages/core/src/activity-events.ts — write API, sanitizer
- packages/core/src/query-activity-events.ts — query + FTS + stats
- packages/cli/src/commands/events.ts — `ao events list/search/stats`

Wired into:
- lifecycle-manager.ts: lifecycle.transition + activity.transition
- session-manager.ts: session.spawned, session.spawn_failed, session.killed

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(activity-events): address PR review comments

- redactValue: remove value-string regex check that silently erased
  error messages mentioning auth terms (key-based redaction is sufficient)
- sanitizeData: reject payloads >16KB instead of slicing (sliced JSON
  is malformed and corrupts JSON output)
- lifecycle-manager: prune activityStateCache alongside states in the
  per-poll stale-entry cleanup loop (prevents unbounded growth)
- events CLI: warn on unrecognised --since duration format instead of
  silently applying no time filter
- searchActivityEvents: accept optional projectId and push it into SQL
  WHERE clause instead of post-LIMIT in-memory filter

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(activity-events): review pass fixes

- formatRow: pad level string before chalk-wrapping so ANSI codes
  don't corrupt column alignment in ao events output
- events-db: add PRAGMA synchronous=NORMAL (WAL+NORMAL is standard
  recommendation; avoids per-write fsync in the poll hot path)
- events-db: emit console.warn when _dbFailed is set so operators know
  events are being dropped instead of failing silently forever
- activity-events: remove dead redactValue wrapper (was a no-op after
  the previous fix; call site now directly assigns the value)
- activity-events: remove unused session.cleanup from ActivityEventKind
  (no call site emitted it; dead API surface)
- query-activity-events: add optional limit param to searchActivityEvents
  (default 100, max 1000, parameterized); add --limit flag to ao events search

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(activity-events): widen source/kind to allow plugin-defined values

ActivityEventInput.source and .kind accept ActivityEventSource|string
and ActivityEventKind|string respectively, so new event sources (e.g.
scm-github, notifier-slack) don't require editing core types.

The named union members are preserved for IDE autocomplete on known values.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(events): level column alignment, filter kind widening, negative limit guard

- events.ts: padEnd(5) → padEnd(9) so level column aligns with the 9-char LEVEL header
- query-activity-events.ts: ActivityEventFilter.kind widened to ActivityEventKind|string
  for consistency with ActivityEventInput.kind (plugin-defined kinds can now be queried)
- query-activity-events.ts: negative/NaN limit values sanitized with Number.isFinite +
  Math.max(1,...) to prevent SQLite LIMIT -N returning the full table

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(events): FTS alias, credential URL sanitization, periodic retention

- query-activity-events.ts: use full table name in MATCH (activity_events_fts
  MATCH ?) instead of alias to avoid 'no such column: fts' in some FTS5 builds
- activity-events.ts: redact https://token@host URL credentials in string values;
  add hourly retention sweep so long-lived processes don't grow DB indefinitely
- events-fts-integration.test.ts: real SQLite integration test for FTS5 search,
  projectId filter, and epoch-based time filter

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(lint): remove inline import() type annotations in integration test

ESLint @typescript-eslint/consistent-type-imports forbids import() in type
positions — replaced with any to keep the test working without the type imports.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(events): parse data to structured JSON in --json output; add test proving value sanitizer correctness

- ao events list/search --json now parses ActivityEvent.data from JSON
  string back to a structured object, making it jq-friendly without
  requiring double-parsing by callers (P1 finding from PR review)
- Add test "preserves error messages that mention sensitive words in
  values" to refute Greptile's false-positive P1 finding: SENSITIVE_KEY_RE
  only matches key names, not string values; "token expired" and
  "authorization header missing" values are preserved correctly

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(events): BM25 relevance ordering for FTS search; add versioned JSON envelope

Search now orders by FTS5 rank (BM25) instead of ts_epoch, returning most relevant
events first. --json output now wraps events in { version, query, meta, events }
for stable CLI contracts.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(events): quote FTS tokens to prevent false negatives on operator-like terms

Searching for words like "OR", "AND", or "NOT" would produce empty results
because SQLite FTS5 treated them as operators after token joining. Wrapping
each token in double quotes forces literal phrase matching.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(tests): update FTS assertion for quoted tokens; raise timeout on slow audit test

query-activity-events test expected the old unquoted join format; update to
match the quoted form added in the previous commit. The agent-report audit
trail test occasionally exceeds the 5 s default on CI runners; raise to 15 s.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(qa): ISSUE-001 - type events stats entries

* test(events): cover session and lifecycle event call sites

* test(core): wait for lifecycle branch adoption

* chore: add activity events changeset

* fix activity event review feedback

* batch prune old activity events

* record activity event when spawn starts

* Fix activity event FTS rebuild and sanitization guard

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
 		2026-05-01 21:13:20 +05:30
..
README.md feat: publish to npm under @composio scope (#32) 2026-02-15 04:28:57 +05:30
activity-events-log.md feat: add SQLite-backed activity event logging layer (#1528) 2026-05-01 21:13:20 +05:30
agent-plugin-safety-costs.md fix: register codex web activity plugin 2026-04-18 14:15:29 +05:30
auto-cleanup-on-merge.md feat(core): auto-terminate sessions on PR merge (#1309) (#1311) 2026-04-20 12:56:07 +05:30
cli-session-ls-terminated.md feat(cli): hide terminal sessions in `ao session ls` by default (#1319) 2026-04-21 11:35:54 +05:30
collapsible-agent-reports.md feat: make agent reports collapsible (#132) 2026-04-17 21:39:37 +05:30
config.json chore: rename @composio scope to @aoagents across all packages 2026-04-09 15:59:33 +00:00
filter-terminated-sessions-from-ls.md feat(cli): filter terminated sessions from ao session ls / ao status by default (#1340) 2026-04-20 13:05:34 +05:30
fix-activity-unavailable-stuck.md fix: avoid stuck probe failures for unavailable activity (#129) 2026-04-17 21:22:44 +05:30
fix-bugbot-detail-dispatch.md feat(core): enrich events with PR title, description, and URL (#1326) 2026-05-01 15:19:09 +05:30
fix-start-restore-and-codex-resume.md docs: align changeset with codex restore behavior 2026-04-19 19:59:16 +05:30
fix-web-lifecycle-restore-affordances.md fix(web): keep closed-unmerged sessions actionable 2026-04-17 14:42:25 +05:30
fix-web-tmux-resolver-wrapped-storagekey.md fix(web): resolve tmux sessions when storageKey is wrapped ({hash}-{projectName}) (#1488) 2026-04-25 00:53:47 +05:30
fixed-orchestrator-identity.md Fix orchestrator identity to use one canonical session per project (#1487) 2026-04-25 18:57:31 +05:30
harden-worker-branch-refresh.md fix: refresh worker branch metadata after branch changes (#1368) 2026-04-26 22:12:46 +05:30
isolate-lifecycle-terminal-logs.md chore: replace changelog entry with changeset (#121) 2026-04-17 16:36:37 +05:30
late-lions-share.md fix: finish PR #1300 major follow-up fixes 2026-04-18 12:35:15 +05:30
lifecycle-activity-signal-contract.md fix(core): address PR #1300 review feedback 2026-04-18 01:54:38 +05:30
lifecycle-transitions-report-watcher.md fix: address PR review comments for lifecycle transitions 2026-04-18 00:39:35 +05:30
opencode-tmpdir-and-shared-cache.md fix: reduce opencode session list churn (#1478) 2026-04-29 01:24:55 +05:30
optional-repo-field.md fix: address all 9 review comments from @illegalcall 2026-04-15 03:04:12 +05:30
pr1300-review-followups.md fix: close remaining pr1300 follow-ups 2026-04-18 15:18:24 +05:30
refactor-session-detail.md refactor(web): break down SessionDetail.tsx into focused components (#1449) 2026-04-25 22:01:21 +05:30
scm-github-ci-merge-pending-detectpr-cache.md feat(core): opt-in gh CLI tracer + scm/tracker migration (Phase A1a) (#1238) 2026-04-25 18:57:04 +05:30
scm-github-pr-cache.md feat(core): opt-in gh CLI tracer + scm/tracker migration (Phase A1a) (#1238) 2026-04-25 18:57:04 +05:30
session-ui-audit-oscillation.md fix: address PR review feedback for session audit trail 2026-04-17 21:06:08 +05:30
stage2-evidence-recovery.md fix: address stage 2 PR review feedback (#95) 2026-04-16 22:46:12 +05:30
stage4-pr-policy.md fix: decouple PR truth from worker session policy 2026-04-17 10:44:35 +05:30
stage5-ui-api-rollout.md feat: expose split lifecycle truth in dashboard 2026-04-17 13:00:26 +05:30
tracker-github-issue-cache.md feat(core): opt-in gh CLI tracer + scm/tracker migration (Phase A1a) (#1238) 2026-04-25 18:57:04 +05:30
web-copy-debug-bundle.md feat(web): copy observability debug bundle from dashboard (#1320) 2026-04-21 11:35:43 +05:30
web-merge-conflict-actions.md feat(web): merge conflict compare link and copy branch on session PR card (#1318) 2026-04-21 11:35:29 +05:30
worker-system-prompt-split.md feat (core): inject worker prompt as instructions file (#1302) 2026-04-26 15:44:39 +05:30

README.md

Changesets

Hello and welcome! This folder has been automatically generated by @changesets/cli, a build tool that works
with multi-package repos, or single-package repos to help you version and publish your code. You can
find the full documentation for it in our repository

We have a quick list of common questions to get you started engaging with this project in
our documentation