ctxeng v0.1.8 — Production context engineering (RAG, redaction, tracing, CI)

Highlights

This release adds production-grade context management for large codebases:

• Secrets & PII redaction (default on): masks common API keys/tokens, passwords, emails, and private keys before token counting, tracing, and output.
  Disable with: --no-redact

• RAG / chunk-level retrieval: --rag switches from whole-file inclusion to selecting the most relevant chunks for the query.

  • Uses embeddings if sentence-transformers is installed
  • Falls back to lexical retrieval otherwise

• AST skeleton mode (Python): --skeleton outputs a high-level outline (imports, classes, methods, function signatures) instead of full bodies.

• Local observability / tracing: --trace writes JSONL traces under .ctxeng/traces/ and includes trace_id + trace_path in metadata.

• CI support: new ctxeng ci subcommand for pipeline-friendly context generation (always writes to --output).

• Context snapshots: --snapshot saves a versioned bundle under .ctxeng/snapshots/<id>/ (output + manifest).

• Few-shot examples: --fewshot injects examples from .ctxeng/examples/ into the context.

Security & repo hygiene

• Respects .gitignore + .ctxengignore by default.
• Adds --allow / --deny path filters for access-control style scoping.

Output

• Improved structure with metadata + included-file index (XML + Markdown).

VSCode extension

The VSCode extension is disabled in this repo version because it is still under development. Please use the ctxeng CLI / Python package for now.

Upgrade

pip install -U ctxeng