feat(session): multi-process session-server (N workers + sticky-hash router)#31

Draft

rmfan wants to merge 22 commits into

prodfrom

feat/session-server-multiprocess

Commits on May 29, 2026

fix(http_utils): disable httpx keepalive to spread load across uvicorn workers

rmfan
and
claude
committed

Commits on Jun 4, 2026

feat(session): SessionRegistry uuid pinning for multi-process routing

rmfan
and
claude
committed
feat(session): add ASGI front-end SessionRouter for multi-process layout

rmfan
and
claude
committed
feat(session): --session-server-workers N spawns N processes + router

rmfan
and
claude
committed
test(session): hash agreement + multi-worker startup smoke tests

rmfan
and
claude
committed
feat(session-router): replace hash+rejection with prefix-encoded session_id

rmfan
and
claude
committed
fix(session-router): stream request/response bodies end-to-end (audit B1)

rmfan
and
claude
committed
fix(session-server): register reaper BEFORE first .start() (audit H2)

rmfan
and
claude
committed
fix(session-server): drop SIGTERM handler chain (audit H3)

rmfan
and
claude
committed
fix(session-server): deep-copy per-worker args to avoid shared-ref bugs (audit H4)

rmfan
and
claude
committed
style: black/isort on PR files (pre-commit autofix)
rmfan
committed
fix(session-router): enable HTTP keepalive in router->backend pool
rmfan
committed
fix(session-router): expose session_server_instance_id on /health
rmfan
committed
fix(session-server): prevent port collisions + reap children on SIGTERM
rmfan
committed
fix(session-router): route unknown session_ids via round-robin (was 404)
rmfan
committed
docs: drop references to design docs not in the repo
rmfan
committed
fix(session-server): explicit error when port walk exhausts 65535
rmfan
committed
perf(session): asyncio.to_thread wrap sync tito-tokenizer calls
rmfan
committed
style: pre-commit autofix on prod files
rmfan
committed
fix(session-router): don't leak exception details in 502 response body
rmfan
committed
perf(session-router): K-way SO_REUSEPORT uvicorn workers (opt-in)
rmfan
committed

Commits on Jun 5, 2026

fix(session-router): return 409 on stale-update guard to prevent cursor mismatch

rmfan
and
claude
committed