ss-tools

busya/ss-tools

Fork 0

Commit Graph

Author	SHA1	Message	Date
busya	04a20f7d3c	feat(translate): replace LLM-based language detection with local lingua-detector - Add _lang_detect.py module wrapping lingua-language-detector (pure Python, 0.076ms/call) - Add batch_detect() with detector caching for performance - Pre-filter rows where detected source language matches target (same-language skip) - Remove detected_source_language from LLM prompt templates (token savings) - Use local detection for cached rows (was always 'und') - Preserve backward compat: LLM detected_source_language as fallback when lingua returns 'und' - Add 24 unit tests for detection, edge cases, caching, and mapping	2026-05-20 14:31:37 +03:00
busya	9228d071ef	fix(translate): fix batch sizing — use real available input budget, respect job.batch_size, lazy playwright in docker - _batch_sizer.py: compute per_batch_budget from actual available_input_budget (context_window - max_output_tokens) instead of sum of first N rows - _batch_sizer.py: cap max_rows_hard_cap with job.batch_size (user config) - _token_budget.py: add available_input_budget and max_output_tokens to return - preview.py: validate required config fields before preview - requirements-docker.txt: add playwright pip package (~5 MB) - backend.entrypoint.sh: lazy playwright install chromium on first start - build.sh: switch tar to tar.xz (-T0 -9), 5.5x smaller bundles - README.md: add offline bundle deployment instructions - playwright.config.js: add testMatch for *.e2e.js files - frontend: preview tab config validation, i18n keys, translationRun store	2026-05-17 23:32:00 +03:00
busya	fdc452a945	feat(docker): add all-in-one Dockerfile without Playwright (<200MB target) Multi-stage build: - Stage 1: node:20-alpine builds frontend (discarded) - Stage 2: python:3.11-slim runs backend + serves SPA static files - Playwright removed from deps (saves ~350MB) - Uvicorn serves both API and frontend on :8000 - Healthcheck via curl - Entrypoint with admin bootstrap support Estimated image size: ~190MB (vs ~550MB with playwright)	2026-05-14 21:37:08 +03:00

Author

SHA1

Message

Date

busya

04a20f7d3c

feat(translate): replace LLM-based language detection with local lingua-detector

- Add _lang_detect.py module wrapping lingua-language-detector (pure Python, 0.076ms/call)
- Add batch_detect() with detector caching for performance
- Pre-filter rows where detected source language matches target (same-language skip)
- Remove detected_source_language from LLM prompt templates (token savings)
- Use local detection for cached rows (was always 'und')
- Preserve backward compat: LLM detected_source_language as fallback when lingua returns 'und'
- Add 24 unit tests for detection, edge cases, caching, and mapping

2026-05-20 14:31:37 +03:00

busya

9228d071ef

fix(translate): fix batch sizing — use real available input budget, respect job.batch_size, lazy playwright in docker

- _batch_sizer.py: compute per_batch_budget from actual available_input_budget
  (context_window - max_output_tokens) instead of sum of first N rows
- _batch_sizer.py: cap max_rows_hard_cap with job.batch_size (user config)
- _token_budget.py: add available_input_budget and max_output_tokens to return
- preview.py: validate required config fields before preview
- requirements-docker.txt: add playwright pip package (~5 MB)
- backend.entrypoint.sh: lazy playwright install chromium on first start
- build.sh: switch tar to tar.xz (-T0 -9), 5.5x smaller bundles
- README.md: add offline bundle deployment instructions
- playwright.config.js: add testMatch for *.e2e.js files
- frontend: preview tab config validation, i18n keys, translationRun store

2026-05-17 23:32:00 +03:00

busya

fdc452a945

feat(docker): add all-in-one Dockerfile without Playwright (<200MB target)

Multi-stage build:
- Stage 1: node:20-alpine builds frontend (discarded)
- Stage 2: python:3.11-slim runs backend + serves SPA static files
- Playwright removed from deps (saves ~350MB)
- Uvicorn serves both API and frontend on :8000
- Healthcheck via curl
- Entrypoint with admin bootstrap support

Estimated image size: ~190MB (vs ~550MB with playwright)

2026-05-14 21:37:08 +03:00

3 Commits