busya
04a20f7d3c
- Add _lang_detect.py module wrapping lingua-language-detector (pure Python, 0.076ms/call) - Add batch_detect() with detector caching for performance - Pre-filter rows where detected source language matches target (same-language skip) - Remove detected_source_language from LLM prompt templates (token savings) - Use local detection for cached rows (was always 'und') - Preserve backward compat: LLM detected_source_language as fallback when lingua returns 'und' - Add 24 unit tests for detection, edge cases, caching, and mapping
60 lines
1.0 KiB
Plaintext
Executable File
60 lines
1.0 KiB
Plaintext
Executable File
annotated-doc==0.0.4
|
|
annotated-types==0.7.0
|
|
anyio==4.12.0
|
|
APScheduler==3.11.2
|
|
attrs==25.4.0
|
|
Authlib==1.6.6
|
|
certifi==2025.11.12
|
|
cffi==2.0.0
|
|
charset-normalizer==3.4.4
|
|
click==8.3.1
|
|
cryptography==46.0.3
|
|
fastapi==0.126.0
|
|
greenlet==3.3.0
|
|
h11==0.16.0
|
|
httpcore==1.0.9
|
|
httpx==0.28.1
|
|
idna==3.11
|
|
jaraco.classes==3.4.0
|
|
jaraco.context==6.0.1
|
|
jaraco.functools==4.3.0
|
|
jeepney==0.9.0
|
|
jsonschema==4.25.1
|
|
jsonschema-specifications==2025.9.1
|
|
keyring==25.7.0
|
|
more-itertools==10.8.0
|
|
pycparser==2.23
|
|
pydantic==2.12.5
|
|
pydantic-settings
|
|
pydantic_core==2.41.5
|
|
python-multipart==0.0.21
|
|
PyYAML==6.0.3
|
|
passlib[bcrypt]
|
|
python-jose[cryptography]
|
|
PyJWT
|
|
RapidFuzz==3.14.3
|
|
referencing==0.37.0
|
|
requests==2.32.5
|
|
rpds-py==0.30.0
|
|
SecretStorage==3.5.0
|
|
SQLAlchemy==2.0.45
|
|
starlette==0.50.0
|
|
typing-inspection==0.4.2
|
|
typing_extensions==4.15.0
|
|
tzlocal==5.3.1
|
|
urllib3==2.6.2
|
|
uvicorn==0.38.0
|
|
websockets==15.0.1
|
|
pandas
|
|
psycopg2-binary
|
|
openpyxl
|
|
GitPython==3.1.44
|
|
itsdangerous
|
|
email-validator
|
|
openai
|
|
playwright
|
|
tenacity
|
|
Pillow
|
|
ruff>=0.11.0
|
|
lingua-language-detector==2.2.0
|