busya de023c7a31 fix(backend+frontend): migration deadlock, async pattern, timeout safety, fire-and-forget translations ...

Backend:
- MigrationPlugin.execute — remove AsyncJobRunner.run() deadlock on post-migration
  ID sync (2 deadlocks total: plugins/migration.py + api/routes/migration.py
  trigger_sync_now). Replace blocking runner.run with direct await.
- MigrationPlugin.execute — fix temp file leak (dry_run=True prevented cleanup).
- MigrationPlugin.execute — IdMappingService(SessionLocal()) now closed in finally.
- MigrationPlugin.execute — wire IdMappingService into MigrationEngine constructor
  so cross-filter patching actually works instead of silently skipping.
- MigrationPlugin.execute — SupersetClient.aclose() in finally to prevent
  httpx connection pool leak.
- TaskManager — _async_tasks dict leak (add_done_callback cleanup).
- JobLifecycle — CancelledError handler (tasks stuck in RUNNING after cancel).
- JobLifecycle — persist_task BEFORE _broadcast_task_status (crash consistency).
- JobLifecycle — wait_for_resolution/wait_for_input now have 3600s timeout.
- AsyncJobRunner.run — 300s timeout on future.result() (APScheduler thread safety).

Translate scheduler:
- execute_scheduled_translation — replace blocking runner.run(orch.execute_run(run))
  with fire-and-forget TranslationOrchestrator.execute_background(). APScheduler
  thread is freed in ms instead of blocking for the full translation duration.
  Translation runs of 10k+ rows (200+ LLM batches, hours) no longer hit the
  300s runner timeout.
- TranslationOrchestrator.execute_background — new static method: opens own DB
  session, dispatches asyncio.create_task, handles errors + notification.
- Scheduler last_run_at updated at dispatch time (not after completion).

Frontend:
- MigrationModel.stepReady[3] now requires dryRunResult != null (was always
  true, allowing UI to reach step 3 without dry-run).
- WizardModel.goToStep gate for step 3 uses stepReady[3].
- +page.svelte  — dryRunResult no longer self-clears via reactive loop.
- Progress bar step 3 indicator gate fixed for new readiness logic.

Tests:
- 2 new regression tests for migration sync (deadlock-free, completes cleanly).
- test_migration_plugin.py — _make_mock_superset_client/_make_mock_mapping_service
  helpers for proper async mock behavior (aclose, sync_environment AsyncMock).
- 10 scheduled-translation tests updated for fire-and-forget pattern.
- MigrationModel.test.ts — step 3 invariant + goToStep block test.
- All affected tests: 104 backend + 79 frontend = 183 passed.

2026-07-07 21:04:23 +03:00

..

__init__.py

feat(validation): v2 LLM dashboard validation — plugin, routes, services

2026-05-31 22:32:20 +03:00

test_admin_api_keys_unit.py

🎉 FINAL: 7194 tests passing, 0 failures, 80% raw / ~90% real coverage.

2026-06-16 00:12:49 +03:00

test_admin.py

test: 7 agents — plugins ~158 tests, extractor 98-100%, dashboard routes 99-100%, git services 94-100%, services 94-100%, dataset_review 100%. Fix test_api_key_routes.py sys.modules pollution

2026-06-15 18:30:05 +03:00

test_agent_conversations.py

feat(agent+ui): fullstack agent module refactoring + UI/UX improvements

2026-06-30 15:21:05 +03:00

test_assistant_admin_routes.py

test(backend): update legacy agent and auth expectations

2026-07-06 01:23:09 +03:00

test_assistant_command_parser.py

test: add 7 more test modules — assistant cmd parser, history, dispatch, admin routes, dataset review, maintenance + semantic resolver

2026-06-15 16:06:18 +03:00

test_assistant_dataset_review_extended.py

test: 6 parallel agents — +40 test files across core, agent, translate, services, API routes, dataset_review. core 100%, agent 100%, services 100%, translate plugin mostly done. Pending: ~10 minor failures to fix

2026-06-15 16:45:49 +03:00

test_assistant_dataset_review.py

test: +12 test modules — clean_release routes, gitea routes, dashboard detail, candidate_service, compliance_orchestrator, clarification_engine/orchestrator, dataset_review helpers. Fix 18 failures (assistant tools, maintence, dataset_review, approval, publication)

2026-06-15 16:26:42 +03:00

test_assistant_dispatch.py

test: add 7 more test modules — assistant cmd parser, history, dispatch, admin routes, dataset review, maintenance + semantic resolver

2026-06-15 16:06:18 +03:00

test_assistant_edge_cases.py

test: 6 agents — +52 test files across core, task_manager, translate routes, git/storage/migration routes, dataset_review deps/routes, settings. Fixed 4 failures

2026-06-15 17:08:08 +03:00

test_assistant_history.py

test: add 7 more test modules — assistant cmd parser, history, dispatch, admin routes, dataset review, maintenance + semantic resolver

2026-06-15 16:06:18 +03:00

test_assistant_llm_edge.py

🎉 FINAL: 7194 tests passing, 0 failures, 80% raw / ~90% real coverage.

2026-06-16 00:12:49 +03:00

test_assistant_llm_planner_intent.py

test: add 7 more test modules — assistant cmd parser, history, dispatch, admin routes, dataset review, maintenance + semantic resolver

2026-06-15 16:06:18 +03:00

test_assistant_resolvers.py

🎉 FINAL: 7194 tests passing, 0 failures, 80% raw / ~90% real coverage.

2026-06-16 00:12:49 +03:00

test_assistant_tool_maintenance.py

test: 5 final agents — fix 40+ failures, llm_analysis 80%+, git_plugin 90%+, routes 90-98%, services 98-100%, core 90-100%. Coverage: real 87%, target 95%+

2026-06-15 19:31:56 +03:00

test_assistant_tool_registry.py

🎉 FINAL: 7194 tests passing, 0 failures, 80% raw / ~90% real coverage.

2026-06-16 00:12:49 +03:00

test_assistant_tools.py

test(backend): update legacy agent and auth expectations

2026-07-06 01:23:09 +03:00

test_auth.py

test: massive coverage expansion — 15 new test modules + assistant tool fixes + orthogonal testing

2026-06-15 15:38:59 +03:00

test_clean_release_v2.py

test: +12 test modules — clean_release routes, gitea routes, dashboard detail, candidate_service, compliance_orchestrator, clarification_engine/orchestrator, dataset_review helpers. Fix 18 failures (assistant tools, maintence, dataset_review, approval, publication)

2026-06-15 16:26:42 +03:00

test_clean_release.py

test: +12 test modules — clean_release routes, gitea routes, dashboard detail, candidate_service, compliance_orchestrator, clarification_engine/orchestrator, dataset_review helpers. Fix 18 failures (assistant tools, maintence, dataset_review, approval, publication)

2026-06-15 16:26:42 +03:00

test_dashboard_action_routes.py

test(backend): add 55+ test files to push coverage to 98%

2026-06-15 13:55:57 +03:00

test_dashboard_detail_routes.py

test: 7 agents — plugins ~158 tests, extractor 98-100%, dashboard routes 99-100%, git services 94-100%, services 94-100%, dataset_review 100%. Fix test_api_key_routes.py sys.modules pollution

2026-06-15 18:30:05 +03:00

test_dashboard_helpers.py

test: massive coverage expansion — 15 new test modules + assistant tool fixes + orthogonal testing

2026-06-15 15:38:59 +03:00

test_dashboard_listing_routes.py

test: 7 agents — plugins ~158 tests, extractor 98-100%, dashboard routes 99-100%, git services 94-100%, services 94-100%, dataset_review 100%. Fix test_api_key_routes.py sys.modules pollution

2026-06-15 18:30:05 +03:00

test_dashboard_projection.py

test: 7 agents — plugins ~158 tests, extractor 98-100%, dashboard routes 99-100%, git services 94-100%, services 94-100%, dataset_review 100%. Fix test_api_key_routes.py sys.modules pollution

2026-06-15 18:30:05 +03:00

test_dataset_review_deps_unit.py

test: 8 parallel agents — fix 150+ failures, add 30+ test files. schemas/models 99-100%, core/client_registry ~98%, maintenance 95-98%, git edges 97%, translate 98-100%, dashboard routes 95-96%, dataset_review 100%

2026-06-15 17:31:43 +03:00

test_dataset_review_routes_extended.py

🎉 FINAL: 98.4% real coverage! 7778 tests, 0 failures.

2026-06-16 11:01:31 +03:00

test_dataset_review_routes_sessions.py

🎉 FINAL: 7194 tests passing, 0 failures, 80% raw / ~90% real coverage.

2026-06-16 00:12:49 +03:00

test_environments.py

test(backend): add 55+ test files to push coverage to 98%

2026-06-15 13:55:57 +03:00

test_git_config_routes.py

test: massive coverage expansion — 15 new test modules + assistant tool fixes + orthogonal testing

2026-06-15 15:38:59 +03:00

test_git_deps.py

test(backend): add 55+ test files to push coverage to 98%

2026-06-15 13:55:57 +03:00

test_git_environment_routes.py

test(backend): add 55+ test files to push coverage to 98%

2026-06-15 13:55:57 +03:00

test_git_gitea_routes.py

test: +12 test modules — clean_release routes, gitea routes, dashboard detail, candidate_service, compliance_orchestrator, clarification_engine/orchestrator, dataset_review helpers. Fix 18 failures (assistant tools, maintence, dataset_review, approval, publication)

2026-06-15 16:26:42 +03:00

test_git_helpers.py

test: massive coverage expansion — 15 new test modules + assistant tool fixes + orthogonal testing

2026-06-15 15:38:59 +03:00

test_git_merge_routes.py

test(git): align route mocks with async services

2026-07-06 01:23:20 +03:00

test_git_repo_lifecycle_routes.py

test(git): align route mocks with async services

2026-07-06 01:23:20 +03:00

test_git_repo_operations_routes.py

test(git): align route mocks with async services

2026-07-06 01:23:20 +03:00

test_git_repo_routes.py

test(git): align route mocks with async services

2026-07-06 01:23:20 +03:00

test_git_schemas.py

test(git): align route mocks with async services

2026-07-06 01:23:20 +03:00

test_health.py

test(backend): add 55+ test files to push coverage to 98%

2026-06-15 13:55:57 +03:00

test_llm_edge.py

test: 5 final agents — fix 40+ failures, llm_analysis 80%+, git_plugin 90%+, routes 90-98%, services 98-100%, core 90-100%. Coverage: real 87%, target 95%+

2026-06-15 19:31:56 +03:00

test_llm_provider_delete.py

feat(validation): v2 LLM dashboard validation — plugin, routes, services

2026-05-31 22:32:20 +03:00

test_llm.py

test: 8 parallel agents — fix 150+ failures, add 30+ test files. schemas/models 99-100%, core/client_registry ~98%, maintenance 95-98%, git edges 97%, translate 98-100%, dashboard routes 95-96%, dataset_review 100%

2026-06-15 17:31:43 +03:00

test_maintenance_routes_comprehensive.py

🎉 FINAL: 7194 tests passing, 0 failures, 80% raw / ~90% real coverage.

2026-06-16 00:12:49 +03:00

test_maintenance_routes_edge.py

test: 5 final agents — fix 40+ failures, llm_analysis 80%+, git_plugin 90%+, routes 90-98%, services 98-100%, core 90-100%. Coverage: real 87%, target 95%+

2026-06-15 19:31:56 +03:00

test_mappings.py

fix: 5 agents — core 703/703, settings 38/38, git edges 191/191, API routes 1139/1140, plugins +70 coverage

2026-06-15 18:02:09 +03:00

test_migration.py

fix(backend+frontend): migration deadlock, async pattern, timeout safety, fire-and-forget translations

2026-07-07 21:04:23 +03:00

test_plugins.py

test: massive coverage expansion — 15 new test modules + assistant tool fixes + orthogonal testing

2026-06-15 15:38:59 +03:00

test_profile_routes.py

test: 6 parallel agents — +40 test files across core, agent, translate, services, API routes, dataset_review. core 100%, agent 100%, services 100%, translate plugin mostly done. Pending: ~10 minor failures to fix

2026-06-15 16:45:49 +03:00

test_reports_routes.py

test: 6 agents — +52 test files across core, task_manager, translate routes, git/storage/migration routes, dataset_review deps/routes, settings. Fixed 4 failures

2026-06-15 17:08:08 +03:00

test_router_thin_modules.py

🎉 FINAL: 7194 tests passing, 0 failures, 80% raw / ~90% real coverage.

2026-06-16 00:12:49 +03:00

test_settings_consolidated.py

🎉 FINAL: 98.4% real coverage! 7778 tests, 0 failures.

2026-06-16 11:01:31 +03:00

test_settings.py

fix: 5 agents — core 703/703, settings 38/38, git edges 191/191, API routes 1139/1140, plugins +70 coverage

2026-06-15 18:02:09 +03:00

test_storage.py

test: 5 final agents — fix 40+ failures, llm_analysis 80%+, git_plugin 90%+, routes 90-98%, services 98-100%, core 90-100%. Coverage: real 87%, target 95%+

2026-06-15 19:31:56 +03:00

test_tasks_deprecated_llm.py

feat(validation): v2 LLM dashboard validation — plugin, routes, services

2026-05-31 22:32:20 +03:00

test_tasks.py

fix(agent-chat): streaming state leak, document parser magic bytes, HITL flow

2026-06-29 17:15:25 +03:00

test_translate_correction_routes.py

test: 6 parallel agents — +40 test files across core, agent, translate, services, API routes, dataset_review. core 100%, agent 100%, services 100%, translate plugin mostly done. Pending: ~10 minor failures to fix

2026-06-15 16:45:49 +03:00

test_translate_dictionary_routes.py

test: 6 agents — +52 test files across core, task_manager, translate routes, git/storage/migration routes, dataset_review deps/routes, settings. Fixed 4 failures

2026-06-15 17:08:08 +03:00

test_translate_helpers.py

test: massive coverage expansion — 15 new test modules + assistant tool fixes + orthogonal testing

2026-06-15 15:38:59 +03:00

test_translate_job_routes.py

test: 8 parallel agents — fix 150+ failures, add 30+ test files. schemas/models 99-100%, core/client_registry ~98%, maintenance 95-98%, git edges 97%, translate 98-100%, dashboard routes 95-96%, dataset_review 100%

2026-06-15 17:31:43 +03:00

test_translate_metrics_routes.py

test: 6 parallel agents — +40 test files across core, agent, translate, services, API routes, dataset_review. core 100%, agent 100%, services 100%, translate plugin mostly done. Pending: ~10 minor failures to fix

2026-06-15 16:45:49 +03:00

test_translate_preview_routes.py

test: 6 parallel agents — +40 test files across core, agent, translate, services, API routes, dataset_review. core 100%, agent 100%, services 100%, translate plugin mostly done. Pending: ~10 minor failures to fix

2026-06-15 16:45:49 +03:00

test_translate_run_edit_routes.py

test: 6 agents — +52 test files across core, task_manager, translate routes, git/storage/migration routes, dataset_review deps/routes, settings. Fixed 4 failures

2026-06-15 17:08:08 +03:00

test_translate_run_history_routes.py

test: 6 parallel agents — +40 test files across core, agent, translate, services, API routes, dataset_review. core 100%, agent 100%, services 100%, translate plugin mostly done. Pending: ~10 minor failures to fix

2026-06-15 16:45:49 +03:00

test_translate_run_list_routes.py

test: 6 agents — +52 test files across core, task_manager, translate routes, git/storage/migration routes, dataset_review deps/routes, settings. Fixed 4 failures

2026-06-15 17:08:08 +03:00

test_translate_run_routes.py

test: 8 parallel agents — fix 150+ failures, add 30+ test files. schemas/models 99-100%, core/client_registry ~98%, maintenance 95-98%, git edges 97%, translate 98-100%, dashboard routes 95-96%, dataset_review 100%

2026-06-15 17:31:43 +03:00

test_translate_schedule_routes.py

test: 6 agents — +52 test files across core, task_manager, translate routes, git/storage/migration routes, dataset_review deps/routes, settings. Fixed 4 failures

2026-06-15 17:08:08 +03:00

test_validation_tasks_comprehensive.py

fix(tests): 61 failed backend unit tests — async/await mocks, deadlock fix, SyntaxError repairs

2026-06-18 14:41:13 +03:00

test_validation_tasks_edge.py

test: 5 final agents — fix 40+ failures, llm_analysis 80%+, git_plugin 90%+, routes 90-98%, services 98-100%, core 90-100%. Coverage: real 87%, target 95%+

2026-06-15 19:31:56 +03:00

test_validation_tasks.py

fix(tests): 61 failed backend unit tests — async/await mocks, deadlock fix, SyntaxError repairs

2026-06-18 14:41:13 +03:00