Testing
29 entities found
/e2e-tests/project-goal.spec.ts
Agent Integration Tests
Agent Integration Tests validate the end-to-end flow of DataLens Agent Mode including session lifecycle and model routing.
Agent session SQLAlchemy error
Fixed by ensuring session instances are converted to scalars before response serialization, resolving 'relation does not exist' errors during agent session startup, enabling reliable agent session creation. The SQLAlchemy detached instance error was fixed by commit 39e9d50.
Backend Tests
Backend tests validate the Discovery feature's API endpoints and server-side logic.
backend/tests/test_agent_gateway.py
Backend test for agent gateway, no additional details provided.
backend/tests/test_agent_orchestration.py
Backend test for agent orchestration, no details provided.
backend/tests/test_agent_skills.py
Backend test for agent skills, no additional details provided.
backend/tests/test_gdpr_detector.py
Backend test for GDPR detector, no details provided.
Commit 52eab9a
Commit 52eab9a requires deployment via Coolify to enable updated debug logging in process_message function.
Commit 557bfb6
Deployed in commit 557bfb6, this introduced comprehensive logging for debugging and detailed diagnostics of the agent's data flow, aiding in troubleshooting issues like async generator failures.
Commit e8f4cd9
The commit e8f4cd9 updated logging within the question router and query execution, enabling better traceability of errors like silent exceptions in async generators, now deployed to improve debugging.
Concurrent Access Test
DISCOVERY_TESTS.md
Documentation of all test cases validating the discovery feature.
E2E test suite
The E2E test suite comprises 15 Playwright tests validating DataLens features on SVGV dataset, covering core functionality, UX, performance, and data validation. It ensures the Data Discovery system's robustness, stability, and correctness, with tests run through the script `tests/test-discovery.sh`. It is part of a comprehensive validation framework now completed and ready for deployment.
file_analyzer.py
DataLens Project uses file_analyzer.py agent for file analysis but has a datetime serialization bug needing fix.
Frontend Tests
Frontend tests test-agent-e2e.spec.ts are included in the Playwright E2E test suite to validate the IronClaw agent feature. Frontend tests validate the Discovery feature's user interface and experience.
frontend/tests/test-results-visualization.spec.ts
Frontend test script validating visualization functionalities.
frontend/tests/test-results-with-wait.spec.ts
Frontend test script for visualization with wait states or delays.
KeyError:0 bug
KeyError:0 bug in API endpoint causes blocking issues for Phase 1 batch processing
Logs
Logs are being used to identify silent failures in the async generator related to query execution, with recent updates adding detailed debug output to trace the exact error points.
OVerlall testing approach
Comprehensive E2E test strategy using Playwright, covering core workflows, UX interactions, performance, and data validation, successfully completed and documented.
Playwright E2E tests
Comprehensive end-to-end testing covering user flows, API, front-end, back-end, and system performance, ensuring high test coverage and quality. The E2E Test Suite includes Playwright tests for the Data Discovery feature. Playwright tests are part of the E2E Test Suite used to validate the Data Discovery Feature. Playwright E2E tests validate the functionality and integration of the Data Discovery system in DataLens. The frontend tests discovery-svgv.spec.ts are part of the Playwright E2E test suite for the Discovery feature. Frontend tests test-agent-e2e.spec.ts are included in the Playwright E2E test suite to validate the IronClaw agent feature. Playwright E2E tests use the test user admin@exerun.com for authentication and functional validation. DataLens Project includes Playwright E2E tests for frontend and user flows to verify platform completeness. The Discovery feature is validated by Playwright E2E tests to ensure functionality.
Regression & Golden Tests
Regression & Golden Tests validate Text-to-SQL correctness and prevent regressions in DataLens Agent Mode.
Skill Unit Tests
Requirements of DataLens Agent Mode are validated by Skill Unit Tests that verify skill correctness on fixture data.
System Orchestration Tests
System Orchestration Tests validate prompt correctness, GDPR guardrails, session lifecycle, and logging in DataLens Agent Mode.
System returning empty responses
The DataLens OpenClaw Integration has been negatively affected by the System returning empty responses condition.
Test infrastructure bugs
Issues with test selectors, URL configurations, and database migrations caused test failures. Corrections in selectors and migration application fixed the problems, enabling successful E2E tests.
Test suite
The GPU-first document extraction implementation is validated by the test suite 'test_docling_extractors.py'. The E2E Test Suite includes Playwright tests for the Data Discovery feature. The E2E Test Suite uses real SVGV budget data for end-to-end validation of the Data Discovery feature.