Project: datalens
81 entity types
Matrix/Intent/BatchProcessor
BusinessProcessIntent

BatchProcessor

BatchProcessor uses FilePrioritizer to prioritize project files in processing pipeline orchestration. BatchProcessor uses ExtractionCoordinator to coordinate data extraction in the pipeline. BatchProcessor uses EmbeddingService to vectorize extracted data in the processing pipeline. DSStarService depends on BatchProcessor to orchestrate DS-STAR Agent API workflows. WorkflowService uses BatchProcessor to orchestrate analysis workflows and data processing pipelines. The File prioritizer is used by the Batch processor orchestrator in the processing pipeline. The Batch processor orchestrator uses the Question router to classify questions and route queries. BatchProcessor orchestrates the full pipeline that involves ExtractionCoordinator for extraction tasks. WorkflowService orchestrates pipelines that may be started and monitored by BatchProcessor. The batch processor orchestrator depends on the catalog worker as the first step in the batch processing pipeline. The batch processor orchestrator uses the prioritize worker to assign processing tiers. The batch processor orchestrator relies on the extract worker to perform data extraction from files. The batch processor orchestrator depends on the vectorize worker to generate embeddings for processed chunks. The batch processing pipeline orchestration is validated by the test_progress_status test case.