Data Discovery feature

The Data Discovery feature includes backend services, UI components like DiscoveryFlow.svelte, and supports the SVGV dataset with 132 files, 473 tables, and 351K rows. It performs semantic matching, search, and consolidation to improve data analysis success rates, validated by extensive E2E tests. It offers /discovery, /tables, and /validate APIs, and is a key part of DataLens, validated by the team and stakeholder Arne Hauge. The Data Discovery feature uses the Discovery service. The Data Discovery system integrates with the PostgreSQL database for storing and retrieving data. The Data Discovery system depends on the RQ Worker to process extraction jobs asynchronously. Arne Hauge is expected to use the Data Discovery system after deployment. The Data Discovery feature was delivered and represented by commit 68764d5.