feat: add ICP validation, company-fit scoring, and rate-limit handling

Merged Phạm Thúc Trường Sơn requested to merge feat/query-filter into main
  • Updated the lite workflow to include an ICP validation step, improving lead filtering before enrichment.
  • Refactored the routing logic to handle backfill scenarios more effectively, ensuring better lead management.
  • Introduced new functions for handling lead removal events and discovery previews, enhancing real-time feedback during the lead processing pipeline.
  • Updated state management to track validated companies and ICP wipeout rounds, allowing for more robust lead discovery and scoring processes.
  • Enhanced enrichment quality checks to consider ICP validation outcomes, ensuring only qualified leads are processed further.

Merge request reports