Artur Mukhamadiev 87af585e1b Refactor crawlers configuration and add new sources ...

- Move hard-coded crawlers from main.py to crawlers.yml
- Use CrawlerFactory to load configuration
- Add 9 new sources: C++ Russia, ICRA 2025, Technoprom, INNOPROM, Hannover Messe, RSF, Skolkovo, Horizon Europe, Addmeto
- Update task list

2026-03-15 00:45:04 +03:00

ai/memory-bank/tasks

Refactor crawlers configuration and add new sources

2026-03-15 00:45:04 +03:00

src

Refactor crawlers configuration and add new sources

2026-03-15 00:45:04 +03:00

tests

Refactor crawlers configuration and add new sources

2026-03-15 00:45:04 +03:00

.gitignore

Refactor crawlers configuration and add new sources

2026-03-15 00:45:04 +03:00

AGENTS.md

[ai] mvp generated by gemini

2026-03-13 11:48:37 +03:00

Description

Yet another web scrapper generated by AI for the needs of R&D Lab

424 KiB

Languages

Python 100%