Artur Mukhamadiev 217037f72e feat(crawlers): convert multiple sources from Playwright to Static/RSS ...

- Added `StaticCrawler` for generic aiohttp+BS4 parsing.
- Added `SkolkovoCrawler` for specialized Next.js parsing of sk.ru.
- Converted ICRA 2025, RSF, CES 2025, and Telegram Addmeto to `static`.
- Converted Horizon Europe to `rss` using its native feed.
- Updated `CrawlerFactory` to support new crawler types.
- Validated changes with unit tests.

2026-03-15 21:21:14 +03:00

ai/memory-bank/tasks

Refactor crawlers configuration and add new sources

2026-03-15 00:45:04 +03:00

src

feat(crawlers): convert multiple sources from Playwright to Static/RSS

2026-03-15 21:21:14 +03:00

tests

feat(crawlers): convert multiple sources from Playwright to Static/RSS

2026-03-15 21:21:14 +03:00

.gitignore

Refactor crawlers configuration and add new sources

2026-03-15 00:45:04 +03:00

AGENTS.md

[ai] mvp generated by gemini

2026-03-13 11:48:37 +03:00

Description

Yet another web scrapper generated by AI for the needs of R&D Lab

424 KiB

Languages

Python 100%