Artur Mukhamadiev a304ae9cd2 feat(crawler): add academic and research sources ...

- Implement crawlers for Microsoft Research, SciRate, and Google Scholar
- Use Playwright with stealth for Google Scholar anti-bot mitigation
- Update CrawlerFactory to support new research crawler types
- Add unit and integration tests for all academic sources with high coverage

2026-03-16 00:11:15 +03:00

ai/memory-bank/tasks

feat(storage): implement hybrid search and fix async chroma i/o

2026-03-16 00:11:07 +03:00

docs

feat(storage): implement hybrid search and fix async chroma i/o

2026-03-16 00:11:07 +03:00

src

feat(crawler): add academic and research sources

2026-03-16 00:11:15 +03:00

tests

feat(crawler): add academic and research sources

2026-03-16 00:11:15 +03:00

.gitignore

Refactor crawlers configuration and add new sources

2026-03-15 00:45:04 +03:00

AGENTS.md

[ai] mvp generated by gemini

2026-03-13 11:48:37 +03:00

requirements.txt

feat(storage): implement hybrid search and fix async chroma i/o

2026-03-16 00:11:07 +03:00

update_chroma_store.py

feat(storage): implement hybrid search and fix async chroma i/o

2026-03-16 00:11:07 +03:00

Description

Yet another web scrapper generated by AI for the needs of R&D Lab

424 KiB

Languages

Python 100%