陌讯skills聚合平台

kb-meta-fetch

📁 tiangong-ai/skills 📅 1 day ago

14

总安装量

5

周安装量

#23503

全站排名

安装命令

npx skills add https://github.com/tiangong-ai/skills --skill kb-meta-fetch

Agent 安装分布

openclaw 5

Skill 文档

KB Meta Fetch

Core Goal

Pull journal-article records from Crossref after a given --from-date.
Read ISSN seed rows from journals_issn (journal, issn1).
Insert rows into journals with ON CONFLICT (doi) DO NOTHING.
Keep the implementation aligned with 1_crossref_multi_increment.py.

Run Workflow

Set database connection env vars (user-managed keys prefixed with KB_):

KB_DB_HOST
KB_DB_PORT
KB_DB_NAME
KB_DB_USER
KB_DB_PASSWORD

Run incremental fetch with a required date:

python3 scripts/crossref_multi_increment.py --from-date 2024-05-01

Check logs in:

crossref.log

Behavior Contract

Query Crossref endpoint: https://api.crossref.org/journals/{issn}/works.
Filter with type:journal-article,from-pub-date:<from-date>.
Keep only items whose container-title equals target journal title (case-insensitive).
Continue pagination with cursor until no matching items remain.
Store fields in journals: title, doi, journal, authors, date.

Scope Boundary

Implement only Crossref incremental fetch + insert into journals.

Script

scripts/crossref_multi_increment.py

GitHub 仓库 ↗ ← 返回陌讯 Skills 聚合平台