spacy-fa-pipeline/scripts
Mohamad Fazeli 9e8ed06361
Complete lg tier: fa_dep_news_lg / fa_core_news_lg
Same 200k-row floret table as fa_ent_news_lg, now with dep/core too.

- configs/fa_dep_news_lg.cfg (fa_dep_news_md.cfg unchanged except vectors)
- project.yml: lg workflow expanded to train-dep-lg, finalize-dep-lg,
  assemble-core-lg, evaluate-lg, finalize-meta-lg, package-lg,
  smoke-lg (mirrors the md tier's dep/core commands)
- scripts/compare_tiers.py: dep/core UD test groups now 3-way (sm/md/lg)
- scripts/finalize_pipeline.py: FLORET_LG url points at the published
  vectors, https://huggingface.co/Phazel/fa-floret-wiki-vectors

UD test: DEP_UAS 90.96 (sm 89.69, md 90.52), DEP_LAS 86.60 (sm 85.15,
md 86.34). NER unchanged from the earlier fa_ent_news_lg run, ENTS_F
75.94. docs/MODELS.md §7 rewritten from ent-only to the full tier.
2026-08-12 22:03:50 +03:30
..
check_noun_chunks.py fa_core_news_sm: Persian spaCy pipeline from UD_Persian-PerDT + ParsTwiNER 2026-07-29 20:52:13 +03:30
compare_tiers.py Complete lg tier: fa_dep_news_lg / fa_core_news_lg 2026-08-12 22:03:50 +03:30
finalize_pipeline.py Complete lg tier: fa_dep_news_lg / fa_core_news_lg 2026-08-12 22:03:50 +03:30
inspect_treebanks.py fa_core_news_sm: Persian spaCy pipeline from UD_Persian-PerDT + ParsTwiNER 2026-07-29 20:52:13 +03:30
smoke_test.py Split the pipeline into fa_dep_news_sm + fa_ent_news_sm, drop core 2026-07-31 11:08:49 +03:30
tokenization_report.py fa_core_news_sm: Persian spaCy pipeline from UD_Persian-PerDT + ParsTwiNER 2026-07-29 20:52:13 +03:30
transfer_perdt_ner.py Ship fa_core_news_sm: PerDT carries its own NER layer 2026-08-01 00:59:16 +03:30
unpack_vectors.py Ship the md tier: floret vectors, docs, and HF publish fixes 2026-08-12 13:15:55 +03:30