spacy-fa-pipeline/scripts
Mohamad Fazeli 4135142e72
Fill in trf throughput on the 940MX
The 940MX does run trf, at 1,158 words/s with batch 32 inside 2 GB, 6.2x its host
CPU. The earlier claim that current PyTorch wheels cannot target sm_50 was only
half right: Maxwell kernels were dropped from the cu128 and cu129 builds starting
torch 2.8, which is what `pip install torch` now resolves to, but the cu126 build
of 2.7.1 still ships sm_50 and works.

.venv-trf-gpu pins torch==2.7.1+cu126 for this and stays separate from .venv,
whose cupy runs on nvidia-* 12.9 wheels that torch would downgrade to 12.6.

Drop the editorial sentence from the generated model card; the table states it.
2026-08-13 17:11:25 +03:30
..
benchmark_throughput.py Add fa_core_news_trf tier on a shared fine-tuned ParsBERT 2026-08-13 16:34:55 +03:30
check_noun_chunks.py fa_core_news_sm: Persian spaCy pipeline from UD_Persian-PerDT + ParsTwiNER 2026-07-29 20:52:13 +03:30
compare_tiers.py Complete lg tier: fa_dep_news_lg / fa_core_news_lg 2026-08-12 22:03:50 +03:30
finalize_pipeline.py Add fa_core_news_trf tier on a shared fine-tuned ParsBERT 2026-08-13 16:34:55 +03:30
inspect_treebanks.py fa_core_news_sm: Persian spaCy pipeline from UD_Persian-PerDT + ParsTwiNER 2026-07-29 20:52:13 +03:30
make_model_card.py Fill in trf throughput on the 940MX 2026-08-13 17:11:25 +03:30
merge_joint_corpus.py Add fa_core_news_trf tier on a shared fine-tuned ParsBERT 2026-08-13 16:34:55 +03:30
smoke_test.py Split the pipeline into fa_dep_news_sm + fa_ent_news_sm, drop core 2026-07-31 11:08:49 +03:30
tokenization_report.py fa_core_news_sm: Persian spaCy pipeline from UD_Persian-PerDT + ParsTwiNER 2026-07-29 20:52:13 +03:30
transfer_perdt_ner.py Ship fa_core_news_sm: PerDT carries its own NER layer 2026-08-01 00:59:16 +03:30
unpack_vectors.py Ship the md tier: floret vectors, docs, and HF publish fixes 2026-08-12 13:15:55 +03:30