M
MISTRAL / mistralai/LIDstral-Arabic

LIDstral Arabic

Language and dialect classifier publicly released by Mistral on Hugging Face on October 9, 2026. It receives Arabic-script text and distinguishes Modern Standard Arabic, dialects and other languages sharing that writing system. It is neither a generative assistant nor a transcription model. It combines fastText one-vs-all, an MLP classifier and per-class isotonic calibration, returning a label and calibrated probabilities over 51 classes.

01 / SUMMARY

The essential

ORIENTATIONLanguage and dialect identification

Primary use stated or inferred cautiously from official documentation.

CONTEXTNonempty text after preprocessing

Maximum input capacity when published by the source.

EXITLabel and probabilities over 51 classes

Documented maximum generation limit.

ACCESSHugging Face · fastText and PyTorch

Verified availability channels.

MODEL TYPEText classification

Primary functional family and verified specialties.

LICENSEApache 2.0

Declared terms for API access, model weights, or self-hosting.

02 / TECHNICAL SHEET

Limits and integration

API IDmistralai/LIDstral-Arabic
Model typeText classification
Access modelOpen weights
LicenseApache 2.0
DeploymentLocal CPU classifier
Release09 OCT 2026
Knowledge cutoffNot published
EntranceText
ExitLabel and probabilities
Context windowNonempty text after preprocessing
maximum outputLabel and probabilities over 51 classes
ReasoningNot applicable
Published tools
Structured OutingsLocal classifier JSON
Batch processingNot published
Prompt cacheNot published
Fine-tuningNot published
Verified platformsHugging Face · fastText · PyTorch
BEST SUITED FOR

Corpus classification, language-based routing, linguistic resource selection and dialect analysis. Including non-Arabic languages reduces confusion between language and script. The official script runs on CPU and offers single inputs, a Python API and JSONL processing. The pipeline requires lid_ova_full.bin, mlp_stacker_ln.pt and isotonic_calibration.pkl to remain together.

WORTH MONITORING

It always selects one of 51 classes: unsupported languages or mixed-language texts may be mislabeled. Preprocessing removes web and ASR artifacts, diacritics, decorative elongation and repeated punctuation while preserving alef variants. Empty inputs or text entirely removed by preprocessing raise an error. Calibrated confidence does not replace domain validation or a policy for uncertain cases.

03 / CAPABILITIES

What it can do

01

Orientation

Corpus classification, language-based routing, linguistic resource selection and dialect analysis. Including non-Arabic languages reduces confusion between language and script. The official script runs on CPU and offers single inputs, a Python API and JSONL processing. The pipeline requires lid_ova_full.bin, mlp_stacker_ln.pt and isotonic_calibration.pkl to remain together.

02

Context

Nonempty text after preprocessing · Label and probabilities over 51 classes

03

Tools and integration

Not published

04

Access

Hugging Face · fastText and PyTorch

Input modalities
Text
04 / PRICES

Documented cost

ConceptWorthUnit/condition
Standard inputNo published official API rateStandard API rate
Cached inputNot publishedReading reused prefixes
Cache write or storageNot publishedThe condition varies by provider
Standard outputSelf-hosted infrastructure costMay include reasoning tokens
Batch inputNot publishedAsynchronous processing
Batch outputNot publishedAsynchronous processing

The model card declares Apache 2.0, and the repository is public and ungated at this review. Its example still mentions a private download; we do not interpret that wording as an available commercial API. No hosted endpoint or per-token price has been verified. Self-hosting entails CPU, memory, storage and operational costs; pin the code revision before loading model files.

i Prices change and may depend on level, region or context length. Check the source before making a decision.

05 / EVALUATIONS

How to read the results

“

Mistral reports evaluation on 84,870 Arabic examples from several datasets. It reports F1 of 88.67% for Moroccan Darija. We retain the dialect and metric: this is not global accuracy and does not extend to every class. Inferama has not reproduced the result. An independent evaluation should inspect the confusion matrix, calibration, mixed texts and out-of-distribution behavior.

BenchmarkResultMetricSource
LIDstral Arabic (Moroccan Darija)88,67 %F1View source ↗

Inferama only highlights a “best result” when the metric, test set, configuration, and date allow for an equivalent comparison. The supplier's figures are presented as claims from its own source.

06 / VERSIONS

Chronology

LIDstral Arabic

Public repository release. The October 8 creation date is not used as the release date.

07 / SOURCES

Traceability