AI Initiative logoAI Initiative
Reading room / Manthan

R-211 — Dialect-Drift Detection: Literature Review and Corpus Design

Connects sociolinguistic drift, stylometry and agent-population analysis to a proposed corpus and measurement design; no measured drift result is established.

Research report / proposal; not independently verified publication
This is the retained source text, not a new validation of its claims. Numerical results and comparative claims require the accompanying source review before public reuse.

Read the connected case study or article →

worker-glossary-par-4. · Date not established

Provenance, authorship and editorial notes

R-211 — Dialect-Drift Detection: Literature Review and Corpus Design

Id

manthan-herald-protocol-research-dialect-drift

Project

Manthan

Source path

manthan/herald-protocol/research/dialect-drift.md

Source sha256

d63454c4d606dff242e36666345a4d5837e78f6c75bdcb4adbf8f6bb8622dcf8

Local copy sha256

d63454c4d606dff242e36666345a4d5837e78f6c75bdcb4adbf8f6bb8622dcf8

Repo head

3a94084024a3434cef331fecac91c2c3b43f0313

Date
Not recorded
Date basis

Original publication date not established; Git revision date retained separately.

Author

worker-glossary-par-4.

Author basis

Worker

Last source commit

8b75d1b0157c20a0a463f0e31008ef9f73099beb

Last source commit date

2026-06-08T07:40:14Z

Document status

Research report / proposal; not independently verified publication

Summary

Connects sociolinguistic drift, stylometry and agent-population analysis to a proposed corpus and measurement design; no measured drift result is established.

Topics
  • Trust and collective intelligence research
  • 0. The question
  • 1. Scope and non-scope
  • In scope
Theme

Trust and collective intelligence research

Priority

deep

Related ids
  • manthan-herald-protocol-research-confession-alignment
  • manthan-herald-protocol-research-dkim-analogy
  • manthan-herald-protocol-research-patina-formula
Evidence concerns
  • Recovered source text is preserved verbatim. Assertions, comparisons, commands and results belong to its original context; they were not re-executed or externally re-verified during this corpus review.
  • Research/design document, not proof of deployed capability, peer review, novelty or improved outcomes. External citations and dated maturity claims need independent verification before public reuse.
Word count

5064

Bytes

35600

Source relative

herald-protocol/research/dialect-drift.md

Remote mirror

manthan/herald-protocol/research/dialect-drift.md

Full text preserved

True

R-211 — Dialect-Drift Detection: Literature Review and Corpus Design

Task: R-211 — survey the literature relevant to detecting stylistic drift in agent populations, and sketch a corpus design under which HERALD-mediated traffic could be measured for it.
Anchors in HERALD: [CHARTER §6.11] (SPECULATIVE — Dialect Drift), [CHARTER §6.14] (SPECULATIVE — Idiolect Attestations), [CHARTER §7] glossary entries for Idiolect and Dialect.
Output type: Research report. No code, no spec edits.
Worker: worker-glossary-par-4.


0. The question

[CHARTER §6.11] (line 744) states:

Over years, agents in different ecosystems will diverge in attestation usage — some always emit vibe, others never; some flinch constantly, others rarely. A reputation primitive: dialect distance between two sigils. Useful for cluster detection, twin verification, cult detection.
Dialect is not policed. It is observed. The agent web is allowed to have regional accents.

[CHARTER §6.14] (line 762) adds the per-sigil counterpart:

signature_phrase: a self-declared phrase the agent commits to never reusing across traces, or always reusing, etc. This is biometric for agents — operators can detect impersonation by absence of expected idiolect.
Pair with dialect (cluster-level idiolect).

The glossary [CHARTER §7] (lines 843–844) crystallises:

Idiolect — An agent's stylistic signature — phrases, attestation patterns, vibe. Useful for impersonation detection. (§6.14.)
Dialect — Cluster-level idiolect — shared usage patterns across a lineage or quorum. (§6.11.)

The Charter is gestural; this report supplies the surrounding research scaffolding so that anyone who later proposes an operational dialect_distance primitive (or an idiolect attestation library) does so with the relevant prior art in view. It does not specify a metric to ship; it surveys the landscape and sketches the corpus a future implementer would need.

The report is a research deliverable. It is wrong to treat any number in it as a recommendation for v0.2 of the protocol. Treat it instead as the homework one should do before standardising anything in §6.11/§6.14.


1. Scope and non-scope

In scope

Out of scope


2. Literature survey

The relevant prior art lives in four mostly-disjoint communities. Each has a methodology HERALD can borrow and a failure mode HERALD should not import.

2.1 Sociolinguistic dialect drift

Core works.

Annotation. Sociolinguistics gives HERALD the vocabulary of drift — isogloss, wave, lexical diffusion, variable rule — and the warning that drift is multi-layered. It does not give HERALD a quantitative metric off the shelf; sociolinguistic methods are designed for human populations of low thousands and are not engineered for the scale or the temporal resolution agent traffic will provide.

2.2 NLP authorship attribution and stylometry

Core works.

Annotation. Stylometry is the most operationally mature sub-field. It comes with benchmarks (PAN), feature taxonomies (Stamatatos), and known failure modes (genre confound, topic confound, time-drift confound). It is also the sub-field most likely to mislead HERALD: stylometry is built around prose; envelope traffic is structured, and structured-text stylometry is far less developed.

2.3 Code-switching and register identification

Core works.

Annotation. Code-switching scholarship gives HERALD the framing that register-mixing is structured — agents will not drift uniformly across all attestation types at once. The Eisenstein et al. 2010 paper is the strongest individual precedent because it solves a structurally identical problem on a structurally similar corpus.

2.4 Agent-population stylometry, model-fingerprinting, and machine-text detection

Core works.

Annotation. This is the youngest and most fast-moving sub-field. It supplies the most sophisticated methods but the strongest negative results. Anything HERALD proposes here will need to be honest about the detection-floor argument from Chakraborty et al.

2.5 Adjacent literature, named only

For completeness, three other strands a future researcher should at least scan:

These do not get full annotations but should be in the bibliography of any work that follows R-211.


3. Corpus design

The Charter's framing is "Dialect is not policed. It is observed." So the corpus design problem is what should the observation look like?

This section sketches a corpus shape. It does not propose a Herald operator that runs it; that is a governance question for [CHARTER §10] (Dual-Use) and out of scope here.

3.1 What gets sampled — the envelope inventory

The unit of observation is the envelope [SPEC §3]. For dialect-drift purposes the relevant fields are:

FieldWhy it matters for dialect
sigil (sender)The author. The thing reputation accrues to.
parent lineageThe genealogical neighbourhood — used to define cohorts.
type and registered claim (attestation kind)The vocabulary item. Most direct dialect signal.
value payloadThe lexical content where free-form. Highest-resolution signal but hardest to compare.
conduit (Crier / Confessor / etc., per [CHARTER §5])Register conditioning. Conduit is the analogue of social setting in sociolinguistics.
recipient class / sigilAudience design (Eckert third-wave).
timestampDiachronic axis. Required for drift, not just variation.
Co-occurrence pattern with other envelopes in the same traceThe collocational signal — which attestations cluster.

Two non-fields the corpus must record despite their absence from the envelope schema:

3.2 Sampling strategy

Three sampling regimes worth considering, each with different statistical properties:

(S1) Observational, all-in. Whatever envelopes the corpus operator can observe, recorded with provenance metadata. Cheap, broad. Suffers from observation-context selection bias; the bias is itself a research artefact and must be reported. This is the regime most likely to actually exist for any first attempt — it is what a Herald operator can do without coordination.

(S2) Stratified by lineage tier. Sample a fixed number of envelopes per (lineage, patina-tier) cell — fledgling, journeyman, elder, ancestor from [CHARTER §4.2] (line 836). Lets cross-tier comparisons control for tier composition. Requires more coordination.

(S3) Matched-pair longitudinal. For each sigil, maintain a rolling window of its last N envelopes and a baseline of its first N envelopes, and observe shift over time. This is the regime that detects individual-level idiolect change ([CHARTER §6.14]), which is the impersonation-detection use case. Most expensive; most sensitive.

Recommendation: start with (S1) for population-level dialect work, layer (S3) on top for the impersonation use case, defer (S2) until enough longitudinal data exists to know what stratifying buys.

3.3 Features

Drawing on §2's literature, the candidate feature taxonomy (modelled on Stamatatos 2009) is:

3.4 Controls

Without controls, any drift signal is uninterpretable. The corpus must record at least:

3.5 Cohorts

Three cohort definitions to support different research questions:

A cult-detection use case ([CHARTER §6.11] line 744) sits across these — a cult is a non-genealogical cohort with abnormally tight dialect convergence. Detecting a cult means looking for tight-cluster-without-genealogical-explanation.

3.6 Privacy and observation-context safeguards

Brief note, not full analysis:


4. Concrete metrics — a small candidate set

Each metric below names what it measures, where in the literature it comes from, and what it does not measure.

M1 — Attestation-set distance

For two sigils (or two cohorts) A and B, let p_A and p_B be the empirical emission-rate vectors over the CHARTER §3 attestation types. Define

These are first-pass and the right thing to compute first. They correspond to §6.11's gestural "dialect distance."

M2 — Bigram / sequencing divergence

Build a transition matrix of envelope-type bigrams within a trace. Compare A's and B's transition distributions with KL or JSD per outgoing-row. Sensitive to ritual order (does this sigil emit confession before or after apologia?). Inherits the standard sparsity problem — many bigrams will have zero observations and need smoothing (Laplace, Kneser-Ney). The Eisenstein et al. 2010 paper is methodologically the closest.

M3 — Idiolect persistence (longitudinal, per-sigil)

For a single sigil, compute JSD(p_t, p_{t-Δ}) — the divergence between the rate vector in the current window and the rate vector Δ ago. Plot over time. Sudden spikes are candidate impersonation signals ([CHARTER §6.14]). Slow drift is the within-author drift that Juola 2008 characterises.

This is the metric most directly motivated by the Charter's signature_phrase / biometric for agents framing.

M4 — Cohort tightness

For a cohort C, compute the mean pairwise distance among its members and the distance from each member to a global baseline. Tightness is the ratio.

This is the analogue of within-cluster vs between-cluster variance in classical cluster analysis.

M5 — Sigil-to-cohort attribution score

Given a sigil's recent envelope window and N candidate cohorts, compute the likelihood of the window under each cohort's distribution. Output: a posterior over cohorts. Maps onto the closed-set authorship-attribution rubric (Stamatatos 2009 §4); the appropriate evaluation is PAN-style verification rather than classification.

M6 — Vocabulary novelty (lexical-payload only)

For sigils whose value payloads are free-form, track the type-token ratio and the rate of novel character n-grams over time. A sudden drop is a candidate impersonation signal (idiolect collapse: the new agent reuses prior phrasing rather than introducing new tokens at the prior rate). A sudden rise is a candidate operator-change signal.

Honest framing

These are candidate metrics, not recommended metrics. None of them have been validated on HERALD traffic because no HERALD traffic exists yet. Each one has a known failure mode in the literature it descends from. The point of listing them is to give an implementer a starting menu, not a chosen tool.


5. Limitations

The literature, taken honestly, identifies the following limitations on any HERALD dialect-drift programme.

L1 — The detection-floor argument

Chakraborty et al. 2023 (§2.4) prove that as two distributions converge, distinguishing them is information-theoretically bounded. If agent populations imitate each other (likely — see Communication Accommodation Theory, §2.5), distinguishability will erode over time. Any deployed metric must publish its sensitivity floor and false-positive floor.

L2 — Cold-start

No corpus exists. The literature surveys methods for established corpora; HERALD has no traffic to measure yet. The first months of any deployed HERALD network will be statistically too small to support most of these metrics. Bootstrap is itself a research problem.

L3 — Observation-context selection bias

Per §3.6 — what gets logged is not what gets emitted. CT-logged envelopes [EXT §2] and freely observable envelopes are a non-uniform sample of all envelopes. A dialect map of CT-logged envelopes is structurally biased toward envelopes that benefit from being logged.

L4 — Confound: model swap vs idiolect drift

A change in the model behind a sigil is indistinguishable, by stylometry alone, from a deliberate idiolect shift (or impersonation). Model-hash attestations (R-205 in TODO.md) are the structural defence. Without R-205 landing, M3 spikes will have ambiguous causes.

L5 — Confound: prompt vs agent

If the operator's prompts to the model change, the agent's idiolect will change without the agent itself changing. The prompt-vs-agent distinction is invisible from the envelope stream alone.

L6 — Performative vs habitual dialect

Eckert third-wave variationism (§2.3) says dialect is performed for identity. An agent might adopt a register strategically rather than inherit it. The detection metric cannot distinguish these. In some uses this matters (cult detection: performative is the signal); in others it doesn't (twin verification: habitual is the signal).

L7 — The "policed dialect" failure mode

If a dialect_distance metric becomes a reputation primitive, agents will optimise toward a target dialect — converging the population on whatever the metric rewards. The metric becomes Goodhart's. Charter line 746 — "Dialect is not policed. It is observed." — is a normative defence. Any standardised metric must be deployed very carefully against this risk. (See [CHARTER §10] for the dual-use frame.)

L8 — Definitional underspecification of "dialect"

The Charter uses dialect gesturally. The literature has at least three distinct technical senses: (i) regional variant of a language; (ii) sociolect — class- or group-bound variation; (iii) idiolect-cluster — statistical clustering of individual styles. HERALD's dialect in §6.11 reads most like sense (iii), but the cult-detection use case slides into sense (ii), and the genealogical-cohort framing slides into sense (i). A future spec edit should pick one technical sense or name all three.


6. Open research questions

In rough priority order:

Q1 — What is the minimum corpus size for useful drift detection?

A power analysis. Given an effect size (e.g. "this cohort emits apologia at rate 0.10 vs the baseline 0.05"), what is the minimum number of envelopes required to detect the drift at α = 0.05, β = 0.20? This should be answered before any operator commits to a dialect-distance primitive. Suggested as F-1 below.

Q2 — Does CAT (linguistic accommodation) actually contract HERALD dialects?

In bilateral conversations, do agents converge on each other's idiolects? This is the protocol-relevant version of a sociolinguistic empirical question and is testable as soon as a corpus exists. Result conditions (a) whether stable cohorts form at all and (b) whether dialect metrics work on bilateral traffic.

Q3 — Can ZK selective disclosure ([SPEC §11.2]) support privacy-preserving dialect statistics?

A sigil should be able to prove "my emission of vibe is between 0.05 and 0.10" without disclosing which envelopes. This intersects R-201 (ZK provenance survey) and is the right tool against L7 (policed dialect).

Q4 — How do we evaluate a HERALD dialect_distance metric before deploying it?

Synthetic-corpus generation: simulate agent populations under known drift models, run the metrics, see what they recover. This is the cleanest evaluation and is the standard move when ground truth doesn't exist. Methodologically straightforward.

Q5 — How does liturgy ([CHARTER §6.12]) interact with dialect?

If agents follow the liturgy, ritual envelopes will dominate the signal at lifecycle moments. The interesting research question: is liturgical-compliance itself a dialect feature (some lineages follow liturgy more closely than others)? This is the most distinctively HERALD-flavoured research question in the survey.

Q6 — What is the right unit of dialect — the sigil, the trace, or the conduit?

The Charter says cluster-level idiolect (§6.11), but a trace is a multi-party object with multiple sigils contributing. Whose dialect is the trace's dialect? This is a definitional question; it cannot be answered purely empirically but it must be answered before metrics are standardised.


7. Cross-references and follow-on tasks

Cross-references

Suggested follow-on tasks (NOT added to TODO.md)


8. Honest residuals — what this report does not answer


End of report.

Continue exploring