Honest critiques pre-empted · LIRIL-surfaced · Direct responses
Limitations & Honest Critiques
A citizen-built 19-axis investigation deserves skeptical reading. These are the three critiques LIRIL surfaced in R10 as the most likely honest challenges a Canadian mainstream journalist would raise — and our direct response to each.
Lack of Expertise
Accepted as valid. Mitigated as follows:
- Every substantive claim cites a primary source — Commissioner of Lobbying Registry, Ethics Commissioner reports, Auditor General reports, Canada Gazette, Federal Court records, Parliamentary committee testimony transcripts, House of Commons Journals. No secondary reporting is cited as authority.
- The investigation makes no claims about individual guilt or intent. The cross-axis tenure-overlap scores are structural indicators, not judgments. The structural finding is explicitly: no oversight body has jurisdiction over cross-axis patterns — a claim about institutional architecture, not about any specific person.
- Rejected AI outputs are documented. See the LIRIL roadmap's 4 red REJECTED rows, including R6's triple-rejection for long-form hallucinations. The review gate catches errors; review failures are logged.
- The scope is framing + evidence aggregation, not original reporting. What this site does is connect already-published primary sources across axes that Canadian media covers individually. That connection is what a structural investigation produces.
Bias Susceptibility
Accepted as valid. Addressed structurally as follows:
- The tenure-overlap marks are computed, not chosen. The marked-state criteria per axis are published in the axis dossier JSON files (tenure overlap ≥ 4.0 threshold with canonical-event list). Anyone can re-run the computation and get the same marks — deterministic, from the published criteria.
- Investigations span multiple parties and multiple eras. Marked actors include Liberal cabinet members (Trudeau, LeBlanc, Lametti, Sajjan, Freeland, etc.), Conservative-era actors (Harper, Poloz), and unelected bodies (PHAC, OSFI, Bank of Canada governance). The axes themselves (arms, Phoenix, MAID, judicial, Indigenous, CSIS oversight) touch multiple governments.
- Rejection of AI suggestions is red-flagged on the roadmap. R5-Q3 (LIRIL advised VPN/anonymous-email for campaigns — rejected for contextual wrongness) and R6 triple-rejection (tracking pixels, AI chatbot, long-form hallucination) show the review gate catching the AI's own biases. The rejections are the transparency, not a failure.
- Every marked actor's page links to contrary evidence when available. Wilson-Raybould's dual-axis page explicitly states the finding "does not allege misconduct" — it identifies the structural oversight gap.
Data Integrity
The most important critique. Addressed as follows:
- Every analytical artifact is SHA-256 with published file hashes. 15+ SHA-256 file hashes published. Any claim's data file hash can be recomputed and compared to the published receipt chain. Tampering breaks the chain visibly.
- The underlying dossiers are committed JSON. Every accountability axis has a committed decision-maker JSON file in the public site repo. You can fork the repo, audit every number, and re-run the computation yourself.
- LIRIL-authored content is attributed and verifiable.
Where LIRIL drafted a letter body (R3, R4, R5 campaigns — climate ECCC, CSC
PBO, procurement PSPC, central banking OSFI), the consultation record with
the exact prompt and response is committed at
data/liril_consultation_r{N}.json— self-sha256 anchored. - Hallucination testing is documented. 9/9 fact-retrieval probes verified correct (Bill C-7 year, Phoenix launch year, MCC name, MAID year, Pi to 4 decimals, etc.). R6 triple-rejection documents the known failure mode for long-form generation. See for the current probe score.
How to verify independently
Any claim on this site is reproducible with 4 commands on a laptop:
- Clone
https://github.com/TENET-5/TENET-5.github.io - Pick an axis. Read its committed decision-maker JSON file.
- Compare its SHA-256 against the published file hashes in
data/*_merkle.jsonfiles (the receipt chain). - Spot-check any actor's claim against the cited primary source
(AG report, Canada Gazette, Hansard, etc.). The citations are in
the dossier's
primary_sourcesarray.
The portfolio-level (2nd-order cross-axis) analysis is a single script. Runs in <2 s on any machine.
What this site does NOT do
- Does not allege criminal guilt. The marks are cross-axis tenure-overlap scores, not judgments. Only the Commissioner of Lobbying, Ethics Commissioner, and courts can make such findings.
- Does not claim personal malfeasance without primary-source evidence. Every claim is tied to a specific cited public-record document.
- Does not track user analytics, opens, or clicks. No tracking pixels. No Google Analytics. No cookies. Localhost storage only for walkthrough progress and sent-campaign marks.
- Does not use social-media engagement mechanics. No comments, no reactions, no chat, no gamification. This is investigative documentation, not a social platform.
- Does not send emails from the site itself. Pre-built
.emlfiles open in the user's own mail client for review-and-send from their own account. - Does not have formal peer review. Published file hashes plus public primary sources are the accountability standard. If you are a peer-review-experienced investigator willing to audit the analysis, contact via contact@tenet5.org — the site will cite your review.
data/liril_consultation_r10.json
(R10-Q3 · 3,217 ms · 475 chars). Related:
State of Investigation ·
LIRIL Roadmap ·
Methodology
Primary records on this file.
Limitations & Honest Critiques. A TENET5 public-record file — open the primary sources cited on this page before treating any figure as settled.