Limitations
What the Workbench does not do.
Being specific about the gaps is part of the product. If a capability is not listed as available, assume it does not exist yet rather than that it is merely undocumented.
Alpha software: draft output only
Assessments and reports are drafts for discussion, not verified operational findings. Do not use output from the Workbench as the sole basis for decisions affecting animal welfare, staffing, safety, funding, or anyone's personal circumstances.
Alpha and product surface
- Output is draft material for discussion, not a verified operational finding.
- Document Q&A across your uploaded documents is not available. Uploaded documents feed Organization AI Opportunity Discovery through retrieval; there is no general ask-documents product yet.
- Multi-organization switching and team administration remain limited. Data is organization-scoped in the database, but there is not a polished org or team management UI.
Document handling
- Only .txt, .md, and .pdf are accepted, up to 4 MB per file.
- There is no OCR. PDF extraction reads a machine-readable text layer only. A scanned PDF will extract little or nothing.
- Images, charts, and diagrams are not interpreted.
- Table structure is not preserved. A table becomes a run of text.
- Text extraction runs during the upload request; a long or interrupted request can leave a document showing as still processing.
Shelter AI Assessment
- Shelter does not use document retrieval. The draft is generated only from the twelve form answers you submit.
- Output quality is bounded by the detail you provide. Vague input produces generic recommendations.
- Do-not-automate entries and guardrails are required parts of the structured draft. They reduce certain failure modes; they do not guarantee correctness.
Organization AI Opportunity Discovery
- Retrieval can miss relevant evidence. Semantic similarity is not proof of relevance.
- Citations show which retrieved excerpts were used to support a claim. They are not proof that a source is true, complete, or current.
- Section titles on citations are often absent, especially for PDF prose that does not match heading patterns. Citations still carry filename, page number when available, and the excerpt text.
- A report may classify opportunities as AI, deterministic automation, or process improvement, and may mark evidence as documented, inferred, or insufficient. Not every report will contain every category.
- Numeric and human-oversight advisory checks are controls on the generated report. They are not a guarantee that the advice is safe or correct.
Models, schemas, and evaluation
- A model can produce confident, plausible, and wrong statements. Treat each opportunity as a hypothesis to test.
- Schemas, citation validation, grounding checks, and guardrails reduce failure modes. They do not make the output correct.
- Nothing is benchmarked against real-world outcomes. There is no evidence yet that following a recommendation improves anything.
- Evaluation covers repeatable cases for retrieval and generation. That is a regression and comparison baseline, not statistical proof of production quality.
- Monetary cost, ROI, and payback estimates are not produced without supporting evidence. Effort ratings and roadmap timing are planning guidance, not validated implementation estimates.
Operational maturity
- The Workbench is in alpha and is being actively changed.
- There is no uptime commitment, no support commitment, and no data retention or export guarantee.
- There is no in-product deletion or export flow for assessments, documents, reports, or accounts yet.
Where AI is the wrong tool
This is not a limitation of the Workbench so much as a position it takes. Where a rule can be written down, it should be written down. Deterministic logic is predictable, testable, and cheap. Shelter assessments are asked to name work that should stay with people or ordinary software. Organization Discovery can classify opportunities as deterministic automation or process improvement when that is the better answer.
Still useful to you?
Access is invite-only. Review how it works and privacy before requesting access.