Dossier — Muhammad Umer · Mobile engineering & on-device AI evals · 2026
Muhammad Umer — mobile engineer, 5+ years shipping Flutter, React Native, and native apps. In 2026: seven open-source projects⟨E2⟩ forming the testing & safety layer for on-device models. ~500 tests⟨E1⟩, two ecosystems, one capture format⟨E3⟩. Alongside: 23 client apps shipped, two acquired by investors⟨E13⟩ — and every number on this page is a citation.
$ unswayed compare captures/apple-fm-greedy… captures/apple-fm-temp1…unswayed: "unswayed-core" v1 — apple-fm (greedy) → apple-fm (temperature 1.0)28 checks compared · 8 equivalent · 1 regressed · 19 undecided✗ REGRESSED one-word-ready · oneWordpass rate 100% → 40% (Δ 95% CI [-0.88, -0.03])"Ready." → "Here's your reply:\n\nReady."? undecided ×19 — n=5 cannot certify equivalence (Δ CI ±0.43)PARITY: FAILED — the model failed parity with itself.
Section 02 — Findings · 3 confirmed
“The availability API says available — then every generation fails.”⟨E5⟩
caught by: underfoot drift observatory · live site ↗
Section 03 — The ledger · 07 shipped 2026
Golden tests that tell AI agents which widget and line broke.⟨E11⟩
$ flutter test # golden mismatchgolden_lens: parity 96.2% — 1 region changed#1 Card (shadow) — lib/widgets/card.dart:42report: golden_lens/card.report.json ← an AI agent can act on thisthe agent fixed line 42; rerun green.
The VCR that HTTP tools can't be: deterministic record/replay + evals for in-process, on-device LLMs.⟨E8⟩
$ flutter test # ReplayMode.replaycassette: support-bot.cassette.json (sha256 ✓)12 prompts replayed byte-identically — zero network, zero flakesLlmJudge verdicts replayed from cassette (deterministic CI)All tests passed — offline.
On-device PII redaction around every LLM call. 164 tests, zero dependencies.⟨E6⟩
$ redactor.redact("Card 4111 1111 1111 1111, ali.raza@example.com")→ "Card [CARD_1], [EMAIL_1]" # sent to the LLM$ session.restore(llmResponse)→ original values restored locally — PII never left the device
Freeze an eval baseline. Fail CI on silent model-swap regressions. 85 tests.⟨E7⟩
$ flutter test # after swapping the on-device modelvouch: "support-bot" vs baseline fake-slm 1 (q4) — REGRESSED1 regressed · 1 drifted · 1 stable✗ REGRESSED refund-policy — is valid JSON: PASS → FAIL"{"refundDays": 30, …}" → "Sure! Our refund policy lasts 30 days…"release blocked before users saw it.
A public drift observatory: what Apple's and Google's OS updates silently change in on-device models.⟨E5⟩
$ underfoot diff 25F80 → 23D8133macOS 26.5.1 (fm 1.5.2): 140/140 ok · 100% deterministiciOS-sim 26.3.1 (fm 1.1.7): availability = .available→ then ALL 140 generations fail (ModelManagerError 1026)[refusalFlip] summary-council: benign city-council summaryfm 1.5.2 passes 5/5 → fm 1.1.7 refuses: "May contain unsafe content"└─ the guardrail layer drifts independently of the model
Statistical parity gate: Wilson/Newcombe intervals, honest UNDECIDED verdicts, certified regressions only.⟨E4⟩⟨E9⟩
The TypeScript twin: same capture format, second ecosystem — capture in Swift, judge in Node. Reaches React Native on-device models through one Vercel AI SDK adapter.⟨E3⟩
Section 04 — Architecture
The Swift and npm gates read and write the same capture file — record on one platform, verify on the other.⟨E3⟩ The npm package's test suite judges captures recorded by the Swift CLI and locks the identical verdict, down to the interval bounds.
Section 05 — Method · ~500 tests passing
I attack my own code before you have to. Each project went through adversarial audit rounds — independent probes written against the implementation, every confirmed defect fixed and locked as a regression test.⟨E10⟩
| Project | Tests | Audit rounds | Notes |
|---|---|---|---|
| golden_lens | 36 | 1 | z-order attribution engine |
| llm_replay_eval | 70 | 1 | cassette engine + judge |
| redact | 164 | 2 | 19 confirmed defects fixed in round 2 |
| vouch | 85 | 2 | 21 confirmed defects fixed |
| underfoot | 17 | 1 | + 2 committed OS-build captures |
| unswayed (Swift) | 40 | 2 | 7 confirmed defects fixed |
| unswayed (npm) | 28 | ported | cross-ecosystem verdict test |
| aggregate | ~500 | 9 | dozens of confirmed defects fixed |
Section 06 — Prior record · 2020–2026
Aug 2025 — present
End-to-end production apps in Flutter and React Native — Clean Architecture, Bloc/Riverpod, native Kotlin/Java/Swift modules for BLE, NFC and background services; live translation, speech-to-text/TTS, WebSocket streaming; APIs on AWS EC2 with Docker and CI/CD.
May — Oct 2025
Built and scaled two investor-acquired products end to end: an AI learning app (AI courseware, real-time code evaluation — Flask, LangChain, OpenAI, WebRTC) and a maternity-care chatbot with a structured medical knowledge base (Flutter, Node.js, Firebase).
Nov 2020 — Apr 2025
Joined as a junior in first year of university; 4.5 years across AI-driven mobile apps (NLP chat, speech recognition, TTS — TensorFlow, PyTorch, LangChain), mobile-facing APIs in Node.js/FastAPI with Redis, RAG architectures (FAISS, ChromaDB), and AWS/Heroku deployments.
FAST NUCES — BS Computer Science, Major in Generative AI · Dean's List ×3 (top 10%) · TA for 600+ students · FCAP admin head, 100+ members · 1st place, DAIRA Software Sprint 2024 · 3rd place, GIKI Cross-Platform Hackathon 2025⟨E12⟩
Section 07 — Shipped apps · 23 delivered · 2 acquired
The client record behind the research: twenty-three production apps across healthcare, fintech, construction, travel, legal, and education — two of them acquired by investors.⟨E13⟩ Tap any row for the full brief.
Standalone Flutter module built for a maternal-health app (MiGynae): photograph or upload health records and extract text with Google ML Kit on-device OCR — fully offline, records stored locally in SQLite.
FlutterML KitSQLite
Smart parking platform: detects open spots from parking-lot images, organizes zones across a campus, and lets drivers reserve ahead — with history, statistics, and an admin console.
FlutterFirebaseProvider
Private transportation subscription app: users subscribe to daily commute plans with assigned drivers, manage schedules, track trips in real time, and pay in-app.
Flutter
Social media application combining a feed with stories, an in-app marketplace, food ordering, and a dedicated panel for restaurant owners.
Flutter
Cross-platform employee communication and collaboration platform for GCC organizations: meetings and scheduling, role-based permissions, and full English/Arabic support with RTL layouts.
FlutterFirebase
Personal finance tracker with automatic expense categorization, budgeting, bill reminders, and visual analytics — secure, cloud-synced, and cross-platform.
FlutterDart
Full-stack web platform that connects learners with real-world tasks posted by companies — practical experience that builds a verifiable portfolio.
JavaScriptWeb
Skill-sharing platform where users exchange skills and services using a time-credit system instead of money, built on Firebase.
FlutterFirebase
Web platform for replaying and discovering New Zealand radio ads, promotions, and deals listeners may have missed on air.
TypeScriptWeb
A life-saving NFC platform storing encrypted health profiles on wristbands. First responders tap devices to access allergies, blood type, and medications — offline, without internet. HIPAA-compliant with QR fallback.
React NativeNext.jsPostgreSQLNFCAWS
AI education platform adapting to each student: real-time code evaluation, live video classrooms, gamification. Acquired after strong beta engagement.
FlutterLangChainOpenAIWebRTC
AI chatbot for pregnant mothers — health advice, symptom tracking, appointments, and community, built for an emerging-market healthcare gap.
FlutterNode.jsFirebase
All-in-one construction app for homeowners and contractors: budgets, milestones, a contractor marketplace, and Stripe payments with role-based dashboards.
FlutterFirebaseStripeMaps
Intelligent travel companion for Saudi Arabia using Gemini 1.5 Flash: personalized itineraries, hotel booking, an AI chatbot, and offline navigation across 5 cities.
FlutterGemini APIGoogle Maps
Cloud hotel management replacing physical keys with NFC/barcode digital keys — automated check-in, reservation management, Docker deployment.
CloudNFCDockerREST APIs
White-label booking SaaS: custom booking pages, automated reminders, payments, and CRM.
TypeScriptNext.jsSaaS
Scan barcodes, compare prices, share lists with family in real time, with AI suggestions from purchase history.
FlutterFirebaseBarcode API
Secure payment app with end-to-end encryption, spending analytics, Stripe integration, budgets, and biometric login.
FlutterFirebaseStripe
Health management combining fitness tracking, medication management, and telemedicine with AI analysis.
FlutterAIFirebase
GPT-powered chatbot with multi-turn conversations; code, writing, and research modes; customizable personality; export.
FlutterOpenAI APINLP
Legal tech connecting citizens and lawyers: find lawyers, book consultations, track cases.
TypeScriptReact Native
School community platform — announcements, events, attendance, grades, and parent-teacher messaging.
FlutterFirebase
World Cup fantasy — build teams, compete on leaderboards, live scores, dynamic scoring, player trading.
FlutterREST APIs
Section 08 — Capabilities
FlutterReact NativeKotlinSwiftJavaDartExpo
React.jsNext.jsTypeScriptJavaScriptTailwind CSSReduxZustandGSAPFramer Motion
Node.jsExpressFastAPIDjangoLaravelGraphQLREST APIsSocket.ioPrisma
LangChainOpenAIGeminiTensorFlowPyTorchRAGFAISSChromaDBNLPHugging Face
PostgreSQLFirebaseMongoDBMySQLRedisSQLiteSupabaseDynamoDB
AWS EC2AWS S3DockerKubernetesCI/CDGitHub ActionsVercelNginxLinux
Section 09 — Contact
I take on mobile app development end to end — Flutter, React Native, and native iOS/Android — plus full-stack web and AI features. Fourteen shipped client apps say I deliver; if your team is building on-device AI or evals infrastructure, that is my specialty on top. Either way, I work the way this page reads: claims first, evidence attached.
working remotely, worldwide · based in Faisalabad, Pakistan
$ open mailto:muhammadumer7574@gmail.com→ replies within 24h
Appendix A — Evidence register · 13 entries
Every claim above is numbered. Every number below is a link.
| № | Claim | Artifact | Link |
|---|---|---|---|
| E1 | ~500 tests passing across the seven projects | CI runs + test suites per repo | github.com/Umer9538 |
| E2 | Seven open-source projects shipped in 2026 | GitHub profile / pub.dev / npm | github.com/Umer9538 |
| E3 | One capture format, two ecosystems — Swift captures judged identically by the npm twin | cross-ecosystem test + committed fixtures | unswayed-js: fixtures + engine.test.ts |
| E4 | Apple's on-device model failed parity with itself: one-word compliance 100% → 40%, Δ 95% CI [-0.88, -0.03] | committed captures (greedy vs temperature 1.0) | unswayed: captures/ |
| E5 | Availability API reports .available, then every generation fails (ModelManagerError 1026); guardrail verdicts differ across framework versions | live observatory findings + committed captures | underfoot observatory |
| E6 | redact: 164 tests, zero runtime dependencies | test suite + pubspec | pub.dev/packages/redact |
| E7 | vouch: 85 tests across package + offline example; CI gate on model swaps | test suites + CI workflow | vouch repo |
| E8 | Deterministic replay of in-process on-device inference (cassettes, sha-256 fingerprints) | package + committed example cassette | pub.dev/packages/llm_replay_eval |
| E9 | Wilson + Newcombe statistics implemented twice (Swift & TypeScript) against shared literature fixtures | Stats.swift / stats.ts + matching test values | unswayed: Sources/ParityCore |
| E10 | Adversarial audit rounds with executable probes; dozens of confirmed defects fixed and locked as regression tests | commit history: audit-fix commits per repo | audit commits |
| E11 | golden_lens attributes a visual diff to the owning widget and source line | attribution engine + report schema | pub.dev/packages/golden_lens |
| E12 | 5+ years shipping production mobile apps (2020–2026: fintech, healthcare/NFC, SaaS) | client work & app record | |
| E13 | 23 client apps shipped 2022–2026; the AI learning platform and maternity-care bot were acquired by investors (built at DriftMeta) | app briefs in Section 07 + work history |