Skip to content
AG / The Technical ReviewArticlesAI systems / Engineering / Research

Not what a model outputs - how the system decides, executes, and holds under load.

Ashwin Gupta

Role

Software Engineer 1

Company

SkanAI
15 Jun 2026 – Present

About

Inference is easy. Everything around it isn't.

Honest where it matters. Available when it's hard.

Mechanical engineering by training - which meant learning to ask why a system fails before asking how to build it. AI hit in second year like a realisation, not a subject: software that understood language was a new class of thing, and I knew it would matter before anyone around me thought it would. The IISc ML lead role confirmed the direction - physics-constrained optimisation on eVTOL design under Dr. Harursampath, five projects in eight months, at the edge of what was understood.

Production changed the picture fast. At Gida and then Coforge, the same pattern emerged: the GenAI core - prompts, basic RAG, API calls - is learnable in three months. Everyone builds it. The real gap is what surrounds the model: the routing logic, the concurrency architecture, the observability that tells you what actually broke and when. That's the part nobody wants to own. That's where I went.

At Coforge on the HSBC Conversational Analytics project, I was the youngest on the team and three months in when I became the de facto integration lead - having solved in one week a problem another technology partner hadn't resolved in eight months at the same client. GIL'd threading replaced with CPU-pinned parallel instances, asyncio + uvloop across the full pipeline, cross-stack observability built before the second incident happened. 7× session capacity. $1.3M annualised savings. MTTR from ~1hr to ~10mins.

Inference as a System

Most teams ship inference as a function call. The real questions - p95 latency, 10× load, what happens when a backend goes down - are architecture questions. I answer them before the first model goes live.

Execution Under Constraints

Systems that perform in demos often don't survive production. Real constraints - latency budgets, VRAM ceilings, cost per token - are known at design time, not discovered at launch. I build the constraint model first.

Physics-Informed Scientific ML

Data-driven physics models aren't data problems - they're structure problems. Ignoring governing equations forces the model to rediscover physics from data it may never have enough of. Embedding PDEs into the objective is what makes sparse data sufficient.

What I don't do

- I don't ship AI wrappers dressed as products. Core API calls with a nice UI aren't systems.

- I don't build for its own sake. The system has to earn what it costs to run.

- I don't take off-the-shelf work. If the implementation is a Google search away, I'm not the right person.

• The Gold and the Glory •

Guinness World Record

Jul 2025
Command Centre Ops • Most Participants - Agentic AI Day 2025 Google Cloud | Hack2Skill • July 2025

$1.3M+ Annualised Savings

Jan 2026
HSBC • Coforge

Best Team Award

Nov 2025
HSBC Account • Coforge

Pat on Back - Think Customer Award

Dec 2024
Individual Delivery Excellence • Coforge

Keep It Up Award

Jun 2026
Ownership of Professional Growth & Skill Visibility • Coforge

Java Spring AI Trainer

Dec '25 – May '26
130+ Participants • 81% voted preferred trainer • NPS +50

Best Outgoing Project

Aug 2024
Mechanical Engineering • BMSCE 2023

Augment.AI, Mentor and Founder

Jan 2022
BMSCE's AI Club

42,800 Downloads • 202,000 Views

Present
Human Faces Kaggle Dataset
Experience & Education

The trajectory.

Software Engineer 115 Jun 2026 – Present

SkanAI

  • Software Engineer 1 - applied LLMs & agentic systems
  • Process intelligence platform
  • Built the team's standard Process Dashboard • one-command onboarding • study & artefact kickoff: 3–4 hrs → 10–15 min
Executive Diploma, AI & MLOct 2025 – Mar 2027

IIIT Bangalore

  • Dual specialisation - MLOps, GenAI & Agentic AI
  • Concurrent with Coforge - formalising the theory behind production systems
  • Structural ML • probabilistic reasoning • optimisation • MLOps at scale
AI EngineerJun 2024 – 5 Jun 2026

Coforge

  • Conversational Analytics (HSBC) - SBC→STT→LLM on GCP/RHEL • authored LLD + orchestration architecture
  • GIL fix: CPU-pinned procs + asyncio/uvloop • 20→140–160 sessions/VM • 1,600+ concurrent
  • Packer GCE automation • GCP log correlator: 250K lines <5s • MTTR 1–2hr→~10min
  • Compute: $118K→$8K/month (~$1.3M/yr) • Azure infra intelligence • Amex GBT RAG
Data ScientistJan 2023 – May 2024

Gida Technologies

  • Here.app (HDFC ERGO) - 163-lang multilingual RAG • 97% factual accuracy
  • Prismforce Skill Graph - +30% relevance • sub-50ms on NVIDIA T4
  • Laminar / Metamorph / Polymorph - AI CMS • no-code chatbots • cURL→20+ lang API
Head of Machine LearningJan 2022 – Sep 2022

IISc - NMCAD Lab

  • eVTOL aerodynamic & structural optimisation under Prof. Harursampath
  • Physics-constrained surrogate ML to reduce FEM simulation cost • 5 projects across fluid, structural & thermal domains
  • Stable convergence with a fraction of the labelled data required by classical simulation
AI Product DeveloperFeb 2021 – Dec 2021

CellStrat

  • Early GPT-era enterprise ML - among first Indian teams shipping
  • NLP pipelines: document classification & processing for enterprise clients
  • Full lifecycle: curation → training → eval → deploy → client handoff
Graphic DesignerJan 2020 – Oct 2022

OutLawed

  • Visual identity, event collateral & social content for a teaching NGO
  • First audience feedback loop - iteration under zero-budget constraints
B.E. Mechanical EngineeringAug 2019 – May 2023

BMS College of Engineering

  • Founder & mentor - Augment.AI, BMSCE's AI club
  • Sponsorship Head, UTSAV '22 - signed MoUs • raised >50% of total budget in 14 days
  • IEEE Joint Secretary • 75+ events • chapter ranked #2 globally • co-founded CS chapter
  • Best Outgoing Project '23 - PINNs across fluid, structural & thermal simulation
  • Published: MCQ generation via graph + LLMs - NCISCT 2022
Impact

Proof, not promises.

Measurable results across performance, efficiency, quality, and beyond.

Scale & Performance

  • 7×per-VM session capacity (20 → 140–160)Conversational Analytics
  • 1,600+concurrent voice sessions at peakConversational Analytics
  • 2,000users validated via SIPp load testConversational Analytics
  • <300msend-to-end latency held at peakConversational Analytics
  • <5%packet loss at 1,600+ sessionsConversational Analytics
  • <50msrecommendation inference (99th pct)Graph-Based Skill Recommendation Engine
  • 1× T4full test load, single GPUGraph-Based Skill Recommendation Engine
  • 18→4mscanvas frame time (18–25 → 4–6ms)ashwingupta.dev - Design Handoff to Production
  • 60 FPSstable under CPU throttleashwingupta.dev - Design Handoff to Production

Cost & Efficiency

  • hrs→minstudy & artefact kickoff: 3–4 hrs → 10–15 minProcess Dashboard
  • 1 commandprocess onboarding replaces a bespoke dashboardProcess Dashboard
  • ~$1.3Mannualized compute savingsConversational Analytics
  • $118K→$8Kmonthly compute costConversational Analytics
  • 80→15production VMs (32 → 8 vCPU)Conversational Analytics
  • days→hrsinfra docs: 2–3 days → 2–3 hoursAzure Infrastructure Documentation Engine
  • 90%image weight cut (2 MB → 211 KB)ashwingupta.dev - Design Handoff to Production
  • 72%JS bundle cutashwingupta.dev - Design Handoff to Production
  • 400→0CSS-animated DOM nodes eliminatedashwingupta.dev - Design Handoff to Production

Systems Breadth

  • 8 phaseslive artefact lifecycle in one process workspaceProcess Dashboard
  • Team-wideadopted as the standard process dashboardProcess Dashboard
  • 19inference backends under one APIcontrola
  • 7modalities, single control planecontrola
  • 6scoring dimensions per routing decisioncontrola
  • 5 · 9capabilities · deterministic servicesScholarOS
  • 5,479chunks processed (Mar 2026 validation)ScholarOS
  • 76contradictions detected in corpusScholarOS

Reliability & Ops

  • 2hr→10mincident MTTRConversational Analytics
  • 15→3mpost-call documentation timeConversational Analytics
  • 250K+log lines correlated in 5–6 minConversational Analytics
  • 0fabricated components (guardrail)Azure Infrastructure Documentation Engine
  • 100%determinism rateScholarOS
  • 0 keysfully offline / air-gappedPageIndexOllama - Local-First Fork of PageIndex

Reach & Languages

  • 163languages, first-class RAG targetsHere.app
  • 163+languages for content generationLaminar (toolchain)
  • 20+languages, cURL→code conversionPolymorph (toolchain)
  • 42,800downloads, Human Faces Kaggle setHuman Faces Kaggle DatasetRecorded
  • 202,000views, Human Faces Kaggle setHuman Faces Kaggle DatasetRecorded
  • NPS +50Java Spring AI trainer, 130+ trainedTraining

Accuracy & Quality

  • ~97%factual accuracy, vehicle spec queriesHere.app
  • ~96%table extraction across carrier PDFsAirline Contract Intelligence
  • 6/6physics benchmarks, stable convergencePINNs
  • +30%recommendation relevanceGraph-Based Skill Recommendation Engine

Research & Publications

  • IJISETpeer-reviewed paper, Vol. 9 (NCISCT 2022)NCISCT 2022
  • CellStratwhite paper published, Dec 2025PINNs
  • 6 / 2enterprise workflows / verticals (white paper)PINNs
  • 5 / 8mophysics-constrained eVTOL projects, IIScResearch arc
Research & Systems

Systems that had to hold.

Published
NCISCT 2022

Automated Assessment Generation - Graphs & Language Models

Published Research • IJISET • Vol. 9 Special Issue

Problem

MCQ distractors must be semantically plausible - factually wrong alone fails to separate understanding from guessing

Method

BERT surfaces salient spans as pivots; proper nouns anchor pivots; WordNet and ConceptNet generate nearby alternatives through sense traversal

System design

WordNet supplies hypernym→hyponym chains with sense disambiguation; ConceptNet adds part-of and related-to structure when coverage thins; fallback ensures distractor coverage

Insight

Semantic distance governs selection - distractors must occupy the same conceptual neighbourhood without matching the tested senses; proximity without identity is the key constraint

Commercial Software • In Development
ScholarOS

Research as Structured Execution - Deterministic Services Over Autonomous Generation

Problem

Research copilots generate fluent text without evidence traceability - grounded synthesis and hallucination look identical; no claim can be audited back.

Method

Five locked MCP services cover literature mapping, contradiction detection, hypothesis critique, evidence extraction, and assembly via schema-defined interfaces.

System design

Only hypothesis critique is agentic - bounded to five iterations; all other stages are deterministic with provenance tracked through typed artifacts.

Insight

Each claim is bound to source evidence; contradiction detection marks where consensus breaks, keeping outputs falsifiable and useful beyond sessions.

Personal
Shipped
ashwingupta.dev - Design Handoff to Production
Spatial UI ArchitectureTypeScript / ReactCanvas 2DAstro • VercelPerformance EngineeringAmbient InterfaceDomain & DNS
Problem

The original portfolio claimed performance engineering while shipping 400 animated DOM nodes and a 2 MB JPEG hero - self-defeating on load.

System

Rebuilt as a three-layer spatial interface - all visual effects collapsed into a single Canvas RAF loop, offscreen pre-rendering, lazy loading, WebP preloads. Structural optimization, not cosmetic.

Design

Extended with an ambient HUD system - geolocation-to-nearest-airport clocks, scroll-depth exploration tracker with color-staged progress arc, normalized mouse XY - all persistent across Astro View Transitions.

Outcome

90% image reduction • 72% JS cut • 400 DOM nodes eliminated • frame time 18–25ms → 4–6ms • 17 pages tracked at scroll-depth resolution.

Open Source
Shipped
PageIndexOllama - Local-First Fork of PageIndex
Provider AbstractionTree-Based RAGOllama / Local LLMsBounded Async ConcurrencyHierarchical FallbackPython / Open Source
Problem

Tree-RAG was hardwired to one provider contract - completion differences silently corrupted recursive traversal; failures surface only at collapse.

System

Added a provider-routing layer with finish-reason normalization, so traversal depends on stable internal contracts, not whichever runtime answered.

Design

Prompt externalization, bounded concurrency, and hierarchical fallback stabilize long-document runs on local models with uneven outputs and limited memory.

Outcome

Fully offline tree-RAG across Ollama, llama.cpp, and vLLM - provider switching is transparent, with no external API keys required.

SkanAI
Team Standard
Process Dashboard - One Workspace for Every Process
Process IntelligenceSingle-Command OnboardingNative Capture DecodingEvidence-Linked Case ReviewMarkdown / Mermaid / Data TablesHTML / JavaScript • Bash / Python
Problem

Every incoming clickstream needed a new dashboard; process artefacts were scattered across local folders, and Markdown reviews required another tool.

System

Built a reusable process workspace that brings clickstreams, case documents, frame metadata, and phase artefacts into one interactive dashboard.

Design

One command onboards a process without copying source data. All eight phases are live, keeping the full artefact lifecycle in the same workspace.

Outcome

Study and artefact kickoff: 3–4 hours → 10–15 minutes. Adopted as the standard dashboard across the team.

Coforge
Client Delivery
Azure Infrastructure Documentation Engine
Azure Resource Graph APILive State ExtractionNetwork & Security Config MappingPlantUML Diagram GenerationFew-Shot LLM PromptingFabrication Guardrails
Problem

Azure docs relied on manual exports and hand-drawn diagrams - every project took 2–3 days and drifted from live state.

System

Built a live-state extraction pipeline - subscription scan, topology mapping, and security config analysis auto-generate SDDs and PlantUML from live resource evidence.

Design

Few-shot prompting grounds generation in extracted inventory; guardrails reject any component without a matching live resource - fabrication blocked from governance docs.

Outcome

2–3 days → ~2–3 hours • 104 resource groups per engagement • zero fabricated components • manual PlantUML authoring removed.

Prismforce
Client Delivery
Graph-Based Skill Recommendation Engine
Weighted Directed GraphMulti-Level Skill HierarchyDynamic Node UpdatesMathematical Scoring HeuristicsReal-Time InferenceNVIDIA T4
Problem

Skill recommendations ignored hierarchical relationships, taxonomy changes forced full batch retraining, and live inference missed the sub-50ms SLA.

System

Built a weighted directed graph over multilevel skill hierarchies with typed edges, lightweight scoring - structure, not retraining, drives relevance.

Design

Dynamic node insertion and deterministic traversal keep the graph current; latency was profiled at the 99th percentile under production load.

Outcome

+30% relevance • sub-50ms inference on one NVIDIA T4 • taxonomy expansion no longer required batch retraining • live updates stayed current.

Recommendations

In their words.

"Ashwin showed a great flexibility and stretched to complete a challenging task which resulted in client's delight. He was able to code a logic which client's other partner could not do it. Well done Ashwin."

Arun Kumar Vastrakar

Senior Delivery Director • Coforge

Delivery Head • HSBC AI • Pat on Back award • Nov 2024

"Ashwin's work on the telephony ingestion layer - PJSIP-based, highly stable, low-latency SIP call-handling at scale - was technically precise. Technically strong, dependable, and proactive. He consistently delivered production-ready code with strong technical ownership, and enhanced the development workflow through automation. Highly recommended for roles in VoIP engineering, real-time media systems, or conversational-AI infrastructure."

Raja Sekhar Amirapu

Senior Technical Architect • Coforge

Direct colleague • HSBC project • Nov 2025

"I had the pleasure of working with Ashwin on a highly complex GCP infrastructure setup, where his expertise in scalability, testing, and debugging proved invaluable. He played a crucial role in designing and implementing the scalability logic, ensuring our infrastructure could handle increasing workloads efficiently. His structured approach to testing helped identify potential bottlenecks early, saving us from critical failures down the line."

Snehasish Chakraborty

GCP Infrastructure Engineer • HSBC (client)

Client • HSBC • Feb 2025

"He would keep an open mind, welcome challenges, and think to deliver an end-to-end solution. I rate Ashwin highly - not just for his knowledge and skills, but his attitude to continue trying under pressure and deliver. I'm sure he will be adding great value wherever he works."

Kartik Mehta

Fraud VS Technology Lead • HSBC (client)

Client • HSBC • Feb 2025

"Ashwin is a risk-taker, never shying away from trying innovative approaches - and what sets him apart is his ability to convert those risks into successful implementations. His commitment to meeting deadlines while upholding the quality of work is a testament to his professionalism. Fearlessness in taking on challenges inspires the entire team to push boundaries and strive for excellence."

Tulsi Patro

AI Engineer • Gida Technologies

Direct colleague • Nov 2023

Stack

What I run in production.

Profiled under load. Not just imported.

Languages

Pythonasync · concurrency
TypeScript
C / C++C, C++
SQLPostgreSQL, MySQL
Bash
LinuxRHEL, Arch, Ubuntu

Backend & Systems

Distributed systems
Microservices
REST / OpenAPI
Async / event-drivenKafka, Pub/Sub
Concurrency & perf
CachingRedis
ObservabilityGrafana, Prometheus
Fault tolerance
Browser automationSelenium
Load testingLocust

Profiling & Perf

Scalene
line_profiler
Memray

Real-Time & Voice

PJSIP / PJSUA2
Kamailio
Real-time systems
SIPpSIP load testing
Transport securityTLS · DTLS/SRTP · SDES

Data & Infra

DB designSQL / NoSQL
ETL / streamingKafka, Spark
FastAPI
NetworkXgraph analysis
FAISS / ANN
Vector searchChroma, HNSW
Doc extractionCamelot, Ghostscript, OpenDataLoader

AI / ML Systems

LLM deployment
On-prem AI
RAG
AgenticLangChain, LangGraph
Fine-tuningLoRA/QLoRA, Unsloth
Eval & monitoringW&B
Ollama
Hugging Face

Cloud & DevOps

GCPGCE, GKE, networking
AzureResource Graph
AWSworking
Docker
Kubernetes
Autoscaling
Packer
Terraform
CI/CD
Contact

Hard problems welcome.

Heads-down building right now - not looking for roles. But if you've got a hard problem, a wild idea, or just want to talk shop about LLMs, distributed systems, scientific ML, or why this site is unreasonably over-engineered for a portfolio, I'm always up for that.

BLR--:--:--
···--:--:--