Open to Global Contract & Senior Full-Time Roles

Shivam Gupta

Senior Backend & AI Engineer

Senior backend engineer with 7+ years architecting multi-tenant APIs, distributed data pipelines, and production AI services. Specializes in LLM observability gateways, high-performance data processing (Polars/Trino), and building secure, scalable Python backends that cut operational compute overhead.

Get in Touch View Architecture

GitHub LinkedIn shivam@shivamai.dev

Experience

OneCard

Senior Software Engineer

CurrentFeb 2023 — Present

80%

infra cost cut

6 mo.

zero-incident uptime

3+ TB

daily logs

Migrated core data transformation workflows from AWS Glue to Apache Spark on Kubernetes (EKS), cutting infrastructure costs by 80% while processing 3+ TB of logs daily.
Pushed heavy analytical predicates to Trino and rewrote core Python/Pandas logic into Polars, scaling workloads down from 8xlarge to xlarge AWS instances to reduce compute costs by 40%.
Secured multi-tenant access across automated pipelines by building a Python authentication library integrating OAuth2 with AWS Secrets Manager for unified RBAC.
Enforced organization-wide AI cost controls by configuring a multi-tenant LiteLLM gateway with budget thresholds for all internal GenAI workloads.
Eliminated chronic Airflow crashes by resolving S3 sync race conditions and refactoring DAGs, achieving 6 months of zero-incident uptime.
Accelerated PR feedback cycles by 25% by engineering custom Claude skills (Model Context Protocol) to inject repository-wide context into a CI pipeline AI reviewer.

PythonPySparkKubernetes (EKS)TrinoPolarsAirflowLiteLLMFastAPIClaude MCP

Shiprocket

Software Engineer

Jun 2021 — Feb 2023

95%

manual accounting removed

100%

peak uptime

Architected a rule-based decision engine that fully automated fulfillment billing reconciliation, eliminating 95% of manual accounting intervention.
Utilized latency profiling to patch critical database bottlenecks and optimize slow queries, maintaining 100% platform uptime during high-traffic peak seasons.

PHPLaravelEloquent ORMMySQLRedis

Triyama Software & GAK E Solution

Full Stack & Software Engineer

Jun 2019 — Jun 2021

90%

manual UI work cut

97%

SEO score achieved

Built a dynamic internal web-page builder for client projects and developed automated backend reporting dashboards, cutting manual UI intervention by 90%.
Optimized MySQL schema designs to improve read response times, and integrated third-party REST APIs for secure social logins and payment gateways.

Full Stack DevelopmentREST APIsMySQLWeb DashboardsUI Architecture

Featured Systems & Architecture

System 01

LLM Cost & Latency Observability

Built a FastAPI service with Pydantic-validated endpoints wrapping the Gemini API. Implemented retry logic with exponential backoff and a budget-cap circuit breaker to prevent runaway token costs. Engineered prompt routing between two model tiers based on input complexity.

View Repository

Reliability

Exponential backoff retries around upstream model calls.

Cost Control

Budget-cap circuit breaker halts runaway token spend.

Routing

Complexity-based prompt routing across two model tiers.

PythonFastAPIPydanticGemini APISQLitePrometheusGrafana

Technical Competencies

Backend & APIs

PythonFastAPIRESTful APIsPydanticFlaskSQLAlchemySystem Design

Cloud & Infrastructure

AWS EKSEC2S3IAMSecrets ManagerEventBridgeKubernetesDockerArgoCDCI/CD

Data & Distributed Systems

PostgreSQLApache KafkaApache AirflowTrinoApache SparkPolarsRedis

AI Engineering

LiteLLMClaudeAgentic AI Workflows (RAG, Model Context Protocol)Agentic WorkflowsGoogle ADKClaude CodeAmazon QGemini API