Data Engineer · Applied AI

I build pipelines that move data and agents that act on it.

Three years engineering production data platforms at Deloitte — GCP, BigQuery, Airflow, 1M+ records a day. Now pairing that foundation with RAG, multi-agent systems, and streaming. M.S. Business Analytics, UIC '26, 4.0 GPA.

Chicago, IL · open to relocation Actively interviewing
Ishan Singh
Data & AI Engineer Chicago, IL
01 · Projects

Things I've shipped

End-to-end systems — not notebooks. Each one runs, deploys, and has a dashboard or API on the other end.

Real-Time Streaming

Kafka E-commerce Pipeline

End-to-end real-time order streaming pipeline. A Python producer generates 2 orders/sec via Faker, Apache Kafka brokers the stream with Zookeeper coordination, a consumer inserts to Supabase, and a live Streamlit dashboard refreshes every 3 seconds with revenue, product, and regional metrics.

Apache KafkaDockerSupabaseStreamlitPlotlyPythonZookeeper
RAG · NLP

UIC Graduate Programs RAG Chatbot

Production-style RAG assistant for UIC graduate program FAQs. Scrapy spider crawls program pages, OpenAI embeddings index content in Pinecone, FastAPI serves retrieval-augmented responses, and a Streamlit UI handles real-time Q&A. Reduces search friction for applicants navigating scattered program info.

RAGOpenAI EmbeddingsPineconeFastAPIScrapyStreamlitGCP
Machine Learning · UIC

Loan Default Prediction & Investment Strategy

Predicted loan defaults on a P2P lending platform using Decision Tree, Random Forest, and Gradient Boosting. Addressed class imbalance, evaluated with AUC/ROC and Lift curves, and ran investment simulations comparing model-based returns vs baseline options.

scikit-learnRandom ForestGBMAUC/ROCPython · pandas
Machine Learning · Analytics

Customer Retention Prediction

End-to-end churn prediction pipeline on 206k Instacart customers. Engineered 13 RFM-based behavioral features from 3M+ transactions, trained Logistic Regression and XGBoost classifiers, and flagged 27k high-risk customers across Low/Medium/High risk tiers. SHAP explainability shows which behaviors drive churn.

XGBoostscikit-learnSHAPPandasFeature EngineeringPythonSeaborn
02 · Experience

Where I've worked

Apr 2024 — Aug 2024

Consultant, Data Engineering

Deloitte USI · Hyderabad, India
  • Owned end-to-end data pipeline delivery for enterprise clients — designed scalable ingestion-to-visualization pipelines across Oracle Fusion platforms, improved validation accuracy 30% using Python automation and SQL quality checks, and acted as liaison between technical and non-technical teams to align data solutions with business objectives.
  • Built automation and developer tooling to accelerate pipeline deployments and ensure data reliability — implemented CI/CD with GitHub Actions, and maintained data documentation and definitions so source-of-truth tables stayed high quality for analytics applications.
  • Collaborated with business and operations stakeholders to understand data needs and translate them into efficient, scalable solutions — set standards for data quality and expectations, and delivered Tableau and Oracle BIP dashboards enabling self-serve analytics.
May 2021 — Apr 2024

Analyst, Data Engineering

Deloitte USI · Hyderabad, India
  • Designed and built scalable data models and ETL/ELT pipelines using Python, SQL, Apache Airflow, and PySpark on GCP — integrated data from Oracle Fusion (AP, AR, SCM, Procurement) and external sources, processing 1M+ daily records reliably across 20+ production pipelines.
  • Maintained data documentation, definitions, and lineage tracking so source-of-truth tables stayed high quality for downstream analytics and reporting — applied best practices in data management ensuring reliability and robustness across the full analytics lifecycle.
  • Validated a 5TB Teradata-to-GCP migration using Apache Beam at 99.99% accuracy — built reusable data quality frameworks and set company-wide standards for data structure, quality, and expectations across production systems.
  • Reduced pipeline release cycle time 20% and QA effort 40% via GitHub Actions and Jenkins CI/CD — built dbt models and BigQuery data models enabling predictive analytics, data analysis, and metrics formulation for cross-functional teams.
  • Integrated Oracle BICC extracts into the GCP data warehouse — built Tableau, Power BI, and Oracle BIP dashboards communicating analytical insights to 100+ stakeholders and applying Agile methodologies throughout delivery.
  • Led UAT and production validation for new pipeline releases — coordinated with QA and business users to verify data accuracy against requirements, logged and triaged defects, and signed off on releases to ensure smooth handoffs into production.
03 · Skills

Tools I work with

PythonSQLApache AirflowApache KafkaPySparkApache BeamdbtETL / ELTData ModelingData QualityOracle Fusion (BICC, SCM)
BigQueryCloud ComposerDataflowDataprocPub/SubCloud StorageGCP IAMPartitioning & ClusteringCost Optimization
LangGraphRAG PipelinespgvectorPineconeOpenAI APIClaude Code SDKMCPscikit-learnXGBoostTensorFlowPyTorchStreamlitPower BI
GitHub ActionsJenkinsDockerCI/CDTerraformLinux / UnixBashpytestMonitoring & AlertingGit
OCI
OCI 2025 Certified Generative AI Professional
Oracle · 2025
K
Data Streaming Engineer Foundations
Confluent (Kafka) · 2025
04 · Contact

Let's build something.

I'm looking for Data Engineering and Applied AI roles where pipelines meet production AI. Based in Chicago, open to relocating anywhere in the US.