Machine learning engineer at FactSet.

LLM evaluation, retrieval, and agent observability.

I work on how language models are measured. At FactSet I build entity-graph enrichment pipelines over news articles, SEC filings, and broker research.

One question drives most of my work: how do we know when a model has genuinely improved? I research that at the Knowledge & Discovery Lab under Prof. Sourish Dasgupta, in collaboration with Oak Ridge National Laboratory, on DISCERN — a diagnostic framework for epistemic non-triviality in LLM-generated hypotheses.

Before that I was an AI Engineer Intern at Binocs Labs, building production RAG pipelines with HyDE and query decomposition, LLM reranking, and citations, and self-hosting Arize Phoenix for observability across agentic workflows. That work turned into merged contributions in Phoenix and OpenInference.

I taught IE406 Machine Learning as an undergraduate TA under Prof. Pritam Anand, convened the AI Club at DAU, mentored 500+ students through the AI Odyssey course, and co-organized Devolution with GDG On Campus DAIICT.

Jash Shah
Gandhinagar, Gujarat
India
jashshah780 [at] gmail.com

news

Jun 2026Joining FactSet in Hyderabad as a Machine Learning Engineer I, AI Enablement.
Mar 2026DISCERN, our framework for epistemic non-triviality in LLM hypothesis generation, is under review at ACL 2026.
Mar 2026Three PRs merged into Arize Phoenix (9.5k+ stars) and one into OpenInference.
May 2026Graduated from Dhirubhai Ambani University in Information and Communication Technology.

selected publication

Under reviewACL 2026

Evaluating Epistemic Non-Triviality in Scientific Hypothesis Generation

Jash Shah, Knowledge & Discovery Lab, DAIICT & Oak Ridge National Laboratory

A diagnostic framework, DISCERN, that tests whether an LLM can tell an incremental research question from a genuinely new one, given everything published before it.

details

toolkit

Python, C, C++, SQL · PyTorch, TensorFlow · LangChain, LangGraph, LlamaIndex, Google ADK · FastAPI, Django, Flask · AWS, Docker, Kubernetes, n8n · Pinecone, Chroma, FAISS