GeezerVisonThe World Wide Web, restored to 800 pixels of glory. |
| Home|About|Gaming cabinet|Archives|How it works|Starter sites |
GeezerVison is showing manasi-sharma.github.io — Manasi Sharma Manasi SharmaHi there! I'm a Research Engineer at Scale AI, where I work on evaluations, benchmarking, and reinforcement learning / post-training research, to train frontier models with better reasoning capabilities for state-of-the-art agents like browser & computer-use agents. My work has been published at conferences such as ICLR, ICML, NeurIPS, and CoRL. Previously, I was a Research Scientist at MIT Lincoln Laboratory. I earned my MS in Computer Science (AI track) from Stanford and my BA in Computer Science and Physics from Columbia. I'm a generalist passionate about applying AI to diverse real-world challenges, from astronomy to autonomous vehicles to agents. I am fortunate to have worked with many different professors over the course of my academic career. I conducted research in the ILIAD Lab under Prof. Dorsa Sadigh at Stanford on robotic learning using language-conditioned diffusion models, and the Stanford Vision Lab under Prof. Fei-Fei Li and Prof. Jiajun Wu on the BEHAVIOR robotic simulation benchmark. As an undergrad, I worked with Prof. Daniel Hsu and Prof. Zoltan Haiman on interpretable deep learning for astrophysics, and at Caltech with Prof. Mansi Kasliwal on image classification for the Gattini-IR telescope. My research interests include AI evaluation methodologies, agents, reinforcement learning, and AI safety and alignment. Everything else: Outside of work, I love dancing (I was Captain of the Columbia Raas dance team), playing the keyboard and exploring the natural landscapes in the Bay Area! Updates
Education
Stanford University, School of EngineeringMaster's in Computer Science Advisors: Dorsa Sadigh (ILIAD Lab), Fei-Fei Li, Jiajun Wu (Stanford Vision Lab)
Columbia University, Columbia CollegeBA in Computer Science with concentration in Physics Advisors: Daniel Hsu, Zoltan Haiman Work Experience
Scale AIMar 2025 — PresentML Research Engineer, Reasoning & Agents Research Team, Scale Labs — San Francisco, CA
MIT Lincoln LaboratoryAug 2023 — Mar 2025Research Scientist, Artificial Intelligence Technology Group — San Francisco, CA (Remote)
Nissan ResearchJun 2022 — Sep 2022Research Intern, Autonomous Systems, Alliance Innovation Lab — Santa Clara, CA
CS Research Mentorship Program — Mountain View, CA
Publications
2026
ICLR
ICML
RubricRobustness: Evaluating the Sensitivity of Rubrics-Based Benchmarks to Simple Perturbations
Manasi Sharma, Brad Kenstler, Bing Liu
International Conference on Machine Learning (ICML), 2026 (arXiv coming soon)
Preprint
Agentic Rubrics for Test-Time Scaling of Computer-Use Agents
Manasi Sharma, Daniel Zhang, Bing Liu
Preprint, May 2026 (arXiv coming soon)
arXiv
MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Servers
Chaithanya Bandi, Ben Hertzberg, ..., Manasi Sharma, et al.
Preprint, January 2026
2025
arXiv
2024
ICML
Why Would You Suggest That? Human Trust in Language Model Responses
Manasi Sharma, Ho Chit Siu, Rohan Paleja, Jaime D. Peña
ICML, Humans, Algorithmic Decision-Making and Society Workshop, 2024
2023
NeurIPS
Exploring and Improving the Spatial Reasoning Abilities of Large Language Models
Manasi Sharma
NeurIPS Instruction Tuning and Following Workshop, 2023
2022
2020
Phys Rev D
Interpreting deep learning models for weak lensing
Jose Manuel Zorrilla Matilla, Manasi Sharma, Daniel Hsu, Zoltan Haiman
Physical Review D, 102(12), American Physical Society, 2020
PASP
Palomar Gattini-IR: Survey Overview, Data Processing System, on-Sky Performance and First Results
Kishalay De, Matthew J. Hankins, ..., Manasi Sharma, ...
Publications of the Astronomical Society of the Pacific, vol. 132, 2020
Teaching Experience
Stanford School of EngineeringMar 2022 — Jun 2023
Graduate Teaching Assistant
Columbia University, Department of MathematicsSep 2019 — Jun 2021
Undergraduate Teaching Assistant for Calculus III (across 4 semesters)
Community Engagement
Graduate Community Chair, Stanford Women in Computer ScienceJun 2022 — Jun 2023
Honors
Areas of ExperienceDeep Learning, Natural Language Processing, Generative AI, Agents, Reinforcement Learning & Decision Making, Computer Vision, Diffusion Models, Explainability, Robotics, & Graph Neural Networks. |
| You are visitor 01402503 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required. |