Applied Scientist, Amazon Search.
Ph.D. Candidate, Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor.
E-mail: knouman@umich.edu
My Curriculum Vitae
Google Scholar Page
About Me
I am a full-time Applied Scientist at Amazon and a final year Ph.D. candidate in the Department of Electrical Engineering and Computer Science (EECS) at the University of Michigan (UoM) where I am advised by prof. Vijay Subramanian. I received my B.S. degree in Electrical and Electronic Engineering from the GIK Institute of Engineering Sciences and Technology (GIKI) in 2014, and the M.S. degree in Electrical and Computer Engineering (ECE) from UoM in 2019. In summer 2022, I was an Applied Scientist intern at Amazon, where I worked in the "Search Science and AI" team on multi-objective optimization of business and customer-experience metrics. In summer 2023, I joined back the team and helped productionize deep contextual bandits and counterfactual learning CI/CD pipelines. In September 2024, I defended my Ph.D. dissertation on ‘Sequential Decision Making in Cooperative Multi-Agent Systems with Constraints‘.
In my research, I like to use the synergy of communications, control, and computing to answer fundamental and domain-specific questions related to efficient, scalable, safe, and secure operation of engineering systems and networks. Specifically, I am interested in
Planning and Reinforcement Learning in Multi-Agent Systems.
Inference and Control in Networks and Network Phenomena.
Publications and Working Papers
Nouman Khan, Ujwal Dinesha, Subrahmanyam Arunachalam, Dheeraj Narasimha, Vijay Subramanian, Srinivas G Shakkottai, "A Multi-Agent View of Wireless Video Streaming with Delayed Client-Feedback".
Nouman Khan, Mehrdad Moharrami, Vijay Subramanian, "Rarest-First with Probabilistic-Mode-Suppression".
Published in IEEE Transactions on Information Theory 2024.
Nouman Khan, Vijay Subramanian, "A Strong Duality Result for Cooperative Decentralized Constrained POMDPs".
Published in IEEE Conference on Decision and Control 2023.
Nouman Khan, Mehrdad Moharammi, Vijay Subramanian, "Stable and Efficient Piece-Selection in Multiple Swarm BitTorrent-like Peer-to-Peer Networks".
Nouman Khan, Vijay Subramanian, "Cooperative Multi-Agent Constrained POMDPs: Strong Duality and Primal-Dual Reinforcement Learning with Approximate Information States".
Working Paper; Preprint: arXiv:2307.16536.
Nouman Khan, Kangle Mu, Mehrdad Moharrami, Vijay Subramanian, "Backward and Forward Inference in Interacting Independent-Cascade Processes: A Scalable and Convergent Message-Passing Approach".
Working Paper; Preprint: arxiv:2310.19138
Teaching
Winter 2024:
Guest Lectures in EECS-502 (Stochastic Processes) on Jan 23, Mar 19, and Mar 28.
Fall 2023:Â
Graduate Student Instructor, EECS-301 Probability Methods in Engineering, UoM.
Guest Lectures in EECS-301 and EECS-544 (Analysis of Societal Networks), each on Oct 18.
Fall 2021: Graduate Student Instructor, SIADS-644 Reinforcement Learning Algorithms, UoM.
Winter 2021: Graduate Student Instructor, EECS-562 Nonlinear Systems and Control, UoM.
Fall 2020: Graduate Student Instructor, EECS-301 Probability Methods in Engineering, UoM.
Spring 2019: Graduate Student Instructor, EECS-203 Discrete Mathematics, UoM.
Winter 2019: Graduate Student Instructor, EECS-203 Discrete Mathematics, UoM.
Fall 2018: Graduate Student Instructor, EECS-203 Discrete Mathematics, UoM.
Industry
Applied Scientist II, Amazon Search, 07/2024-Present.
Applied Scientist II Intern, Amazon Search, 05/2023 - 08/2023.
Applied Scientist II Intern, Amazon Search, 05/2022 - 08/2022.
Honors and Awards
Richard F. and Eleanor A. Towner Prize for Distinguished Academic Achievement, UoM, 2024.
Rackham International Student Fellowship, UoM. 2023.
Honorable Mention for ECE Department's Outstanding Graduate Student Instructor, UoM, 2021.
ECE Department Fellowship, UoM, 2019.
President's Medal for highest aggregate standing in the university, GIKI, 2014.
Electronic Engineering Medal for highest aggregate standing in the department, 2014.
Best Senior Year Design Project in Industrial Open House and Careers Fair, GIKI, 2014.
Best Serious Speaker (English) and Winner, Bilingual Declamation Contest, NUST, Pakistan, 2011.
Dean's Honor List, GIKI, 2010-2014.
Invited and Contributed Talks
[Contributed Talk]. A Multi-Agent View of Wireless Video Streaming with Delayed Client-Feedback.
IEEE INFOCOM, Vancouver, Canada, May 2024.
[Invited Talk]. Foundations for Cooperative Multi-Agent Systems and Networks: Decentralized Decision Making.
University of North Texas, Computer Science Department, April 2024.
Queen's University, Mathematics Department, April 2024.
Bilkent University, Industrial Engineering Department, April 2024.
Koc University, Electrical and Electornics Engineering Department, April 2024.
Purdue University Northwest, Computer Science Department, February 2024.
[Contributed Talk]. A Strong Duality Result for Cooperative Decentralized Constrained POMDPs.Â
IEEE CDC, Singapore, Dec 2023.
[Invited Talk]. Reinforcement Learning in Cooperative Multi-Agent Constrained POMDPs.
The 2023 Annual Midwest Optimization Meeting, Department of Mathematics, UoM, Oct 2023.
[Contributed Talk].Â
Stable and Efficient Piece-Selection in Multiple Swarm BitTorrent-like Peer-to-Peer Networks. IEEE INFOCOM, Virtual, 2020.
Service
[Journal and Conference Reviews]
IEEE Internet of Things (2020).
IEEE CDC (2023, 2024).
NeurIPS (2024).
AISTATS (2024).
[Seminars and Workshops]
Discussant, ECE Communications and Signal Processing Seminars, UoM. 2020-2021
Volunteer Organizer: ACM Mobihoc 2019 TPC Workshop and Meeting 2019