Abstract: Many constrained sequential decision-making processes, such as safe AV navigation, wireless network control, caching, cloud computing, etc., can be cast as Constrained Markov Decision Processes (CMDP). Reinforcement Learning (RL) algorithms have been used to learn optimal policies for unknown unconstrained MDP. Extending these RL algorithms to unknown CMDP brings the additional challenge of maximizing the reward and satisfying the constraints. In this talk, I will present algorithms that can learn safe policies effectively. In the second part of the talk, I will demonstrate how the theoretical understanding of the constrained MDP can help us to develop algorithms for practical applications. As an application, I show how to learn to obtain optimal beam directions under time-varying interference-constrained channels for a mobile service robot. Optimal beam selection in mmWave is challenging because of its time-varying nature. We propose a primal-dual Gaussian process bandit with adaptive reinitialization to handle non-stationarity and interference constraints. We demonstrate how our approach learns to adapt effectively to time-varying channel conditions. Co-sponsored by: IEEE North Jersey Section Speaker(s): Dr. Arnob Ghosh, Agenda: Nov 6th, Talk: 7:00 PM - 8:00 PM Discussion Q/A: 8:00 PM - 8:15 PM Room: ECE 202, Bldg: Electrical and Computer Engineering, 154 Summit Street, Newark, New Jersey, United States, 07102

Engineering Expo Technical Event with 7 PDHs available including electrical/lighting tract and ethics. Please register at the link below. https://www.eventleaf.com/e/CNYExpo There will be six tracts to choose from including civil, fire protection, lighting/electrical, mechanical/energy, and structural. An Engineering Ethics presentation will be offered during lunch. Co-sponsored by: C&S Engineers Agenda: Issued later and available on site link Room: Call 315-556-0824, Double Tree , 6301 route 298, East Syracuse, New York, United States, 13057

Join the IEEE Future Directions to explore The Challenge, The Opportunity and The Future Perspective in the IEEE Global Tech Forum on AI. Contribute your perspective on the generational changes and the influence and development of Generative AI on future technology and society. The IEEE Global Tech Forum on AI will be held on Thursday, 7 November 2024 in Cambridge, MA, USA. This event will be held at the Microsoft New England Research & Development Center (NERD). Co-sponsored by: IEEE Future Directions Agenda: 9:30AM Introduction, Chris Miyachi, IEEE Future Directions Committee Chair 9:40AM Keynote talk, (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#can-even) 10:40AM The Future: AI Through Gen-Z Eyes, - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#ceballos) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#sahoo) 11:25AM Stressy Depressy Chatty: AI’s Role in Transforming Mental Health - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#farahany) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#desilva) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#sackett) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#thennakoon) 12:10PM Lunch 12:55PM Becoming a More Creative Human thru Responsible AI Teaming - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#grise) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#cummings) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#hou) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#richards) 1:40PM Unravelling the AI Tapestry: Navigating Provenance and Trust in Artificial Intelligence - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#miyachi) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#dupree) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#liao) 2:10PM Pandora’s Box or Philosopher’s Stone? – The Delicate Balance - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#lewis) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#navarro) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#neppel) - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#roff) 2:55PM Imagination in Action - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#werner) 5:00PM Wrap-Up - (https://cmte.ieee.org/futuredirections/future-tech-forum/gtf-ai/#miyachi) 1 Memorial Drive, Cambridge, Massachusetts, United States, 02139

Thank you for attending the IEEE LI Power Electronics Symposium! Hauppauge, New York, United States

Upgrade includes: · Logo on swag bags given to attendees · Logo on symposium flyers & posters · Preferential table placement Hauppauge Radisson, 110 Motor Parkway, Hauppauge, Long Island, New York, United States, 11788

Upgrade includes: - Logo on the dinner napkins - Logo on symposium flyers & posters - Preferential table placement Hauppauge Radisson, 110 Motor Parkway, Hauppauge, Long Island, New York, United States, 11788

A wine cart sponsorship upgrade (limit 1) entitles you to one free table with preferential placement, logo inclusion on the symposium flyers and posters, and 100 tickets for you to give out to attendees for a free glass of wine. (Wine cart opens at 6 PM.) Hauppauge Radisson, 110 Motor Parkway, Hauppauge, Long Island, New York, United States, 11788

A beer cart sponsorship upgrade (limit 1) entitles you to one free table with preferential placement, logo inclusion on the symposium flyers and posters, and 100 tickets for you to give out to attendees for a free beer. (Beer cart opens at 5:30 PM.) Hauppauge Radisson, 110 Motor Parkway, Hauppauge, Long Island, New York, United States, 11788

When registering, please do NOT click the "Add a Guest" button! (Unless you want more than one table.) Hauppauge Radisson, 110 Motor Parkway, Hauppauge, Long Island, New York, United States, 11788

A lunch sponsorship upgrade entitles you to one free table with preferential placement, logo inclusion on the symposium flyers and posters, and logo inclusion on the poster at the lunch station. Hauppauge Radisson, 110 Motor Parkway, Hauppauge, Long Island, New York, United States, 11788

Upgrade includes: · Logo on the coffee break napkins · Logo on symposium flyers & posters · Preferential table placement Hauppauge Radisson, 110 Motor Parkway, Hauppauge, Long Island, New York, United States, 11788

(https://attend.ieee.org/wie-forum-usa-east-2024/) Stamford, Connecticut, United States