Dr Hyrum Anderson is a Distinguished Machine Learning Engineer at Robust Intelligence. Prior to that, he was Principal Architect of Trustworthy Machine Learning at Microsoft where he also founded Microsoft’s AI Red Team; he also led security research at MIT Lincoln Laboratory, Sandia National Laboratories, and Mendiant, and was Chief Scientist at Endgame (later acquired by Elastic). He’s also the co-author of the book “Not a Bug, But with a Sticker” and his research interests include assessing the security and privacy of ML systems and building Robust AI models.

Timestamps of the conversation 00:50 Introduction 01:40 Background in AI and ML security 04:45 Attacks on ML systems 08:20 Fractions of ML systems prone to Attacks 10:38 Operational risks with security measures 13:40 Solution from an algorithmic or policy perspective 15:46 AI regulation and policy making 22:40 Co-development of AI and security measures 24:06 Risks of Generative AI and Mitigation 27:45 Influencing an AI model 30:08 Prompt stealing on ChatGPT 33:50 Microsoft AI Red Team 38:46 Managing risks 39:41 Government Regulations 43:04 What to expect from the Book 46:40 Black in AI & Bountiful Children’s Foundation Check out Rora: https://teamrora.com/jayshah Guide to STEM Ph.D. AI Researcher + Research Scientist pay: https://www.teamrora.com/post/ai-researchers-salary-negotiation-report-2023 Rora's negotiation philosophy: https://www.teamrora.com/post/the-biggest-misconception-about-negotiating-salaryhttps://www.teamrora.com/post/job-offer-negotiation-lies Hyrum's Linkedin: https://www.linkedin.com/in/hyrumanderson/ And Research: https://scholar.google.com/citations?user=pP6yo9EAAAAJ&hl=en Book - Not a Bug, But with a Sticker: https://www.amazon.com/Not-Bug-But-Sticker-Learning/dp/1119883989/ About the Host: Jay is a Ph.D. student at Arizona State University. Linkedin: https://www.linkedin.com/in/shahjay22/ Twitter: https://twitter.com/jaygshah22 Homepage: https://www.public.asu.edu/~jgshah1/ for any queries. Stay tuned for upcoming webinars! ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Meredith is an associate professor at New York University and research director at the NYU Alliance for Public Interest Technology. Her research interests include using data analysis for good and ethical AI. She is also the author of the book “More Than a Glitch: Confronting Race, Gender, and Ability Bias in Tech” and we will discuss more about this with her in this podcast. Time stamps of the conversation 00:42 Introduction 01:17 Background 02:17 Meaning of “it is not a glitch” in the book title 04:40 How are biases coded into AI systems? 08:45 AI is not the solution to every problem 09:55 Algorithm Auditing 11:57 Why do organizations don't use algorithmic auditing more often? 15:12 Techno-chauvinism and drawing boundaries 23:18 Bias issues with ChatGPT and Auditing the model 27:55 Using AI for Public Good - AI on context 31:52 Advice to young researchers in AI Meredith's homepage: https://meredithbroussard.com/ And her Book: https://mitpress.mit.edu/9780262047654/more-than-a-glitch/ About the Host: Jay is a Ph.D. student at Arizona State University. Linkedin: https://www.linkedin.com/in/shahjay22/ Twitter: https://twitter.com/jaygshah22 Homepage: https://www.public.asu.edu/~jgshah1/ for any queries. Stay tuned for upcoming webinars! ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Part-2 of my podcast with David Stutz. (Part-1: https://youtu.be/J7hzMYUcfto) David is a research scientist at DeepMind working on building robust and safe deep learning models. Prior to joining DeepMind, he was a PhD student at the Max Plank Institute of Informatics. He also maintains a fantastic blog on various topics related to machine learning and graduate life which is insightful to young researchers out there. 00:00:00 Working at DeepMind 00:08:20 Importance of Abstraction and Collaboration in Research 00:13:08 DeepMind internship project 00:19:39 What drives research projects at DeepMind 00:27:45 Research in Industry vs Academia 00:30:45 Interview tips for research roles, at DeepMind or other companies 00:44:38 Finding the right Advisor & Institute for PhD 01:02:12 Do you really need a Ph.D. to do AI/ML research? 01:08:28 Academia vs Industry: Making the choice 01:10:49 Pressure to publish more papers 01:21:35 Artificial General Intelligence (AGI) 01:33:24 Advice to young enthusiasts on getting started David's Homepage: https://davidstutz.de/ And his blog: https://davidstutz.de/category/blog/ Research work: https://scholar.google.com/citations?user=TxEy3cwAAAAJ&hl=en About the Host: Jay is a Ph.D. student at Arizona State University. Linkedin: https://www.linkedin.com/in/shahjay22/ Twitter: https://twitter.com/jaygshah22 Homepage: https://www.public.asu.edu/~jgshah1/ for any queries. Stay tuned for upcoming webinars! ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Rora helps top AI researchers and professionals negotiate their pay -- often as they transition from academia into industry. Moving into tech is a huge transition for many PhDs and post-docs -- the pay is much more significant and the terms of employment are often quite different. In the past 5 years, the Rora team has helped over 1000 STEM professionals negotiate more than $10M in additional earnings from companies like DeepMind, OpenAI, Google Brain, and Anthropic -- and advocate for better roles, more alignment with their managers, and more flexible work. Referral link: https://teamrora.com/jayshah Guide to STEM Ph.D. AI Researcher + Research Scientist pay: https://www.teamrora.com/post/ai-researchers-salary-negotiation-report-2023 (the majority of the STEM PhDs we support are going into tech roles) Rora's negotiation philosophy: https://www.teamrora.com/post/the-biggest-misconception-about-negotiating-salaryhttps://www.teamrora.com/post/job-offer-negotiation-lieshttps://www.teamrora.com/post/roras-3-keys-to-negotiating-a-new-job-offer00:00 Highlights 00:55 Introduction 01:42 About Rora 05:40 Myths in Job Negotiations 08:58 Fear of losing job offers 12:36 30-60-90 day roadmap for negotiation 15:28 Knowing if you should negotiate 20:46 Negotiating with only one offer 24:40 What to negotiate? 29:00 Knowing if you're low-balled in offers 31:31 When negotiations don't workout 35:00 When & How to Negotiate? 43:00 Negotiating promotions 46:45 Is there always room for Negotiation? 49:42 Quick advice to people who have offers in hand 55:32 Wrong assumptions Learn more about Jordan: https://www.linkedin.com/in/jordansale And Rora: https://teamrora.com/jayshah Also check-out these talks on all available podcast platforms: https://jayshah.buzzsprout.com About the Host: Jay is a Ph.D. student at Arizona State University. Linkedin: https://www.linkedin.com/in/shahjay22/ Twitter: https://twitter.com/jaygshah22 Homepage: https://www.public.asu.edu/~jgshah1/ for any queries. Stay tuned for upcoming webinars! ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Part-1 of my podcast with David Stutz. (Part-2: https://youtu.be/IumJcB7bE20) David is a research scientist at DeepMind working on building robust and safe deep learning models. Prior to joining DeepMind, he was a Ph.D. student at the Max Plank Institute of Informatics. He also maintains a fantastic blog on various topics related to machine learning and graduate life which is insightful to young researchers out there. Check out Rora: https://teamrora.com/jayshah Guide to STEM Ph.D. AI Researcher + Research Scientist pay: https://www.teamrora.com/post/ai-researchers-salary-negotiation-report-202300:00:00 Highlights and Sponsors 00:01:22 Intro 00:02:14 Interest in AI 00:12:26 Finding research interests 00:22:41 Robustness vs Generalization in deep neural networks 00:28:03 Generalization vs model performance trade-off 00:37:30 On-manifold adversarial examples for better generalization 00:48:20 Vision transformers 00:49:45 Confidence-calibrated adversarial training 00:59:25 Improving hardware architecture for deep neural networks 01:08:45 What's the tradeoff in quantization? 01:19:07 Amazing aspects of working at DeepMind 01:27:38 Learning the skills of Abstraction when collaborating David's Homepage: https://davidstutz.de/ And his blog: https://davidstutz.de/category/blog/ Research work: https://scholar.google.com/citations?user=TxEy3cwAAAAJ&hl=en About the Host: Jay is a Ph.D. student at Arizona State University. Linkedin: https://www.linkedin.com/in/shahjay22/ Twitter: https://twitter.com/jaygshah22 Homepage: https://www.public.asu.edu/~jgshah1/ for any queries. Stay tuned for upcoming webinars! ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Dr. Subbarao Kambhampati is a Professor of Computer Science at Arizona State University and the director of the Yochan lab where his research focuses on decision-making and planning, specifically in the context of human-aware AI systems. He has been named a fellow of AAAI, AAAS, and ACM in recognition of his research contributions and also received a distinguished alumnus award from the University of Maryland and IIT Madras.

Check out Rora: https://teamrora.com/jayshah
Guide to STEM Ph.D. AI Researcher + Research Scientist pay: https://www.teamrora.com/post/ai-researchers-salary-negotiation-report-2023
Rora's negotiation philosophy:
https://www.teamrora.com/post/the-biggest-misconception-about-negotiating-salary
https://www.teamrora.com/post/job-offer-negotiation-lies

00:00:00 Highlights and Intro
00:02:16 What is chatgpt doing?
00:10:27 Does it really learn anything?
00:17:28 Chatgpt hallucinations & getting facts wrong
00:23:29 Generative vs Predictive Modeling in AI
00:41:51 Learning common patterns from Language
00:57:00 Implications in society
01:03:28 Can we fix chatgpt hallucinations? 
01:26:24 RLHF is not enough
01:32:47 Existential risk of AI (or chatgpt) 
01:49:04 Open sourcing in AI
02:04:32 OpenAI is not "open" anymore
02:08:51 Can AI program itself in the future?
02:25:08 Deep & Narrow AI to Broad & Shallow AI
02:30:03 AI as assistive technology - understanding its strengths & limitations
02:44:14 Summary

Articles referred to in the conversation
https://thehill.com/opinion/technology/3861182-beauty-lies-chatgpt-welcome-to-the-post-truth-world/

More about Prof. Rao
Homepage: https://rakaposhi.eas.asu.edu/
Twitter: https://twitter.com/rao2z

Also check-out these talks on all available podcast platforms: https://jayshah.buzzsprout.com

About the Host:
Jay is a Ph.D. student at Arizona State University.
Linkedin: https://www.linkedin.com/in/shahjay22/
Twitter: https://twitter.com/jaygshah22
Homepage: https://www.public.asu.edu/~jgshah1/ for any queries.

Stay tuned for upcoming webinars!

***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Checkout these Podcasts on YouTube: https://www.youtube.com/c/JayShahml
About the author: https://www.public.asu.edu/~jgshah1/

Karyna Naminas is the CEO of Label Your Data which provides data annotation services to different organizations interested in developing AI-based solutions.

Check out Rora: https://teamrora.com/jayshah
Guide to STEM Ph.D. AI Researcher + Research Scientist pay: https://www.teamrora.com/post/ai-researchers-salary-negotiation-report-2023
Rora's negotiation philosophy:
https://www.teamrora.com/post/the-biggest-misconception-about-negotiating-salary
https://www.teamrora.com/post/job-offer-negotiation-lies

00:00:00 Introduction and Sponsors
00:02:28 Background before being a CEO
00:06:38 Fascinating aspects of AI
00:09:10 Data annotation outside of AI
00:10:21 Effect of COVID, Russia-Ukraine War, and economic crisis on Business
00:18:47 Sourcing data annotators 
00:22:40 Challenges in annotation
00:31:00 Data annotation for Military applications in Ukraine
00:41:42 Tools used for annotation
00:44:56 Segment anything and chatgpt to facilitate annotation
00:51:00 Key responsibilities as a CEO
00:53:58 Metrics for performance evaluation
00:59:56 Building leadership
01:06:06 Advice to aspiring entrepreneurs
01:09:34 Dealing with failures as a CEO 

Learn more about Karyna: https://www.linkedin.com/in/karyna-naminas-923908200
Label Your Data: https://labelyourdata.com/
LinkedIn: https://www.linkedin.com/company/label-your-data/

Also check-out these talks on all available podcast platforms: https://jayshah.buzzsprout.com

About the Host:
Jay is a Ph.D. student at Arizona State University.
Linkedin: https://www.linkedin.com/in/shahjay22/
Twitter: https://twitter.com/jaygshah22
Homepage: https://www.public.asu.edu/~jgshah1/ for any queries.

Stay tuned for upcoming webinars!

***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Checkout these Podcasts on YouTube: https://www.youtube.com/c/JayShahml
About the author: https://www.public.asu.edu/~jgshah1/

Amey Dharwadker works as a Machine Learning Tech Lead Manager at Meta, supporting Facebook's Video Recommendations Ranking team and working on building and deploying personalization models for billions of users. He has also been instrumental in driving a significant increase in user engagement and revenue for the company through his work on News Feed and Ads ranking ML models. As an experienced researcher, he has co-authored publications at various AI/ML conferences and patents in the fields of recommender systems and machine learning. He has undergraduate and graduate degrees from the National Institute of Technology Tiruchirappalli (India) and Columbia University.

Time stamps of the conversation
00:00:46 Introduction
00:01:46 Getting into recommendation systems
00:05:25 Projects currently working on at Facebook, Meta
00:06:55 User satisfaction to improve recommendations
00:08:25 Implicit Metrics to improve engagement
00:11:34 Video vs product recommendations based on fixed attributes
00:13:20 Understanding video content
00:15:55 Working at Scale
00:20:02 Cold start problem
00:22:41 Data privacy concerns
00:24:36 Challenges of deploying machine learning models
00:30:56 Trade-off in metrics to boost user engagement
00:33:47 Introspecting recommender systems - Interpretability 
00:37:14 Long video vs short video - how to adapt algorithms?
00:42:17 Being a Machine Learning Tech Lead Manager at Meta - work routine
00:45:00 Transitioning to leadership roles
00:50:55 Tips on interviewing for Machine Learning roles
00:57:23 Machine Learning job interviews
01:02:30 Finding your interest in AI/machine learning
01:05:24 Transitioning to ML roles within the industry 
01:08:36 Remaining updated to research 
01:12:00 Advice to young computer science students

More about Amey: https://research.facebook.com/people/dharwadker-amey-porobo/
Linkedin: https://www.linkedin.com/in/ameydharwadker/

Also check-out these talks on all available podcast platforms: https://jayshah.buzzsprout.com

About the Host:
Jay is a Ph.D. student at Arizona State University.
Linkedin: https://www.linkedin.com/in/shahjay22/
Twitter: https://twitter.com/jaygshah22
Homepage: https://www.public.asu.edu/~jgshah1/ for any queries.

Stay tuned for upcoming webinars!

***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Checkout these Podcasts on YouTube: https://www.youtube.com/c/JayShahml
About the author: https://www.public.asu.edu/~jgshah1/