The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization by Hendrycks, Dan, Basart, Steven, Mu, Norman, Kadavath, Saurav, Wang, Frank, Dorundo, Evan, Desai, Rahul, Zhu, Tyler, Parajuli, Samyak, Guo, Mike, Song, Dawn, Steinhardt, Jacob, Gilmer, Justin

Request full text

DeepChrome 2.0: Investigating and Improving Architectures, Visualizations, & Experiments by Kadavath, Saurav, Paradis, Samuel, Yeung, Jacob

Get full text

Pretraining & Reinforcement Learning: Sharpening the Axe Before Cutting the Tree by Kadavath, Saurav, Paradis, Samuel, Yao, Brian

Get full text

Measuring Mathematical Problem Solving With the MATH Dataset by Hendrycks, Dan, Burns, Collin, Kadavath, Saurav, Arora, Akul, Basart, Steven, Tang, Eric, Song, Dawn, Steinhardt, Jacob

Get full text

Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty by Hendrycks, Dan, Mantas Mazeika, Kadavath, Saurav, Song, Dawn

Get full text

Measuring Coding Challenge Competence With APPS by Hendrycks, Dan, Basart, Steven, Kadavath, Saurav, Mantas Mazeika, Arora, Akul, Guo, Ethan, Burns, Collin, Puranik, Samir, He, Horace, Song, Dawn, Steinhardt, Jacob

Get full text

Measuring Faithfulness in Chain-of-Thought Reasoning by Lanham, Tamera, Chen, Anna, Radhakrishnan, Ansh, Steiner, Benoit, Denison, Carson, Hernandez, Danny, Li, Dustin, Durmus, Esin, Hubinger, Evan, Jackson Kernion, Lukošiūtė, Kamilė, Nguyen, Karina, Cheng, Newton, Nicholas, Joseph, Schiefer, Nicholas, Rausch, Oliver, Larson, Robin, McCandlish, Sam, Kundu, Sandipan, Kadavath, Saurav, Yang, Shannon, Henighan, Thomas, Maxwell, Timothy, Telleen-Lawton, Timothy, Hume, Tristan, Hatfield-Dodds, Zac, Kaplan, Jared, Brauner, Jan, Bowman, Samuel R, Perez, Ethan

Get full text

The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization by Hendrycks, Dan, Basart, Steven, Mu, Norman, Kadavath, Saurav, Wang, Frank, Dorundo, Evan, Desai, Rahul, Zhu, Tyler, Parajuli, Samyak, Guo, Mike, Song, Dawn, Steinhardt, Jacob, Gilmer, Justin

Get full text

Specific versus General Principles for Constitutional AI by Kundu, Sandipan, Bai, Yuntao, Kadavath, Saurav, Askell, Amanda, Callahan, Andrew, Chen, Anna, Goldie, Anna, Balwit, Avital, Mirhoseini, Azalia, McLean, Brayden, Olsson, Catherine, Evraets, Cassie, Tran-Johnson, Eli, Durmus, Esin, Perez, Ethan, Jackson Kernion, Kerr, Jamie, Ndousse, Kamal, Nguyen, Karina, Nelson Elhage, Cheng, Newton, Schiefer, Nicholas, DasSarma, Nova, Rausch, Oliver, Larson, Robin, Yang, Shannon, Kravec, Shauna, Telleen-Lawton, Timothy, Liao, Thomas I, Henighan, Tom, Hume, Tristan, Hatfield-Dodds, Zac, Mindermann, Sören, Nicholas, Joseph, McCandlish, Sam, Kaplan, Jared

Get full text

Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned by Ganguli, Deep, Lovitt, Liane, Jackson Kernion, Askell, Amanda, Bai, Yuntao, Kadavath, Saurav, Mann, Ben, Perez, Ethan, Schiefer, Nicholas, Ndousse, Kamal, Jones, Andy, Bowman, Sam, Chen, Anna, Conerly, Tom, DasSarma, Nova, Drain, Dawn, Nelson Elhage, El-Showk, Sheer, t, Stanislav, Hatfield-Dodds, Zac, Henighan, Tom, Hernandez, Danny, Hume, Tristan, Jacobson, Josh, Johnston, Scott, Kravec, Shauna, Olsson, Catherine, Ringer, Sam, Tran-Johnson, Eli, Amodei, Dario, Brown, Tom, Nicholas, Joseph, McCandlish, Sam, Olah, Chris, Kaplan, Jared, Clark, Jack

Get full text

Language Models (Mostly) Know What They Know by Kadavath, Saurav, Conerly, Tom, Askell, Amanda, Henighan, Tom, Drain, Dawn, Perez, Ethan, Schiefer, Nicholas, Hatfield-Dodds, Zac, DasSarma, Nova, Tran-Johnson, Eli, Johnston, Scott, El-Showk, Sheer, Jones, Andy, Nelson Elhage, Hume, Tristan, Chen, Anna, Bai, Yuntao, Bowman, Sam, t, Stanislav, Ganguli, Deep, Hernandez, Danny, Jacobson, Josh, Jackson Kernion, Kravec, Shauna, Lovitt, Liane, Ndousse, Kamal, Olsson, Catherine, Ringer, Sam, Amodei, Dario, Brown, Tom, Clark, Jack, Nicholas, Joseph, Mann, Ben, McCandlish, Sam, Olah, Chris, Kaplan, Jared

Get full text

Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback by Bai, Yuntao, Jones, Andy, Ndousse, Kamal, Askell, Amanda, Chen, Anna, DasSarma, Nova, Drain, Dawn, t, Stanislav, Ganguli, Deep, Henighan, Tom, Nicholas, Joseph, Kadavath, Saurav, Jackson Kernion, Conerly, Tom, El-Showk, Sheer, Nelson Elhage, Hatfield-Dodds, Zac, Hernandez, Danny, Hume, Tristan, Johnston, Scott, Kravec, Shauna, Lovitt, Liane, Nanda, Neel, Olsson, Catherine, Amodei, Dario, Brown, Tom, Clark, Jack, McCandlish, Sam, Olah, Chris, Mann, Ben, Kaplan, Jared

Get full text

The Capacity for Moral Self-Correction in Large Language Models by Ganguli, Deep, Askell, Amanda, Schiefer, Nicholas, Liao, Thomas I, Lukošiūtė, Kamilė, Chen, Anna, Goldie, Anna, Mirhoseini, Azalia, Olsson, Catherine, Hernandez, Danny, Drain, Dawn, Li, Dustin, Tran-Johnson, Eli, Perez, Ethan, Jackson Kernion, Kerr, Jamie, Mueller, Jared, Landau, Joshua, Ndousse, Kamal, Nguyen, Karina, Lovitt, Liane, Sellitto, Michael, Nelson Elhage, Mercado, Noemi, DasSarma, Nova, Rausch, Oliver, Lasenby, Robert, Larson, Robin, Ringer, Sam, Kundu, Sandipan, Kadavath, Saurav, Johnston, Scott, Kravec, Shauna, Sheer El Showk, Lanham, Tamera, Telleen-Lawton, Timothy, Henighan, Tom, Hume, Tristan, Bai, Yuntao, Hatfield-Dodds, Zac, Mann, Ben, Amodei, Dario, Nicholas, Joseph, McCandlish, Sam, Brown, Tom, Olah, Christopher, Clark, Jack, Bowman, Samuel R, Kaplan, Jared

Get full text

Constitutional AI: Harmlessness from AI Feedback by Bai, Yuntao, Kadavath, Saurav, Kundu, Sandipan, Askell, Amanda, Jackson Kernion, Jones, Andy, Chen, Anna, Goldie, Anna, Mirhoseini, Azalia, McKinnon, Cameron, Chen, Carol, Olsson, Catherine, Olah, Christopher, Hernandez, Danny, Drain, Dawn, Ganguli, Deep, Li, Dustin, Tran-Johnson, Eli, Perez, Ethan, Kerr, Jamie, Mueller, Jared, Ladish, Jeffrey, Landau, Joshua, Ndousse, Kamal, Lukosuite, Kamile, Lovitt, Liane, Sellitto, Michael, Nelson Elhage, Schiefer, Nicholas, Mercado, Noemi, DasSarma, Nova, Lasenby, Robert, Larson, Robin, Ringer, Sam, Johnston, Scott, Kravec, Shauna, Sheer El Showk, t, Stanislav, Lanham, Tamera, Telleen-Lawton, Timothy, Conerly, Tom, Henighan, Tom, Hume, Tristan, Bowman, Samuel R, Hatfield-Dodds, Zac, Mann, Ben, Amodei, Dario, Nicholas, Joseph, McCandlish, Sam, Brown, Tom, Kaplan, Jared

Get full text

Discovering Language Model Behaviors with Model-Written Evaluations by Perez, Ethan, Ringer, Sam, Lukošiūtė, Kamilė, Nguyen, Karina, Chen, Edwin, Scott, Heiner, Pettit, Craig, Olsson, Catherine, Kundu, Sandipan, Kadavath, Saurav, Jones, Andy, Chen, Anna, Mann, Ben, Israel, Brian, Seethor, Bryan, McKinnon, Cameron, Olah, Christopher, Yan, Da, Amodei, Daniela, Amodei, Dario, Drain, Dawn, Li, Dustin, Tran-Johnson, Eli, Khundadze, Guro, Jackson Kernion, Landis, James, Kerr, Jamie, Mueller, Jared, Jeeyoon Hyun, Landau, Joshua, Ndousse, Kamal, Goldberg, Landon, Lovitt, Liane, Lucas, Martin, Sellitto, Michael, Zhang, Miranda, Kingsland, Neerav, Nelson Elhage, Nicholas, Joseph, Mercado, Noemí, DasSarma, Nova, Rausch, Oliver, Larson, Robin, McCandlish, Sam, Johnston, Scott, Kravec, Shauna, Sheer El Showk, Lanham, Tamera, Telleen-Lawton, Timothy, Brown, Tom, Henighan, Tom, Hume, Tristan, Bai, Yuntao, Hatfield-Dodds, Zac, Clark, Jack, Bowman, Samuel R, Askell, Amanda, Grosse, Roger, Hernandez, Danny, Ganguli, Deep, Hubinger, Evan, Schiefer, Nicholas, Kaplan, Jared

Get full text