In this episode, I talk about a survey I didn’t plan to analyze—one that popped up the moment I opened Microsoft Word. Microsoft asked for feedback, and well… I had some. I break down the flaws in their opening question, including directional bias, vague wording, and unlabeled scale points. I also reflect on how these design choices impact data quality and what could have been done better. It’s a reminder that even the most common surveys we see in the wild from even the biggest tech giants can teach us a lot about what not to do. If you just enjoy a good critique, you’ll want to stick around for this one.

Contact us at: totalsurveydesign@gmail.com. And follow us on Instagram @totalsurveydesign.

Support the show

Find us online at: instagram.com/totalsurveydesign/
https://taplink.cc/totalsurveydesign
Contact us at: totalsurveydesign@gmail.com

In this episode of Total Survey Design, Dr. Azdren Coma and Dr. Seon Yup Lee interview Dr. Jon Krosnick, a leading expert on political behavior, survey methodology, and public opinion. Dr. Krosnick is a professor at Stanford University who has advised the U.S. Census Bureau, led national studies on voting behavior and climate change, and published extensively on how people form attitudes and make decisions.

Recorded at the historic St. Louis Union Station Hotel during the 2025 AAPOR conference, this conversation covers Dr. Krosnick’s career path, the role of mentorship, and his research on trust and measurement validity. The episode also addresses broader topics in academia, such as the pressures of publishing, the importance of constructive feedback, and the value of humility and replication in science.

Support the show

Find us online at: instagram.com/totalsurveydesign/
https://taplink.cc/totalsurveydesign
Contact us at: totalsurveydesign@gmail.com

In this episode I sat down with Thom to talk about surveys. We talked about his time at the Social and Economic Sciences Research Center, working with Don Dillman on various projects including the 2000 U.S. Census, some of his favorite projects, my dissertation survey, the application of the Tailored Design Method on a wide variety of cultures, and much more.

Support the show

Find us online at: instagram.com/totalsurveydesign/
https://taplink.cc/totalsurveydesign
Contact us at: totalsurveydesign@gmail.com

In this episode, we do a small retrospective on the first season. We also look ahead to see what is to come. We also give a call to action, seeking your support to ensure that this project continues to exist into the future.

If you would like to support us, you can do so by visiting our Ko-fi page at:

https://ko-fi.com/totalsurveydesign

Thank you.

Support the show

Find us online at: instagram.com/totalsurveydesign/
https://taplink.cc/totalsurveydesign
Contact us at: totalsurveydesign@gmail.com

In this episode, we explore essential considerations for crafting effective surveys. We begin by emphasizing the importance of defining the purpose of your survey, which serves as a guide through each step of its creation. We discuss how understanding your main goal—whether it's measuring customer satisfaction or academic variables—shapes your questions and improves data quality. Additionally, we highlight the significance of knowing your target population, budget, and timeframe. By the episode's end, we offer practical advice on streamlining your survey to avoid unnecessary questions, reduce costs, and enhance response quality. Join us to learn how to design your survey with precision and purpose.

Support the show

Find us online at: instagram.com/totalsurveydesign/
https://taplink.cc/totalsurveydesign
Contact us at: totalsurveydesign@gmail.com

In this episode, we discuss the target population. We emphasize the importance of a well-defined target population, in context of the goal of your survey, and in relation to your sampling frame. We offer examples of target populations of various studies, and offer suggestions for the types of variables that you may want to consider when thinking about your target population.

Support the show

Find us online at: instagram.com/totalsurveydesign/
https://taplink.cc/totalsurveydesign
Contact us at: totalsurveydesign@gmail.com

In this episode, we interview James McCall, a survey methodologist at Westat. James shares what first drew him to surveys, and what drove him into a career of surveys. We talk about his role as a survey methodologist in industry. We discuss cognitive testing, data scripts, and other elements of the art and science of survey design. We also discuss our pet-peeves, such as matrix questions, check-all-that-apply questions, pre-testing, having too-short timelines, and more. James also shares advice for social scientists who are interested in pursuing a career in survey methodology.

Support the show

Find us online at: instagram.com/totalsurveydesign/
https://taplink.cc/totalsurveydesign
Contact us at: totalsurveydesign@gmail.com

In this episode, we explore the key design elements of effective surveys, emphasizing the importance of user-friendly experiences and reliable data collection. But first, in our free talk segment we discuss the compensation structure of the YouGov platform.

Then, we highlight practical tips like strategic question ordering, clear language use, and consistent visual design. Additionally, the episode discusses behavioral aspects such as the appropriate use of forced responses and fair uses of attention checks to maintain respondent engagement without compromising data quality.

Support the show

Find us online at: instagram.com/totalsurveydesign/
https://taplink.cc/totalsurveydesign
Contact us at: totalsurveydesign@gmail.com