Three common research methodologies are CAPI, CATI, and CAWI, which stand for Computer Assisted Personal Interviewing, Computer Assisted Telephone Interviewing, and Computer Assisted Web Interviewing. While these three methods have similar names and are often mentioned together, in practice they are very different methods, and each has unique characteristics which should be taken into account when deciding on a data collection method. Below we outline the major differences of CATI, CAPI, and CAWI, along with pros and cons of each method.

Computer Assisted Personal Interviewing (CAPI)

Computer Assisted Personal Interviewing or CAPI is an in-person or face-to-face research method in which interviewers use software on a computer or tablet to record interview responses. CAPI is an interviewer-administered mode, meaning that interviewers can clarify questions that may be unclear to respondents and ask follow-ups. It is generally considered an improvement on older face-to-face interview methodologies, in which interviewers relied on pen and paper to read through a questionnaire and record responses, because it reduces the chance of interviewer error and enables more secure storage of data. CAPI surveys support nearly any question type, both qualitative and quantitative, and interviewers can use visual and audio aids.

Because CAPI is an in-person research mode, it can reach anyone, even populations who do not have internet or phone access, which makes it a good solution for gathering data from low-income populations. However, CAPI requires interviewers to be trained in survey administration and for them to travel to each household they will interview. In emerging regions and rural areas where houses can be dispersed over a large area, this can make administering CAPI surveys time-consuming.

Pros of Computer Assisted Personal Interviewing:  

• Can reach any household or respondent, even those without internet or phone access
• Allows for interviewers to collect detailed data through follow-up questions and probing
• Improves on paper and pen survey administration by reducing the chance of interviewer error or data loss

Cons of Computer Assisted Personal Interviewing:  

• Requires interviewers to be recruited and trained in survey administration
• Can be time-consuming for interviewers to travel from household to household, especially in rural areas
• Can be costly due to the need for trained interviewers and the length of time it takes to collect data 

Computer Assisted Telephone Interviewing (CATI)

Computer Assisted Telephone Interviewing or CATI is a voice call interview method in which trained interviewers call respondents’ phone numbers, usually working from a central call center. CATI interviews are similar to CAPI interviews in that they are interviewer-administered, so interviewers can conduct similar probing and clarification of survey questions, and CATI software also allows interviewers to securely record responses and save data. CATI interviews support both qualitative and quantitative survey questions and can utilize audio aids as part of a questionnaire design.

CATI surveys can only reach populations with access to a landline or mobile phone, which means the lowest-income populations may not be reachable through a CATI survey. However, CATI is generally faster to administer than CAPI surveys and slightly lower cost, as interviewers work from a central location rather than traveling to conduct surveys in person.

Pros of Computer Assisted Telephone Interviewing:

• Allows for interviewers to collect detailed data through follow-up questions and probing
• Securely stores data and enables simple survey administration through CATI software
• Reaches wide segments of the population without having to overcome logistical hurdles associated with in-person research
• Interviews can be administered at the respondent’s convenience by scheduling a call-back time

Cons of Computer Assisted Telephone Interviewing:

• Requires interviewers to be recruited and trained in survey administration
• May not reach the lowest-income populations who do not have access to a mobile phone or landline

Computer Assisted Web Interviewing (CAWI)

Computer Assisted Web Interviewing or CAWI is another name for online surveys or interviews, which are surveys administered through a web browser or mobile application. Links for CAWI surveys can be sent through multiple methods, including email, mobile application notifications, online advertisements, and SMS messages. CAWI surveys support both closed-ended and open-ended survey questions, however may not provide as detailed qualitative data as an interviewer-administered mode such as CATI or CAPI.

CAWI surveys are useful for gathering quick insights from large sample sizes as they do not require interviewers to be trained and can be distributed very widely, but they are limited to populations who have internet access and are comfortable using computers or internet-enabled phones or tablets. CAWI surveys are also self-administered, meaning you rely on the respondent to fill in a survey accurately without the guidance of an interviewer, and that questionnaires generally need to be shorter for respondents to complete them.   

Pros of Computer Assisted Web Interviewing

• Simple to set-up and administer to large sample sizes
• Do not require the hiring and training of interviewers
• Can be a fast and low-cost method of data collection

Cons of Computer Assisted Web Interviewing

• Only reach literate populations and those with access to the internet and a computer or mobile device
• Qualitative data collection can be more limited than with interviewer-administered modes
• Questionnaires should be shorter to encourage higher completion rates

Choosing between CAPI, CATI, and CAWI

As outlined above, there are significant differences between CAPI, CATI, and CAWI survey modes. Generally, if you are looking to get the most representative survey possible, CAPI and CATI are the best options, but CAWI can be useful for quickly gathering insights on a consumer population or in countries which have high levels of internet access. When choosing a research mode, you must take into account the population you are trying to reach, questionnaire length and complexity, budget, and timeline. Use GeoPoll’s interactive research mode picker to get a quick view of what modes may be feasible for the project you are working on.

Depending on the country you are looking to research in, some modes may be more feasible than others, and talking to a research expert can help you narrow down your mode options. In addition to the three research modes mentioned here, there are other options such as SMS and Interactive Voice Response (IVR) which some research firms, such as GeoPoll, offer in addition to CAPI, CATI, and CAWI.

To speak to the GeoPoll team about which research mode is right for you, please contact us today.

The post CAPI, CATI, and CAWI Research Methods appeared first on GeoPoll.

Interview with King Beach

Tell me about your background before you came to GeoPoll and what space you worked in 

I started in survey research and social science research as an undergrad at Michigan State. My degree was in the natural science with an emphasis on research and scientific methods – I also worked with the Institute for Public Policy and Social Research to learn about survey research, designing surveys, managing call centers, and improving performance. I engaged on a lot of social norms surveys and health surveys, and I worked up from a interviewer to manager through undergrad, and then continued to work with that group before joining GeoPoll.

What drew you to GeoPoll and made you join the team? How long have you been at GeoPoll?  

It sounded exciting – I found the position through AAPOR and it sounded like a good opportunity to get involved with new research methods. GeoPoll was also offering the opportunity to do multi-faceted components of the research, seeing the research lifecycle from questionnaire design to analysis. There are not a lot of organizations who let you do all of that. It was startup mentality and there was an interest in doing exploratory research that hasn’t been done before by testing and seeing what does and doesn’t work in market research.

Thinking about my roles within the company, oh boy! I came on as a research assistant and was mostly focused on survey operations and day to day project management. That evolved to managing teams related to the influx of SMS work that we had at the time, and growing survey operations from a team of 1-2 to a team of 15. Recently my work has transitioned over to CATI as clients are more interested in our ability to collect data through CATI. I now work on a wide variety of things surrounding our operations, from design of our mobile applications to client communications.

Can you briefly describe your current role at GeoPoll and main responsibilities?  

The Solutions Team oversees our call center and in-person work in over 60 countries. We onboard, train, and provide standardized quality control with the local teams we work with for our CATI and CAPI surveys. This means meeting the teams, doing trainings, and making sure different groups can meet our standards for quality and oversight.

Within 2020 the big change has been transitioning from face-to-face to virtual training. In 2019 we had a large network of team members who could travel to countries to do work and face-to-face training, we had about 6 people (on the Solutions Team) on the road at any one time. We’ve reinvented that to do that virtually all over video meeting while still implementing the standards we had while in person. It has led to some challenges in communication but for the most part we’ve been successful in migrating to virtual oversight.

What is the biggest challenge in overseeing so many call centers in different regions?

We’ve learned along the way that we need to have local partners in market who are on the ground to help co-design surveys, assist with trainings, provide feedback on questionnaires, and more. Gathering local context and constructive feedback through virtual meetings is crucial and we’ve bridged that gap by finding the right people in the right positions. Another thing is scaling given how much growth we’ve had in the past year – we’ve increased our CATI work 5-6x in the past year.

For call centers, oversight is challenging as we’ve seen when teams have gone remote in countries where working remote is not very common, there have been teething issues with staff who are not used to working at home. We are working in countries where people don’t work remotely so there has been a lot of growth that our teams have taken on to maintain their staff of interviewers remotely – in Burkina Faso our call center manager was going house to house on a scooter to check on interviewers to make sure they had everything they needed!

You mentioned the growth we’ve seen in CATI over the past year, largely due to restrictions around in-person research. Can you speak to that and if you think clients will stay with CATI now that they’ve tried it out?

It’s interesting as GeoPoll has been on the front of this for so long and you see these big shifts with how data is collected over time. On the consumer research side, I think the industry will stick with CATI work if they are still getting data they expect with the quality they expect at a cheaper price point. The advantage with CATI is that you can still do both quantitative and qualitative research and provide the same level of oversight as with CAPI. On the international development side, I do think more work will remain with CATI but very targeted projects may move back to CAPI.

What I’ve heard from our colleagues is that the CATI work and the quality of data we have provided is an eye opener for the industry which has led to more work with many clients. When they run the first couple projects with us they might be testing between modes, and they are pleased with the quality we provide so continue on.

What are you excited about in terms of where GeoPoll will go in the future?  

What I’m most excited about is that we’ve found a way to be on the forefront of new research. We are able to offer clients a variety of ways to work with us and provide different forms of data. We’ve also found a way to adapt and expand what we do here at an unprecedented pace in terms of growth. A year ago we may have ran CATI in 20 markets and now we’re in 60. Being able to continue to expand to meet client’s needs is always interesting, whether that’s through new markets, approaches, or project design.

What’s a fact about yourself that people may not know right away?

I think you know most of these but I love art, cars, hiking and the outdoors. Street art is a fun one, and in most of the new offices we’ve opened I’ve done a mural for the office. I think I’ve done art in Africa in 5-6 different countries in our offices and even working with local art communities. It builds comradery with the rest of the team when I go out and share some personal art.

The post King Beach on Remotely Managing 60+ Call Centers appeared first on GeoPoll.

In mid-December, GeoPoll began to make calls to Tigray and the neighboring Amhara region from our call center located in Addis Ababa, Ethiopia, aiming to gather more information on the crisis and reach those who had been impacted. While communications outages were ongoing in some areas, GeoPoll was able to reach 434 respondents in Amhara and 46 in Tigray through Computer Assisted Telephone Interviewing (CATI). CATI voice calls were made by trained interviewers in local languages (Amharic and Tigrinya). All respondents opted-into the study and were given information regarding the confidentiality of their responses.

Data from Tigray and Amhara, Ethiopia

While the results from our study are limited in scope and from a small sample size, they provide some insight into the current situation on-the-ground in Northern Ethiopia. Results show that a much higher percentage in Tigray than in Amhara have been forced to leave their home or know someone who has left their home, with 52% of those in Tigray saying they have fled their home in the past 2 months and 80% in Tigray knowing someone who has fled their home. A higher percent in Tigray (63% compared to 9% in Amhara) also say they have witnessed violence in the past two weeks, and that they do not feel safe in their homes

Food and livestock markets are more likely to be closed in Tigray, with 57% reporting that their food market is closed and 58% that their livestock market is closed.  Over half of those in Tigray report that they do not have access to medical care, and 80% have experienced phone outages, compared to 32% in Amhara who have experienced phone outages. Those in both Amhara and Tigray report shortages of necessities such as fuel, but they are more severe in Tigray; 87% in Tigray have experienced shortages of necessities while 40% in Amhara say the same.

Open-ended answers give more context to reasons why people have been displaced from their homes, with many citing conflict, the current food situation, necessity shortages, and violence people have witnessed. Regarding violence they had observed, one respondent stated that ‘I saw a battle in which the Tigray Special Forces attacked defense, and then the Amhara Regional State Special Forces came to rescue the defense force and fought to save them.’ Regarding the food situation, while some say it is fine now, others state there is a food shortage, with one respondent stating ‘There is low food supply and high increases in price.’ Answers around shortages of necessities mention food, water, and electricity, among other items. We also asked about current concerns and hopes for the future of Ethiopia, with many citing peace as a hope for the future of Ethiopia.

The full results of this study are available in the dashboard below. To learn more about GeoPoll’s capabilities in Ethiopia, please contact us.

The post Remote Data Collection in Northern Ethiopia: Tigray and Amhara appeared first on GeoPoll.

CATI stands for Computer Assisted Telephone Interviewing. CATI is a common research mode in which interviewers conduct surveys via telephone calls using a computer-assisted method, such as a software system loaded onto a computer or mobile device. In the CATI survey method, interviewers (also called survey enumerators) use CATI software which guides them through a survey, records responses, and monitors response and completion rates, among other features. The CATI software or application houses the survey design, including the full questionnaire and related instructions, survey routing or logic, and all questions and answer options.

Benefits of CATI Survey Research

CATI improves on traditional voice call methods, which use a pen-and-paper system to review questions and record answers. Using a CATI application or software, data is securely stored, and interviewers can focus on the interview rather than other items such as survey routing. While each CATI software has unique features, general advantages of CATI software include:

• Performs survey routing automatically based on the inputted answer; If a respondent answers ‘yes’ to a specific question, the CATI software will automatically display the correct next question
• Inputs and uploads data to a central system automatically, removing the need for manual data input based on pen-and-paper questionnaires. This dramatically reduces data processing errors and time spent uploading data
• Stores questionnaires digitally, so they can be updated or changed on-the-fly if issues arise with question-wording or skip logic
• Automatically tracks survey production statistics, including response rates, completion rates, dropoff rates, and more
• Allows for remote oversight of interviewers through analytics, including total interview length, individual question length, and response patterns, which can be automatically fed into a quality assurance dashboard and monitored regularly
• Provides recordings of interviews which can be examined for further data quality checks
• Compared to other voice call research methods, such as Interactive Voice Response, CATI surveys are a closer alternative to face-to-face interviews. This is because they are interviewer-administered, allow for follow-up questions from the interviewer, and can gather qualitative data through open-ended questions.

Challenges of CATI Survey Research

Some challenges should be taken into consideration when embarking on a CATI research project. These include:

• Interviewers must be trained not only on the specific questionnaire but also on the CATI software they are using, as each can have a different flow and features
• If questionnaires are scripted incorrectly into the CATI software, interviewers may not notice and incorrectly administer surveys
• Open-ended answers still need to be typed into the CATI software, which can leave room for error when transcribing
• Depending on the CATI software, it may be difficult to modify previous answers as navigating backwards is more challenging than when using pen-and-paper questionnaires

While researchers must keep these challenges in mind, they can be mitigated through interviewer training programs and regular cross-checks of questionnaire scripting, among other quality control measures.

How CATI Research Works

The CATI research process may differ slightly based on the research group being used. When working with GeoPoll, who has an existing network of over 40 call centers located around the globe, the process for a new project typically follows these steps:

Phase 1: Concept and Initiation:In this phase, GeoPoll will discuss the project specifications with the client, conduct a feasibility assessment, decide on a sampling frame and sampling approach such as random digit dialing, and put together a budget based on the targeting, sample size, questionnaire length, and other considerations.  

Phase 2: Project Definition and Planning: Next, GeoPoll’s execution team will work with the client to design a questionnaire using best practices for CATI survey design, translate the questionnaire, and conduct extensive project-specific interviewer training. For some projects, GeoPoll will conduct a pilot that can be used as a quality check before the study goes into full production.

Phase 3: Survey Production and Monitoring:Once the planning is completed GeoPoll’s team will move a survey into the production phase. In this phase, phone numbers are generated or provided to interviewers who begin making live calls. Throughout survey production, survey data and analytics which demonstrate interviewer progress are regularly monitored to ensure the highest-quality outputs. Call recordings are also used for an additional level of quality assurance.

Phase 4: Data Analysis and Outputs:Once the data is collected and quality checks are undertaken, it is passed onto GeoPoll’s research team for analysis. The research team performs another round of quality checks and then prepares data in the desired output, including raw data files, written reports, excel tables, and more.   

CATI vs CAPI and CAWI 

One common question surrounding Computer Assisted Telephone Interviewing is how it compares to other modes. You can read this post to learn more about how CATI compares to IVR, an automated voice-call mode that does not use live interviewers. Other methods CATI can be compared to are CAPI, Computer Assisted Personal Interviewing, and CAWI, Computer Assisted Web Interviewing. CAPI is a face-to-face research mode which, similarly to CATI, is aided by a software system that enables the interviewer to view questions and be automatically routed through a survey.

Many of the benefits listed above for CATI apply to CAPI surveys. Using CAPI instead of a pen-and-paper method reduces data input errors and allows for remote oversight of interviewers when they are in the field, often showing where they are through GPS and tracking metrics such as length of the interview. A benefit of CAPI over CATI is that you can reach a wider population, as CAPI does not require respondents to have mobile phones. However, CAPI surveys can take a long time to conduct as interviewers need to travel from house to house to gather survey responses.a

Computer Assisted Web Interviewing is another name for link-based or online surveys. These surveys are opened by respondents in a web page, who complete the questionnaire themselves. CAWI surveys are self-administered, so do not allow for the type of follow-ups that CATI provides for, and only reach those with an internet connection. Benefits of CAWI or any online survey mode are the speed at which a large group of respondents can be surveyed, and the relatively low cost.

CATI Software in Africa, Asia, and Latin America 

GeoPoll conducts CATI surveys out of over 40 call centers we operate throughout Africa, Asia, and Latin America, using our own proprietary CATI application. GeoPoll’s CATI software application was built specifically for use in countries in Africa, Asia, and Latin America. It has features including an offline mode, call recording, built-in quality checks, multi-lingual capabilities, and more. To learn more about GeoPoll’s CATI services or run your own CATI survey through GeoPoll, please contact us today.

The post CATI Surveys in Market Research | Computer Assisted Telephone Interviewing appeared first on GeoPoll.

GeoPoll has been increasingly tasked with transitioning face-to-face research projects to CATI, a remote research methodology which gathers data through voice calls. As a result, over the past few months we have been rapidly opening remote call centers, training survey interviewers, and deploying new Computer Assisted Telephone Interviewing projects. We are pleased to share that in June 2020 GeoPoll’s CATI services operated in 41 countries, and we managed over 700 survey interviewers who completed more than 85,000 voice call interviews.

GeoPoll oversees call centers throughout Africa, Latin America, and Asia that enable remote data collection on vital indicators including food security, access to healthcare, and more. We are conducting studies for partners that directly relate to the pandemic, such as the Insights2Impact COVID-19 tracker, as well as those which track the indirect effects of coronavirus, and other studies which are not currently possible to administer in-person due to coronavirus and related travel restrictions.

Conducting survey research through CATI is an excellent substitute for in-person research, as this method can reach illiterate populations, only requires the respondent has access to a basic mobile handset, and is administered by a trained interviewer, rather than being self-administered by the respondent. CATI also allow for longer survey questionnaires than can typically be used in modes such as SMS, and have been found to have higher response rates and completion rates than Interactive Voice Response (IVR).

GeoPoll’s team is experienced in quickly launching new call centers and CATI projects. Our CATI operations are led by our dedicated solutions team, consisting of GeoPoll staff located in the United States, Kenya, and South Africa, and are supported by trusted GeoPoll partners around the globe. Data collection and interviewer monitoring are enabled by GeoPoll’s proprietary CATI application, which was built specifically for use in emerging markets.

GeoPoll Computer Assisted Interviewing Application

GeoPoll’s CATI application is a simple to use application that facilitates GeoPoll’s CATI survey projects. Using the CATI application, interviewers are guided through each survey and can easily record responses and take notes during an interview. The application operates using only a mobile device or tablet, meaning interviewers do not need specialized hardware to get started. This has enabled GeoPoll to remotely onboard and train new interviewers during the COVID-19 crisis, when many of our call centers have transitioned to operating remotely.

Features of the GeoPoll CATI Application include:

• Supports multiple languages and scripts
• An offline mode allows for interviews to be conducted when device is offline and automatically uploaded when connectivity is present
• Supports multiple question types including multiple choice, open ended, media capture, and more
• Includes a secure login and multiple levels of access to ensure all data is secured
• Integrated with phone dialer
• Provides immediate airtime incentives in many markets

Conduct CATI Interviews in Africa, Asia, Latin America

GeoPoll has conducted CATI interviews in the following countries and can launch in new markets within 30 days. To request more information on our capabilities please contact us.

Africa CATI Capabilities:

GeoPoll has completed CATI projects in all of the below countries in sub-Saharan Africa and North Africa:

• Angola
• Benin
• Botswana
• Burkina Faso
• Cameroon
• Central African Republic
• Chad
• Côte D’Ivoire
• Democratic Republic of Congo
• Ethiopia
• Gambia
• Ghana
• Guinea
• Kenya
• Liberia
• Madagascar
• Malawi
• Mali
• Mauritania
• Morocco
• Mozambique
• Namibia
• Niger
• Nigeria
• Republic of Congo
• Rwanda
• Senegal
• Sierra Leone
• Somalia
• South Africa
• South Sudan
• Sudan
• Tanzania
• Tunisia
• Uganda
• Zambia
• Zimbabwe

The Americas CATI Capabilities:

GeoPoll has completed CATI projects in all of the below countries in North, Central, and South America, and the Caribbean:

• Colombia
• Dominican Republic
• Ecuador
• El Salvador
• Guatemala
• Honduras
• Mexico
• Nicaragua
• Panama
• Trinidad & Tobago
• Venezuela

Asia and The Middle East CATI Capabilities:

GeoPoll has completed CATI projects in all of the below countries in South Asia, Southeast Asia and The Middle East

• Afghanistan
• Bangladesh
• Bhutan
• India
• Indonesia
• Iraq
• Nepal
• Pakistan
• Philippines
• Sri Lanka

The post GeoPoll’s CATI Operations in Africa, Asia, Latin America appeared first on GeoPoll.

In-person research is one of the oldest methods of data collection and remains popular today despite the high costs often associated with this methodology. Face-to-face methodologies are still used regularly in emerging regions such as those in Africa, Asia, and Latin America, where researchers looking to reach lower socioeconomic classes often turn to in-person interviewers.

However, the coronavirus outbreak has made in-person research impossible in many countries due to travel restrictions and lockdowns, and inadvisable in other regions due to the health risks associated with interviewers traveling door-to-door. In order to keep interviewers and their subjects safe, researchers must quickly find alternative ways to collect data, especially when that data can provide vital information on food availability, healthcare-seeking behaviors, and consumer perceptions.

Best Practices for Remote Data Collection

At GeoPoll we have been conducting research in emerging regions through remote, mobile-based methodologies since our launch in 2014. Our expertise in collecting data through modes including SMS, mobile web, and Computer-Assisted Telephone Interviewing (CATI) enables us to assist those looking to transition in-person projects to remote modes. Below are some of our tips for adapting in-person studies to remote methodologies:

Assess available research modes: Remote research modes that are commonly used in emerging regions include 2-way SMS, CATI voice calls, IVR calls, mobile web links, and mobile applications. While CATI call centers may not be able to continue to operate out of a central location in all countries, providers such as GeoPoll are already working on systems to allow interviewers to conduct calls from their own homes.

Consider the population you are reaching: While in-person modes can reach all socioeconomic classes, increased mobile penetration around the globe allows for remote research to be conducted. When looking to reach lower socioeconomic classes, voice call interviews conducted through CATI will provide the closest comparison to in-person research as they can reach illiterate populations. IVR may also be utilized, but often has low response rates and high costs.

Use a reputable sample provider: Unless you are reaching your own list of respondents, you will need to use a reputable sample provider to gather a representative sample. Firms including GeoPoll have pre-stratified databases of mobile respondents in many markets. We have also seen success using Random Digit Dialing methods in certain countries.

Adjust your survey design: Surveys designed for face-to-face administration will need to be adjusted for a remote methodology. SMS surveys must be designed with several factors in mind including character limits and overall questionnaire length, and mobile web questionnaires should also be on the short side to minimize drop-off rates. CATI surveys can be slightly longer, but researchers should still take length and survey structure into consideration.

Compensate respondents: As with in-person research, respondents should be compensated for their time. If messages are not zero-rated, researchers should also take into consideration the data costs associated with responding to a survey. GeoPoll has found that incentive amounts of $0.50 to $1.00 are sufficient in most markets, and can deposit incentives immediately upon survey completion through several methods including airtime and mobile money.

Work with a partner experienced in remote data collection: When administered with care, remote methodologies can collect data that is of equal quality to in-person research. However, to get the best results you should work with a research organization that has experience in best practices around study design, research modes, and sampling techniques for a remote study.

Conduct Remote Research with GeoPoll

GeoPoll’s team are experts in remote data collection methodologies and can help you transition in-person studies to remote, mobile-based methodologies quickly and effectively. To speak to a member of our team about your project, please contact us today.

The post How to Transition Face-to-Face to Remote Research Methodologies appeared first on GeoPoll.

Similarities between IVR and CATI Research Modes

IVR and CATI are modes most often used to collect survey data, and they both leverage voice calls to collect responses from survey respondents. Voice calls are preferable to other phone-based research modes such as text message in certain circumstances, such as when the target population has high illiteracy rates, as is often the case in rural areas. Respondents for either mode may be recruited through a research company such as GeoPoll, a pre-identified list of beneficiaries or customers, or by random digit dialing, in which phone numbers are randomly generated in order to gather respondents from a wide area.

IVR and CATI surveys both start with a phone call to the respondent’s phone number that they must answer in order to take part in a survey, and this is followed by a series of questions that the respondent must answer. However, the two modes start to diverge once the respondent picks up the phone and starts answering questions.

Differences between IVR and CATI Research Modes

The biggest difference between Interactive Voice Response and Computer-Assisted Telephone Interviewing is that IVR methods rely on a pre-recorded voice recording to ask questions to respondents, while CATI requires trained interviewers to make live calls to respondents. In IVR, respondents must key in or speak answers to an automated system, similar to the ones commonly used when calling customer service hotlines. After each question, a new pre-recorded segment is relayed to the respondent until the survey is completed.

In the CATI research mode, interviewers make calls themselves, and they are the ones noting down the respondents’ answers and reading the next question from a script. CATI interviewers use specialized software to dial phone numbers, record the answers they are given, and read the next question based on any skip logic that is included. Because they are administering surveys themselves, CATI interviewers must be trained, and they often operate out of a physical call center that has to be maintained, neither of which is needed for IVR calls.

Due to the ways in which surveys are administered in IVR and CATI modes, there are also large differences in the number of respondents each can reach in a set period of time. Automated IVR software makes it a good mode for calling very large sample sizes, while CATI requires live interviewers, and cannot accomplish the same number of calls in the same time period without a huge number of interviewers. Because of the costs required to train and host CATI interviewers, it is often assumed that CATI is much more expensive than IVR. This can be the case, however, it is important to note that IVR often has very low response rates, and the cost of airtime to make enough calls to get the desired number of completed surveys can add up quickly. Below are some pros and cons of IVR and CATI to consider:

Pros of Interactive Voice Response (IVR)

• Can reach large sample sizes quickly
• Can be more cost-effective than other voice-call modes
• Can reach illiterate populations
• No need to train interviewers

Cons of Interactive Voice Response (IVR)

• Low response rates may lead to longer timelines and higher costs
• The respondent must pick-up when the call is administered
• Restrictions on what types of questions can be asked due to recorded nature
• Long surveys are difficult to administer due to high drop-off rates

Pros of Computer Assisted Telephone Interviewing

• Can reach illiterate populations
• Longer surveys can be administered due to higher engagement levels with an interviewer
• Can ask open-ended questions to gather qualitative data when needed
• Interviewers can offer to call respondents back at more convenient times
• Can use multiple interviewers (for example, male and female, or with different dialects) in order to reach all demographic groups

Cons of Computer Assisted Telephone Interviewing 

• Requires interviewer recruiting and training by yourself or through a research agency
• Costs can be high due to the need for interviewers and call center space
• The volume of calls made in a time period depends on the number of interviewers hired

Conduct Voice Call Surveys with GeoPoll

GeoPoll conducts voice calls surveys through CATI, using our own CATI software, trained interviewers, and call centers, and can also conduct surveys via IVR. Leverage our database of respondents throughout the world and expertise in conducting voice call surveys by contacting us for your next research project.

The post Interactive Voice Response vs Computer Assisted Telephone Interviewing for Survey Research appeared first on GeoPoll.

This CATI center was opened in July, following a GeoPoll-led training with local call center staff. GeoPoll trained local staff on how to use the GeoPoll data collection app, which allows for online and offline data collection for CATI and CAPI. In addition, staff were trained on best practices for CATI/CAPI research, ethics, and project implementation in order to ensure all GeoPoll CATI projects are of the highest quality. GeoPoll staff also trained a team who will oversee the call center and CATI/CAPI data collection in West Africa, including monitoring data and ongoing call center operations.

Nigeria CATI Call Center Capabilities

Localization is one of the most important aspects of CATI/CAPI work in Africa, and GeoPoll now has a roster of 50 interviewers who can be used for different projects based on client needs, including a mix of male and female interviewers, those who speak different dialects, and who have work experience in multiple locations. Staff are from 17 of the 36 states across Nigeria and speak a combination of 9 different languages: English, Hausa, Yoruba, Igbo, Edo, Urobo, Igala, Tarok, and Ijaw.

As part of this launch, GeoPoll also met with local partners and clients so that our operations team could learn more about client needs for CATI work. We began pilot work for three CATI projects currently ongoing in the region and provided in-person oversight on data collection for a week. So far, we have collected data for multiple projects from the Nigeria CATI center, and completed over 8,000 interviews.

Conduct Your Own CATI Survey in Africa

GeoPoll regularly conducts surveys via multiple modes, and we are excited to grow our CATI and CAPI capabilities in West Africa and beyond so that we can better service our clients and partners in the region. To learn more about our capabilities or commission a CATI or CAPI-based survey of your own, please contact us.

The post GeoPoll Launches Center for CATI Surveys in Nigeria appeared first on GeoPoll.

Jeremy Bowles (PhD student in Government at Harvard University) and Horacio Larreguy (Associate Professor of Government at Harvard University) are conducting a study in partnership with GeoPoll using CATI to understand how perceptions of candidates to the Liberian House of Representatives are affected by a series of debates held ahead of the October 10 general election. What is CATI and what are the best practices in CATI project implementation?

The study is conducted in partnership with United States Agency for International Development (USAID), the USAID-funded Internews Liberia Media Development (LMD) project, and NORC at the University of Chicago, an objective non-partisan research institution. Through a baseline and end-line survey across all 73 electoral districts in Liberia, GeoPoll is administering a survey through computer-assisted telephone interviewing (CATI) that tracks perceptions of district-level candidates before and after the 2017 general election.

What is CATI?
CATI is a method of mobile data collection through which live enumerators call a respondent on their mobile phone and administer the survey live with the respondent. The study leaders and GeoPoll determined CATI as the preferred mobile data collection method due to logistical and financial conditions that did not allow for an in-person survey, concerns that an SMS survey would limit the length of the survey, and the politically-sensitive nature of the questions. 

How do we decide on CATI?
During the design stage of any project, GeoPoll works with its project partners to assess which mode is most appropriate for the project’s end goal. CATI is frequently advantageous in situations where the target beneficiary group may be illiterate, or when the survey covers a complex or sensitive topic.

CATI Best Practices
Launching the CATI center in Liberia for this project highlights several best practices in CATI project implementation, especially on projects aimed at reaching hard-to-reach populations: 

1. Understand the mode most appropriate for the target beneficiary population at the design stage. In instances where the survey covers complex or sensitive topics, a live call survey method may encourage a higher response rate than another method of mobile survey data collection.
2. For a location-based study, understand how to reach respondents at their verified specific location. This project aims to reach respondents at a very specific location – their electoral district – which was not pre-identifiable in the GeoPoll database. Through a survey design that includes routing CATI enumerators to a list of possible electoral districts per county, GeoPoll was able to locate users at this specific sub-location to assure that the candidate they were referencing was that respondent’s district candidate.
3. In survey design, understand how the target population will interpret political questions. For instance, what type of voting information will respondents have on hand? Will respondents know their voting center or candidate names? This information is necessary to ensure respondents’ ability to answer questions accurately.

Project Implementation
To implement the Liberia Candidate Debates survey, GeoPoll set up a CATI calling center specifically for the project.  Steps GeoPoll took to set up the CATI center included: 

1. GeoPoll hired approximately 25 Liberian enumerators and call managers. Local enumerators are important in CATI so that calls are done in the local language and dialect;
2. GeoPoll CATI implementation specialists traveled to Monrovia to train the local enumerators and set up data collection and quality control systems;
3. Utilizing the GeoPoll database, which has more than 1 million mobile phone users in Liberia, enumerators called up to 300 phone numbers per day, which were pre-stratified by county in Liberia. The respondent’s particular electoral district within that county was then confirmed through questions in the survey;
4. The baseline survey assessed respondents’ levels of political information, knowledge of particular political topics, preferences over policy issues in the local district, and voting intentions. Respondents were asked if they had listened to the district-level candidate debates, what the most important issue was in their district, and which Representative running in their district they planned to vote for. As with all GeoPoll surveys, all answers to the survey are confidential. These perceptions will be compared to the results of a post-survey after the election.

GeoPoll completed the baseline survey of nearly 5,000 respondents prior to the election; the end-line survey is currently under way. Watch for future installments of this blog post series to see the later stages of the project.

The post Tracking Perceptions of District-Level Candidates in Liberia through Computer-Assisted Telephone Interviewing (CATI) appeared first on GeoPoll.