What is Validity?
by Evelina Galaczi
July 17th, 2020

The fundamental concept to keep in mind when creating any assessment is validity. Validity refers to whether a test measures what it aims to measure. For example, a valid driving test should include a practical driving component and not just a theoretical test of the rules of driving. A valid language test for university entry, for example, should include tasks that are representative of at least some aspects of what actually happens in university settings, such as listening to lectures, giving presentations, engaging in tutorials, writing essays, and reading texts.

Validity has different elements, which we are now going to look at in turn.

Test Purpose – Why am I testing?

We can never really say that a test is valid or not valid. Instead, we can say that a test is valid for a particular purpose. There are several reasons why you might want to test your students. You could be trying to check their learning at the end of a unit, or trying to understand what they know and don't know. Or, you might want to use a test to place learners into groups based on their ability, or to provide test takers with a certificate of language proficiency. Each of these different reasons for testing represents a different test purpose.

The purpose of the test determines the type of test you're going to produce, which in turn affects the kinds of tasks you're going to choose, the number of test items, the length of the test, and so on. For example, a test certifying that doctors can practise in an English-speaking country would be different from a placement test which aims to place those doctors into language courses.

Test Takers – Who am I testing?

It’s also vital to keep in mind who is taking your test. Is it primary school children or teenagers or adults? Or is it airline pilots or doctors or engineers? This is an important question because the test has to be appropriate for the test takers it is aimed for. If your test takers are primary school children, for instance, you might want to give them more interactive tasks or games to test their language ability. If you are testing listening skills, for example, you might want to use role plays for doctors, but lectures or monologues with university students.

Test Construct – What am I testing?

Another key point is to consider what you want to test. Before designing a test, you need to identify the ability or skill that the test is designed to measure – in technical terms, the ‘test construct’. Some examples of constructs are: intelligence, personality, anxiety, English language ability, pronunciation. To take language assessment as an example, the test construct could be communicative language ability, or speaking ability, or perhaps even a construct as specific as pronunciation. The challenge is to define the construct and find ways to elicit it and measure it; for example, if we are testing the construct of fluency, we might consider features such as rate of speech, number of pauses/ hesitations and the extent to which any pauses/hesitations cause strain for a listener.

Test Tasks – How am I testing?

Once you’ve defined what you want to test, you need to decide how you’re going to test it. The focus here is on selecting the right test tasks for the ability (i.e. construct) you're interested in testing. All task types have advantages and limitations and so it’s important to use a range of tasks in order to minimize their individual limitations and optimize the measurement of the ability you’re interested in. The tasks in a test are like a menu of options that are available to choose from, and you must be sure to choose the right task or the right range of tasks for the ability you're trying to measure. 

Test Reliability - How am I scoring?

Next it’s important to consider how to score your test. A test needs to be reliable and to produce accurate scores. So, you’ll need to make sure that the scores from a test reflect a learner's actual ability. In deciding how to score a test, you’ll need to consider whether the answers are going to be scored as correct or incorrect (this might be the case for multiple–choice tasks, for example) or whether you might use a range of marks and give partial credit, as for example, in reading or listening comprehension questions. In speaking and writing, you’ll also have to decide what criteria to use (for example, grammar, vocabulary, pronunciation, essay, organisation in writing, and so on). You’ll also need to make sure that the teachers involved in speaking or writing assessment have received some training, so that they are marking to (more or less) the same standard.

Test Impact - How will my test help learners?

The final – and in many ways most important – question to ask yourself is how the test is benefitting learners. Good tests engage learners in situations similar to ones that they might face outside the classroom (i.e. authentic tasks), or which provide useful feedback or help their language development by focusing on all four skills (reading, listening, writing, speaking). For example, if a test has a speaking component, this will encourage speaking practice in the classroom. And if that speaking test includes both language production (e.g. describe a picture) and interaction (e.g. discuss a topic with another student), then preparing for the test encourages the use of a wide range of speaking activities in the classroom and enhances learning.

Adapted from: https://www.cambridgeenglish.org/blog/what-is-validity. Acesso em: 15 dez. 2023.

What is customer experience management?

(Available at: www.dynamics.microsoft.com/en-us/marketing/what-is-customer-experience-management-cxm/ – text specially adapted for this test).

Text 18A3-I 

    The roar of a waterfall suggests the power of water. Rampaging floodwaters can uproot strong trees and twist railroad tracks. When the power of water is harnessed, however, it can do useful work for humans. 

    Since ancient times, people have put the energy in the flow of water to work. They first made water work for them with the waterwheel, a wheel with paddles around its rim. Flowing water rotated the waterwheel, which in turn ran machinery that was linked to it. Today, new kinds of waterwheels — turbines — spin generators that produce electricity. Electricity from water-turned generators is known as hydroelectricity. 

    By building a dam across a river, the natural upstream water level is elevated and a difference in head is created that can be used to drive turbines and generate electricity. A large upstream reservoir may balance seasonal water flow; rain or melted snow can be stored in the reservoir during the wet season to provide electricity during dry seasons. 

    Waterpower is distributed unevenly among the continents and nations of the world. Europe and North America have developed much of their waterpower. Asia, South America, and Africa have abundant waterpower potential, but while countries such as China and Brazil have become leading hydroelectric producers, much of the waterpower resource on those continents remains undeveloped. 

Elizabeth Lachner. Hydroelectricity. Rosen Publishing Group, 2018 (adapted). 

 United Nations Environmental Programme. Dams and Development: Relevant Practices for Improved

Decision-making. Nairobi: The Secretariat of the Dams and Development Project, 2007. p. 10-1 (adapted).

Text 3

Benefits of a Bilingual Brain

¹ Language ability is typically measured in two active parts, speaking and writing, and two passive parts, listening and reading. While a balanced bilingual has near equal abilities in two languages, most bilinguals around the world know and use their languages in varying proportions. But recent advances in brain imaging technology have given neurolinguists a glimpse into how specific aspects of language learning affect the bilingual brain. 

² It's well known that the brain's left hemisphere is more dominant and analytical in logical processes, while the right hemisphere is more active in emotional and social ones, though this is a matter of degree, not an absolute split. The fact that language involves both types of functions has led to the critical period hypothesis. According to this theory, children learn languages more easily because the plasticity of their developing brains lets them use both hemispheres in language acquisition, while in most adults, language is lateralized to one hemisphere, usually the left. If this is true, learning a language in childhood may give you a more holistic grasp of its social and emotional contexts. 

³ Conversely, recent research showed that people who learned a second language in adulthood exhibit less emotional bias and a more rational approach when confronting problems in the second language than in their native one. But regardless of when you acquire additional languages, being multilingual gives your brain some remarkable advantages, such as higher density of the grey matter that contains most of your brain's neurons and synapses, and more activity in certain regions when engaging a second language. The strong workout a bilingual brain receives throughout its life can also help delay the onset of diseases, like Alzheimer's and dementia by as much as five years.

Source: Adapted from “Benefits of a bilingual brain” (Video), by Mia Nacamuli for TED-ed, 2015. Available on: https://www.youtube.com/watch?v=MMmOLN5zBLY with subtitles.

O texto seguinte servirá de base para responder à questão.

New generation of Indigenous activists battle to save the Amazon

Campaigners in Brazil use drones to document work of self-defence teams trying to stop environmental destruction caused by illegal mining

Batista, who belongs to South America's Macuxi people, is part of a new generation of Indigenous journalists helping chronicle an age-old battle against outside aggression. For centuries, non-Indigenous writers and reporters have flocked to the rainforest region to tell their version of that ancestral fight for survival. Now, a growing cohort of Indigenous communicators are telling their own stories, providing first-hand dispatches from some of the Amazon's most inaccessible and under-reported corners.

"It's dangerous work and we suffer a lot when we're out in the field," said Batista, one of about 26,000 inhabitants of Raposa Serra do Sol, Brazil's second most populous Indigenous territory. "But it really gives me strength because I'm showing the reality of our lives to the world."

"It's my job to monitor the territory: to see who's coming in and who is leaving, to find areas being invaded, and to defend the territory because we cannot live without it," said Batista, who was trained by a local Indigenous association, the Conselho Indígena de Roraima, as part of an initiative called Rede Wakywai, which means "our news" in the local Wapichana language.

The Guardian

                                                                             Read the charge below: 

Read the text and answer the question below:

HOTMART:

Hotmart is a complete platform for those who want to create and sell digital products such as e-books, online courses, videos, subscriptions, among others. It is widely used by content producers and affiliates. It is a company with a worldwide presence and promotes entrepreneurship and distance education. Hotmart allows anyone who wants to work with digital products. Best of all, many people are well paid working in this digital market