hallucination trap 8211

The hallucination trap – information convincing but factually incorrect

ByJustpaste.in

By Syeda Samar Zahra Zaidi

When you ask an AI chatbot a question it does not know the answer to, an odd thing can happen: instead of hesitating or saying, “I am not sure!” it confidently delivers a tidy, well-structured, completely fabricated response—often with fake citations, fictional figures, and an authoritative tone. This phenomenon is known as the ‘hallucination trap ’, and it may be the most significant barrier between trust and artificial intelligence.

I was introduced to the term “AI hallucination” for the first time in the workshop under the project titled “Digital Trust and Free Expression in the AI Era” at Department of Media and Development Communication, University of the Punjab, supported by the U.S. Mission to Pakistan in partnership with the Pakistan-U.S. Alumni Network (PUAN). I learned that a “hallucination” occurs when a language model produces information that sounds convincing but is factually incorrect or completely made up. Examples include inventing a legal case that never existed, citing a research paper that doesn’t exist or boldly misrepresenting a historical date. What is disturbing is not merely that AI can be wrong-humans make mistake too- but rather the way it presents that incorrect information with clearly, confidence and without a trace of doubt.

Large language models are essentially highly complex pattern predictors trained to produce the most likely next word in a sequence. As a result, when a model has encountered a topic thousands of times in its training data, the predictors are typically accurate. However, when it comes across a gap, an unidentified fact or a question at the outer edge of its knowledge, it doesn’t shift into a hesitant mode. Instead, it continues doing exactly what it was trained to do: generate a logical, fluent piece of writing, producing a response that is structurally sound and grammatically correct but based on nothing.

In human communication, confidence is generally perceived as a sign of strength which is important. We naturally prefer to trust a calm, reliable voice over a hesitant one. AI systems unintentionally exploit the tendency because their language remains confident whether they are right or wrong.

The risks increase with the use of AI, as students may unintentionally include false information into their work and journalists have published articles citing artificially created sources and quotes, negatively affecting the credibility of their publications. Such inaccuracies influence what millions of people see, believe or share, thereby amplifying fabricated content.

The reason AI does not simply say “I don’t know” is partly due to the way these systems are trained. Many models are designed to provide helpful, comprehensive-sounding answers and are rarely rewarded for expressing doubt during training. This means that a model that frequently acknowledges uncertainty may be judged as less helpful than one that consistently provides an answer, even when that confidence is occasionally misplaced. Such incorrectly aligned incentives arise when the training process gradually teaches the model that sounding confident is more valuable than being accuracy.

Retrieval-augmented generation, which relies on responses in actual, verifiable records rather than internal memory alone, improved training techniques that explicitly account for uncertainty; and systems built to simply cite sources. So, users can independently verify claims are just a few of the ways developers are using to addresses this problem.

While none of these solutions fully eliminate hallucination yet, taken together they represent a major shift from blind confidence toward earned trust. The most dangerous outcome is not an AI that makes mistakes but a culture of users who stop questioning because the system always sounds so sure of itself.

 

Therefore, until AI becomes more reliably aware of it own limitation, part of the responsibility falls on the people who use it: treating AI-generated output as a starting point rather than an endpoint, cross checking important facts against credible sources. In the end, the hallucination trap serves as a reminder that illusion is not the same as truth. As AI becomes increasingly common in education, digital media and everyday life, understanding why it occasionally lies with confidence is not only a technical curiosity but also a fundamental aspect of digital literacy. We must strengthen our ability to verify the information provided by AI as they become more persuasive.

The views, thoughts, and opinions expressed in this blog are solely those of the author and do not necessarily reflect the official policy or position of the U.S. Mission to Pakistan or USEFP.

The writer, Syeda Samar Zahra Zaidi, is a student of Media and Development Communication at  University of the Punjab, Lahore and can be reached at samarzahra456@gmail.com.

 

Similar Posts

  • The law’s own labor problem

    ByJustpaste.in

    EVERY year, hundreds of fresh law graduates walk into Pakistan’s leading chambers and firms for what is euphemistically called an “internship” or “pupillage.” Most will not be paid a rupee for months, sometimes years, of full-time work drafting pleadings, researching case law and sitting in on client meetings. Some will eventually be “made permanent” on a modest salary; many others will simply be replaced by the next batch of eager graduates willing to work for free. This arrangement is so normalized within the legal fraternity that it is rarely discussed as a labor rights issue at all. It is treated, instead, as an inevitable rite of passage the price of admission into a prestigious profession. Yet a closer look suggests that Pakistan’s legal industry may be one of the starkest examples of unregulated, exploitative internship practice in the country, and one uniquely ill-placed to defend it, given that the profession exists to interpret and enforce the very laws it is quietly sidestepping. The scale of the problem has been documented, if informally. Lawyers who have surveyed the profession describe junior associates at reputed firms completing unpaid stints stretching from three months to two years, often working full days while technically still “training.” The practice persists despite Pakistan’s Apprenticeship Ordinance, 1962, which was designed precisely to regulate structured on-the-job training and guarantee apprentices certain minimum protections. Law firms and chambers, however, rarely register their interns as apprentices under this law, leaving them in a legal no-man’s-land: neither students, nor employees, nor apprentices in the statutory sense. This gap is compounded by the profession’s own regulator. The Pakistan Bar Council and provincial bar councils set the rules for enrolment, requiring aspiring advocates to complete a period of pupillage under a senior lawyer before they can be licensed. But neither the Legal Practitioners and Bar Councils Act, 1973, nor the rules made under it, mandate that this pupillage be paid. In effect, the very body responsible for admitting new lawyers to practice has built an unpaid apprenticeship requirement into the licensing process itself a far cry from professions such as medicine, where house officers, despite their own well-documented grievances, at least draw a government stipend during mandatory training. The consequences fall unevenly. A law graduate from a well-off Lahore or Karachi household, who can rely on family support for rent and daily expenses, can afford to spend two years being trained for free at a top-tier firm. A graduate from Multan or Turbat, or from a household with no such cushion, effectively cannot. Since access to the most prestigious firms is widely understood to run through personal connections and informal referrals rather than open, merit-based recruitment, the unpaid pupillage system quietly filters out precisely those graduates for whom a legal career could be most transformative. What is marketed as a meritocratic apprenticeship is, in practice, a wealth test dressed up as professional training. Female interns face a related but distinct set of risks. The relative informality of chamber culture, combined with the absence of any real institutional oversight of unpaid interns’ working conditions, leaves young women particularly exposed to harassment with limited recourse. The Protection against Harassment of Women at the Workplace Act, 2010, and its 2022 amendment, extended coverage to a wider range of workplace relationships, but enforcement inside small chambers as opposed to large corporate firms with formal HR departments remains largely theoretical. An unpaid intern hoping for a reference or a permanent position has every incentive to stay silent. None of this is to say every senior lawyer who takes on unpaid interns is acting in bad faith; many genuinely believe, as the profession has long insisted, that pupillage is an investment in the intern’s own future. But belief is not evidence, and there is little data testing whether unpaid pupillage produces better lawyers than a modestly paid one would, or whether firms would truly stop training juniors if a stipend were required. Given how heavily law firms already rely on interns for substantive work, it seems more likely that a minimum stipend requirement would simply formalize the value interns already provide. The fix does not require reinventing the wheel. The Pakistan Bar Council could amend its enrolment rules to require a minimum stipend during pupillage, as some foreign bar associations already do. Firms above a certain size could be required to register interns under the Apprenticeship Ordinance, bringing them within existing protections. And bar councils could extend meaningful, monitored harassment complaint mechanisms to chambers of every size, not just the handful of firms large enough to run their own HR departments. A profession built on the promise of equal treatment before the law owes its own newest entrants rather more consistency between what it argues in court and how it treats them at their desks.

  • Why does food make your mouth water

    ByJustpaste.in

    Have you ever seen your favorite food smelled it or simply thought about it and suddenly felt your mouth watering? This can happen even when you are not very hungry. Just seeing or smelling food can make your body prepare for eating. Experts call this the “cephalic phase of digestion.” In simple words it means your body can start preparing for digestion before food even reaches your mouth. Your brain prepares your body When you see, smell or think about a favorite food your brain gets a signal that food may be coming.  It then sends signals to different parts of the digestive system. One of the first things that happens is that your mouth produces more saliva.  Saliva makes food softer and easier to chew and swallow. It also helps start the digestion process. That is why seeing hot pizza, biryani, jalebi or another favorite dish can make your mouth water.  Your body is already getting ready to eat. It is not always about hunger Mouth watering does not always mean you are very hungry.  You may even feel full and still have a strong reaction to your favorite food. Food cravings can be affected by its smell appearance memories and past experiences. For example, the smell of a homemade dish from childhood may bring back old memories and make you want to eat it again. Smells can trigger strong reactions Sometimes you do not even need to see food. A delicious smell from the kitchen can make you feel hungry within seconds. But the opposite can also happen. A bad smell unpleasant sight or negative memory can make you feel sick or lose your appetite. For example if you once became sick after eating a certain food, your brain may connect that food with the bad experience. Later even its smell may make you feel nauseous. •Your body has a protective system These reactions are part of the close connection between the brain and the digestive system.  Your brain does not only help you notice food you like it can also help protect you from food that may be harmful. A bad smell or unpleasant appearance can make you avoid certain food. In some cases it may even cause nausea or reduce your appetite. So the next time your mouth waters when you see your favorite dish remember that your body may already be preparing for the meal before you take your first bite.

  • |

    Lady Catherine Dyer’s metaphysical elegy

    ByJustpaste.in

    “My dearest dust“, in three monosyllables, Dyer fuses affectionate devotion with biblical mortality. Few opening lines in English poetry carry the sudden jolt of Lady Catherine Dyer’s seventeenth-century elegy to her late husband, Sir William Dyer. The phrase creates a brilliant phonic equation. Two words linked by alliterative d sounds and ending in the crisp st consonant cluster. This sequence immediately brings closer the earthly tenderness and the cold realities of the grave. Written after Sir William’s premature death in 1621 at the age of 37, the 14-line poem presents a wife addressing her departed spouse. This poem is not from a distance of detached, formal mourning, but from the shared boundary of their marital bedchamber. It is an extraordinary work of grief. A sequence of part lullaby, part nocturnal dialogue, and part radical act of faith. Dyer crafts her elegy primarily in rhymed heroic couplets, a poetic form where paired lines lie side-by-side like lovers in rest. Yet, the emotional core of the poem resides within its deliberate deviations from standard iambic pentameter. When Catherine laments her husband’s sudden departure, the meter breaks under the weight of her longing: Thy weary limbs with early rest, She exempts the line 6 of its expected fifth metrical foot, reducing it to iambic tetrameter. Dyer mirrors the truncated nature of Sir William’s life. His death was early and so the line itself ends prematurely. Similarly, when describing her daily routines of widowhood in line 10, preparing her nightly dress and calling to prayer. There, the missing foot echoes the quiet vacancy of her solitary routine. Something essential is absent, and the meter forces the reader to feel that empty space. Even the poem’s gentle play with rhythm in lines 3 and 4 captures this hesitation. Asking whether they might have, Sate up, or gone to bedd together? The unaccented final syllable creates a lingering, breathless pause. It presents a moment where the speaker hesitates before facing the silence of her answer. The Audacity of Desire What makes Dyer’s poem so captivating is its unapologetic amalgamation of grief and intimacy. As the poem draws toward its conclusion, the speaker describes her eyelids growing heavy while her beloved’s body grows cold. She commands: Draw, draw ye closed curtaynes: and make room: My dear, my dearest dust; I come, I come. To a contemporary reader, the closing insistence: “I come, I come” is a poignant declaration of joining her husband in ultimate death. However, the phrasing carries a remarkably provocative double layer. In Renaissance and 17th-century vernacular, “to die” was a well-known euphemism for sexual climax. The verb “to come” already held slang connotations surrounding physical intimacy. For Lady Catherine, her very surname, Dyer, homophonically echoes dier. These final words create a daring convergence of spiritual reunion and erotic memory. To lay down in the grave beside her husband is both an act of holy surrender and a transcendent return to marital passion. It is a moment of fearless emotional honesty carved directly into a sacred space. The Monument at Colmworth This extraordinary text was not merely kept in a private manuscript. In 1641, two decades after her husband’s death, Lady Catherine erected an elaborate monument in the Church of St. Denys in Colmworth, Bedfordshire. Above stone effigies of the couple propped on their elbows as if engaged in eternal late-night conversation, the full poem was proudly embossed. Lady Catherine outlived Sir William by 33 years, never remarrying. For over three decades, she lived with the memory of the husband who died young after fathering seven children. Catherine would have gazed upon her own stone likeness, reading her own words of twenty years prior while waiting for the remaining thirteen years of her earthly separation to expire.  The Dissolution of Words and the Promise of Reunion In the centuries since its installation, time and moisture have slowly eroded the Colmworth monument. Today, many of the terminal words in the carved verses have worn away, softening the crispness of the original rhymes. Yet, there is a poetic justice in this physical decay. Rather than diminishing the work, the fading text represents a literal blurring of boundaries. It expresses a “de-coupleting” of stone that mirrors the breakdown of mortal limits. As the physical letters dissolve into the ambient damp of the church, Catherine and William’s separation quietly closes, fulfilling the poem’s final command to make room for eternal rest.  

  • Stay safe this monsoon

    ByJustpaste.in

    The monsoon season brings cool weather fresh air and beautiful rainfall making it a favorite time of the year for many people. However it also comes with several risks. In Pakistan especially in cities like Karachi heavy rain can cause water to collect on roads making travel dangerous and increasing the risk of accidents. Experts say that following a few simple safety tips can help prevent serious incidents during the rainy season. One of the biggest dangers during rain is electricity. Never touch fallen power lines or electrical equipment with bare hands.  Parents should also teach children to stay away from broken or exposed electric wires. It is also a good idea to unplug electrical appliances that are not in use during heavy rain. Drivers should avoid parking vehicles under power poles or overhead electric wires as strong winds and heavy rain can damage them and create dangerous situations. People walking outdoors should be careful as well. Whenever possible use dry sidewalks and avoid walking through standing water. Flooded roads may hide open drains or fallen electric wires making them extremely dangerous. If you need to go outside while it is raining, carry an umbrella or wear a raincoat to stay dry and reduce the risk of catching seasonal illnesses. Health experts also recommend keeping a basic first aid kit at home so that minor injuries or emergencies can be treated quickly until medical help is available. Rainwater that remains stagnant for several days can become a breeding ground for mosquitoes increasing the risk of diseases such as dengue malaria and skin infections. To stay safe make sure rainwater does not collect around your home or in  nearby streets. Experts say that taking these simple precautions can help protect lives and allow people to enjoy the beauty of the monsoon season more safely.

  • High sugar intake in early life may raise dementia risk

    ByJustpaste.in

    A new study has found that children who consume high amounts of sugar at an early age may face a higher risk of developing dementia later in life. The study suggests that pregnant women who avoid sweets, chocolates and other sugary foods may help reduce their child’s risk of developing the disease by up to 20 percent. The research published in the medical journal Neurology also found that consuming very small amounts of sugar during early life may provide protection against dementia. The study’s lead author, Professor Jiazheng Zheng said the findings suggest that limiting sugar intake during the early stages of life could have long-term benefits for brain health. He further said the findings highlight the potential importance of early-life nutrition in reducing the risk of dementia decades later. Researchers from the Hong Kong University of Science and Technology compared the health of 64,737 people who were born before and after sugar rationing was introduced in Britain during World War II. The participants were divided into groups based on the timing of sugar rationing: those who experienced limited access to sugar before birth and during their first year of life, those who experienced it before birth and until the age of two and those who were not exposed to sugar rationing. When the participants reached an average age of 55, the research team began analyzing their medical records to determine which individuals were diagnosed with dementia during the following 15 years. Among the 15,256 people who had limited access to sugar before birth and during their first two years of life, only 2 percent were later diagnosed with dementia. Although researchers say the findings do not conclusively prove that eating less sugar directly prevents dementia, experts believe the results are consistent with growing evidence that sugar can affect brain function. Experts also say that the brain is highly sensitive to fluctuations in blood sugar levels. Other research has found that people with high blood sugar levels may face up to a 69 percent higher risk of Alzheimer’s disease.

  • Why popcorn explodes when heated

    ByJustpaste.in

    Popcorn is a favorite snack for people of all ages, especially during movie nights. But have you ever wondered why only certain corn kernels pop while regular corn does not? Food experts say the answer lies in the kernel’s unique structure moisture and the way it reacts to heat. Not all corn can turn into popcorn. A special type of corn called Zea mays everta is used because its kernels have a hard outer shell and a soft starchy center with a small amount of water inside. Although popcorn kernels look dry they contain about 13–15% moisture. When heated, the water inside turns into steam. Since the outer shell is very strong the steam cannot escape causing pressure to build inside the kernel. As the pressure keeps increasing the kernel acts like a tiny pressure cooker. Eventually the shell bursts with a popping sound.  The hot steam quickly escapes and the soft starch inside expands. Within seconds it cools and forms the fluffy crispy popcorn we enjoy.  A popped kernel can become 30 to 40 times larger than its original size. Sometimes a few kernels do not pop. Experts say this usually happens because they do not contain enough moisture to create the pressure needed to burst. Tiny cracks in the outer shell can also let steam escape too early preventing the kernel from popping.  Heating the kernels at a temperature that is too low may also cause them to dry out before enough pressure builds up. Popcorn can be made in several ways including on the stove in an air popper or in a microwave. Microwave popcorn bags and the oil inside them help spread heat evenly while oil on the stove helps heat the kernels more consistently. Air poppers on the other hand use only hot air and do not require oil. According to food scientists the secret behind perfect popcorn is the combination of a strong outer shell the right amount of moisture steam pressure and the natural expansion of starch when heated.

Leave a Reply

Your email address will not be published. Required fields are marked *