hallucination trap 8211

The hallucination trap – information convincing but factually incorrect

By Syeda Samar Zahra Zaidi

When you ask an AI chatbot a question it does not know the answer to, an odd thing can happen: instead of hesitating or saying, “I am not sure!” it confidently delivers a tidy, well-structured, completely fabricated response—often with fake citations, fictional figures, and an authoritative tone. This phenomenon is known as the ‘hallucination trap ’, and it may be the most significant barrier between trust and artificial intelligence.

I was introduced to the term “AI hallucination” for the first time in the workshop under the project titled “Digital Trust and Free Expression in the AI Era” at Department of Media and Development Communication, University of the Punjab, supported by the U.S. Mission to Pakistan in partnership with the Pakistan-U.S. Alumni Network (PUAN). I learned that a “hallucination” occurs when a language model produces information that sounds convincing but is factually incorrect or completely made up. Examples include inventing a legal case that never existed, citing a research paper that doesn’t exist or boldly misrepresenting a historical date. What is disturbing is not merely that AI can be wrong-humans make mistake too- but rather the way it presents that incorrect information with clearly, confidence and without a trace of doubt.

Large language models are essentially highly complex pattern predictors trained to produce the most likely next word in a sequence. As a result, when a model has encountered a topic thousands of times in its training data, the predictors are typically accurate. However, when it comes across a gap, an unidentified fact or a question at the outer edge of its knowledge, it doesn’t shift into a hesitant mode. Instead, it continues doing exactly what it was trained to do: generate a logical, fluent piece of writing, producing a response that is structurally sound and grammatically correct but based on nothing.

In human communication, confidence is generally perceived as a sign of strength which is important. We naturally prefer to trust a calm, reliable voice over a hesitant one. AI systems unintentionally exploit the tendency because their language remains confident whether they are right or wrong.

The risks increase with the use of AI, as students may unintentionally include false information into their work and journalists have published articles citing artificially created sources and quotes, negatively affecting the credibility of their publications. Such inaccuracies influence what millions of people see, believe or share, thereby amplifying fabricated content.

The reason AI does not simply say “I don’t know” is partly due to the way these systems are trained. Many models are designed to provide helpful, comprehensive-sounding answers and are rarely rewarded for expressing doubt during training. This means that a model that frequently acknowledges uncertainty may be judged as less helpful than one that consistently provides an answer, even when that confidence is occasionally misplaced. Such incorrectly aligned incentives arise when the training process gradually teaches the model that sounding confident is more valuable than being accuracy.

Retrieval-augmented generation, which relies on responses in actual, verifiable records rather than internal memory alone, improved training techniques that explicitly account for uncertainty; and systems built to simply cite sources. So, users can independently verify claims are just a few of the ways developers are using to addresses this problem.

While none of these solutions fully eliminate hallucination yet, taken together they represent a major shift from blind confidence toward earned trust. The most dangerous outcome is not an AI that makes mistakes but a culture of users who stop questioning because the system always sounds so sure of itself.

 

Therefore, until AI becomes more reliably aware of it own limitation, part of the responsibility falls on the people who use it: treating AI-generated output as a starting point rather than an endpoint, cross checking important facts against credible sources. In the end, the hallucination trap serves as a reminder that illusion is not the same as truth. As AI becomes increasingly common in education, digital media and everyday life, understanding why it occasionally lies with confidence is not only a technical curiosity but also a fundamental aspect of digital literacy. We must strengthen our ability to verify the information provided by AI as they become more persuasive.

The views, thoughts, and opinions expressed in this blog are solely those of the author and do not necessarily reflect the official policy or position of the U.S. Mission to Pakistan or USEFP.

The writer, Syeda Samar Zahra Zaidi, is a student of Media and Development Communication at  University of the Punjab, Lahore and can be reached at samarzahra456@gmail.com.

 

Similar Posts

  • The law’s own labor problem

    EVERY year, hundreds of fresh law graduates walk into Pakistan’s leading chambers and firms for what is euphemistically called an “internship” or “pupillage.” Most will not be paid a rupee for months, sometimes years, of full-time work drafting pleadings, researching case law and sitting in on client meetings. Some will eventually be “made permanent” on a modest salary; many others will simply be replaced by the next batch of eager graduates willing to work for free. This arrangement is so normalized within the legal fraternity that it is rarely discussed as a labor rights issue at all. It is treated, instead, as an inevitable rite of passage the price of admission into a prestigious profession. Yet a closer look suggests that Pakistan’s legal industry may be one of the starkest examples of unregulated, exploitative internship practice in the country, and one uniquely ill-placed to defend it, given that the profession exists to interpret and enforce the very laws it is quietly sidestepping. The scale of the problem has been documented, if informally. Lawyers who have surveyed the profession describe junior associates at reputed firms completing unpaid stints stretching from three months to two years, often working full days while technically still “training.” The practice persists despite Pakistan’s Apprenticeship Ordinance, 1962, which was designed precisely to regulate structured on-the-job training and guarantee apprentices certain minimum protections. Law firms and chambers, however, rarely register their interns as apprentices under this law, leaving them in a legal no-man’s-land: neither students, nor employees, nor apprentices in the statutory sense. This gap is compounded by the profession’s own regulator. The Pakistan Bar Council and provincial bar councils set the rules for enrolment, requiring aspiring advocates to complete a period of pupillage under a senior lawyer before they can be licensed. But neither the Legal Practitioners and Bar Councils Act, 1973, nor the rules made under it, mandate that this pupillage be paid. In effect, the very body responsible for admitting new lawyers to practice has built an unpaid apprenticeship requirement into the licensing process itself a far cry from professions such as medicine, where house officers, despite their own well-documented grievances, at least draw a government stipend during mandatory training. The consequences fall unevenly. A law graduate from a well-off Lahore or Karachi household, who can rely on family support for rent and daily expenses, can afford to spend two years being trained for free at a top-tier firm. A graduate from Multan or Turbat, or from a household with no such cushion, effectively cannot. Since access to the most prestigious firms is widely understood to run through personal connections and informal referrals rather than open, merit-based recruitment, the unpaid pupillage system quietly filters out precisely those graduates for whom a legal career could be most transformative. What is marketed as a meritocratic apprenticeship is, in practice, a wealth test dressed up as professional training. Female interns face a related but distinct set of risks. The relative informality of chamber culture, combined with the absence of any real institutional oversight of unpaid interns’ working conditions, leaves young women particularly exposed to harassment with limited recourse. The Protection against Harassment of Women at the Workplace Act, 2010, and its 2022 amendment, extended coverage to a wider range of workplace relationships, but enforcement inside small chambers as opposed to large corporate firms with formal HR departments remains largely theoretical. An unpaid intern hoping for a reference or a permanent position has every incentive to stay silent. None of this is to say every senior lawyer who takes on unpaid interns is acting in bad faith; many genuinely believe, as the profession has long insisted, that pupillage is an investment in the intern’s own future. But belief is not evidence, and there is little data testing whether unpaid pupillage produces better lawyers than a modestly paid one would, or whether firms would truly stop training juniors if a stipend were required. Given how heavily law firms already rely on interns for substantive work, it seems more likely that a minimum stipend requirement would simply formalize the value interns already provide. The fix does not require reinventing the wheel. The Pakistan Bar Council could amend its enrolment rules to require a minimum stipend during pupillage, as some foreign bar associations already do. Firms above a certain size could be required to register interns under the Apprenticeship Ordinance, bringing them within existing protections. And bar councils could extend meaningful, monitored harassment complaint mechanisms to chambers of every size, not just the handful of firms large enough to run their own HR departments. A profession built on the promise of equal treatment before the law owes its own newest entrants rather more consistency between what it argues in court and how it treats them at their desks.

  • |

    China’s Chongqing East becomes world’s largest railway station

    Almost everyone has travelled by train at some point and has seen railway stations. But do you know which country is home to the world’s largest railway station? If you do not, here is the answer: the world’s largest railway station is located in China and is nothing short of an architectural marvel. China is already known for numerous engineering wonders ranging from remarkable bridges to the world’s largest high-speed railway network. Chongqing East Railway Station Chongqing East Railway Station located in southwestern China is the world’s largest railway station in terms of area. It was opened to the public in June 2025. The railway station covers an area of approximately 13 million square feet equivalent to around 170 football fields. It is also about five times larger than New York’s Grand Central Terminal. The station has 15 platforms and 29 railway tracks and during peak hours, it can accommodate around 16,000 passengers per hour. Around 16,500 tonnes of steel were used for its roof. However, the most remarkable feature of the station is the speed at which it was constructed and it was built on top of a mountain. The Chongqing region is mountainous which has traditionally made the development of transportation infrastructure particularly challenging. The station was constructed in just 38 months with the help of around 40,000 workers and a fleet of robotic machinery. Although 38 months may seem like a long period, in many countries, simply obtaining approval for projects of this scale can take longer than that.

  • Solo travel finding its footing in Pakistan

    The image of travel in Pakistan is changing. At bus terminals in Rawalpindi, at Islamabad International Airport, and on trails in Hunza, a growing number of travellers are moving with just one thing in common — they are alone. Solo travel, once seen as unusual, is now a quiet but visible trend among Pakistanis. Industry data and tour operators say bookings by single travellers have risen steadily over the last two years, driven by social media, remote work, and a desire for independence. For decades, Pakistani travel meant family trips to Murree, Nathiagali, or Swat, or group tours arranged through agencies. That model is shifting. Nevertheless, reasons are practical and personal. Let’s say, no need to coordinate leave or budgets with others, or time to navigate new places on one’s own terms. These days , hostels, cafés, and trekking groups in places like Karimabad and Skardu have become meeting points for solo travellers. However, safety remains the top concern, especially for women. That is pushing both travellers and the industry to adapt. Hotels in major tourist towns now offer female-only dorms. Ride-hailing apps provide trip sharing. Also, the Ministry of Tourism has started listing registered guesthouses and guides on its website. Taking about the top destinations, Domestically, the most popular solo destinations of 2026 are, Hunza, Skardu, and Fairy Meadows for trekking and landscapes, Swat and Kalam for short trips, easier access. And Islamabad and Lahore, for weekend culture trips, history, and food walks. Internationally, Pakistanis traveling alone are choosing Turkey, Malaysia, and Saudi Arabia for Umrah-plus-tourism packages. Portugal and Japan are also rising for first-time solo travellers abroad due to safety and transit systems. But I would say Sri Lanka is the must go. For traveling solo, One of the biggest challenge is price. Single rooms and ‘single supplements’ on tours can add 20-30% to costs. However, to counter this, some operators are launching “solo-friendly” departures — group tours where you get your own room but share activities. To combat this, solo travellers usually travel in shoulder months and spend more on local experiences — guides, food, and home-stays. I am a travelwriter, who travels solo weather traveled domestically or internationally, my advise is basic precautions, let say, safe hotels, air travel, authentic agents and no home stays, since for my travel I only prefer top notch hotels, always get the travel plan from reputable travel agencies, and travel with the guide from company. Also, I avoid night life.

  • Three hours with Nawaz Sharif: reflections on a leader looking to the future

    On Friday, I had the opportunity to spend nearly three hours with former Prime Minister and President of the Pakistan Muslim League (Nawaz), Mian Muhammad Nawaz Sharif, at his Jati Umra residence in Raiwind. We offered Jumma prayers together, shared lunch and held an extensive discussion on Pakistan’s political landscape. It was more than a courtesy meeting; it provided a rare opportunity to observe, first-hand, the thinking of a leader who remains deeply involved in shaping the direction of his party and closely following the country’s political developments. The meeting came at a significant moment for the PML-N. Following the party’s recent success in the Azad Jammu and Kashmir elections, there is renewed confidence within its ranks. Nawaz Sharif appeared optimistic, composed and fully focused on the challenges and opportunities that lie ahead. What struck me first was his health and energy. Nawaz Sharif was in excellent spirits, displaying the confidence and composure of a politician who believes his party is firmly back on the front foot. There was no sense of retirement or political detachment. Instead, there was a clear focus on governance, organisation and preparing for the future. The recent PML-N victory in the Azad Kashmir elections has undoubtedly reinforced that confidence. For the party, the result was more than just another electoral success; it was an affirmation that its political message continues to resonate with voters. Nawaz Sharif spoke with satisfaction about the outcome, viewing it as an important milestone in the party’s broader revival. He was equally appreciative of the performance of the Punjab Government under Chief Minister Maryam Nawaz Sharif. In his view, the provincial administration has demonstrated that governance and public service remain the strongest political currency. Whether through infrastructure, public welfare initiatives or administrative reforms, he believes Punjab is once again becoming the party’s showcase of governance. Prime Minister Muhammad Shehbaz Sharif also received praise during our conversation. Nawaz Sharif expressed confidence in his younger brother’s efforts to steer Pakistan towards economic stability, strengthen institutions and improve the country’s international standing during a challenging period. His remarks reflected a leadership that sees continuity and coordination within the party as one of its greatest strengths. Perhaps the most significant observation from the meeting was Nawaz Sharif’s continued command of the PML-N. Despite years away from active frontline politics, he remains the party’s central strategic figure. Senior leaders continue to look towards him for direction, while party workers still regard him as the movement’s principal source of political inspiration. Much has been written about Nawaz Sharif’s return to Pakistan and his re-emergence in national politics. Yet spending time with him offered a clearer picture than any public rally or television appearance could provide. He is not merely observing events from the sidelines; he is actively shaping the party’s direction, evaluating political developments and planning for the future. My own conclusion from this meeting is straightforward. Nawaz Sharif remains fully engaged, firmly in command of the PML-N and focused on leading his party into the next general elections whenever they are held. Whether one agrees with his politics or not, it would be a mistake to underestimate his influence or his determination. Pakistan’s political landscape continues to evolve rapidly. But after spending three hours with Nawaz Sharif on Friday, one thing appears certain: he believes his political journey is entering a new phase, not its final chapter, and he intends to remain at the centre of Pakistan’s political discourse for years to come.

  • | | |

    The silence of the state

    Al Jazeera’s digital domain was restricted in Pakistan following its critical coverage of regional unrest and local election turmoil. Pakistan had become the second country after Israel to ban the Qatari broadcaster. While the statement makes for a soundbite, it oversimplifies both history and the mechanics of state censorship. In reality, the history of sovereign states attempting to mute inconvenient journalism is long, systemic, and filled with precedent. The Reality Behind the Headlines The recent digital restrictions in Pakistan emerged after the network broadcast extensive ground coverage of civil protests, Internet shutdowns, and election-related violence in Pakistan-administered Kashmir. State authorities responded by accusing the international news organization of yellow journalism and selective reporting. Shortly after, users across the country reported that the network’s website had become inaccessible. Repeated bans on Al Jazeera However, this action makes Pakistan the first nation to follow Israel’s 2024 ban overlooks press suppression. Over the past two decades, Al Jazeera has faced repeated office closures, revocations and total broadcast bans across numerous jurisdictions. Egypt (2013): Following political upheaval, the government shut down the network’s local operations and detained several of its journalists under allegations of threat to national stability. The Gulf Blockade (2017): During a severe diplomatic rift, Saudi Arabia, the United Arab Emirates, Bahrain, and Jordan blocked the channel’s signals and shuttered its regional bureaus. Israel (2024): Emergency legislation empowered authorities to halt local broadcasts, raid offices, and seize transmission equipment over national security claims. Far from being a rare sequel, the administrative impulse to silence an uncomfortable mirror is an old story retold. The Architecture of Banishment In literary traditions, the suppression of speech is rarely about the words themselves; it is about who holds the authority to define reality. George Orwell  observed in 1984 that the primary goal of totalitarian control is to limit the perimeter of thought by controlling the historical record. When a state apparatus brands unfavorable reporting as inherently fraudulent or subversive, it engages in an act of narrative containment. The label of yellow journalism becomes a rhetorical wall. This label shield the public from realities that disrupt official consensus. This dynamic reflects the bureaucratic absurdity depicted in Franz Kafka’s The Castle, where an elusive authority governs from above while remaining immune to direct questioning. In Kafka’s vision, the citizen is caught in a maze of unwritten rules and opaque decrees, where seeking transparency is treated as an act of insubordination. When digital portals are quietly restricted without formal public legislation or explicit judicial oversight, the state operates within a similarly Kafkaesque realm. The silence itself becomes an instrument of governance. The Illusion of Total Control There is a profound irony in modern media suppression. In classical literature, exile was absolute. A banished figure like Ovid was removed physically from the city center, their voice fading at the empire’s edges. Today, however, censorship in a hyper-connected world is an exercise in futility. Blocking a website or pulling a broadcast signal rarely extinguishes the narrative. Instead, it often draws greater international scrutiny to the very events the state wished to obscure. A phenomenon akin to the Streisand effect.   When governments resort to digital blockades, they reveal a fundamental fragility. True political stability rests on the capacity to withstand criticism.  To edit reality is like trying to stop the tide by breaking the hourglass. The water continues to rise, and the story, inevitably, finds another way to be told.

  • Are protein supplements safe for teens?

    Fitness and bodybuilding are becoming increasingly popular among young people. Many gym goers and athletes use protein powders and other supplements to build stronger muscles and improve their physical performance. But are these products always safe? A medical study published in the Proceedings journal of Baylor University Medical Center examined the effects of protein supplements. The researchers described protein powder as a “double edged sword” because it can be useful in some situations but may also cause problems when used incorrectly or unnecessarily. Protein is important for growing bodies The teenage years are an important stage of physical growth.  Protein helps the body build and repair muscles strengthen bones produce hormones and enzymes support the immune system and maintain overall growth. Most young people can get enough protein from a balanced diet. Foods such as milk, yogurt eggs, lentils, beans soy, fish, chicken lean meat nuts and seeds are good sources of protein. When are supplements needed? Many young people start drinking protein shakes after joining a gym playing sports or watching fitness videos on social media. Experts advise against using protein powders simply because a friend gym trainer or social media influencer recommends them. However some young people may need extra protein because of intense training dietary restrictions or certain health conditions. In such cases supplements should be used only with advice from a doctor or qualified nutrition professional. More protein does not mean more muscle Taking large amounts of protein does not automatically lead to bigger or stronger muscles.  Muscle growth also depends on regular strength training, enough calories proper sleep, rest and individual factors such as genetics. Taking more protein than the body needs can also add extra calories to the diet and may contribute to weight gain especially when physical activity is low. Some protein powders may contain extra ingredients. Some protein powders available in the market may contain added sugar artificial sweeteners, herbal ingredients extra calories or stimulant substances. The quality of supplements can also vary. Some products may not be tested as carefully as medicines which can create a risk of unwanted or undeclared ingredients. Who should be more careful? Young people with kidney disease or certain metabolic conditions should not take high protein supplements without medical advice. Anyone who is replacing regular meals with several protein shakes every day following an extremely restrictive diet or experiencing stomach problems after using protein powder should stop and seek professional advice. Protein shakes are not a replacement for food. Protein shakes cannot replace a healthy and balanced diet. Regular foods provide much more than protein. They also supply fiber healthy fats, vitamins minerals calcium iron and other nutrients that are important for healthy growth and development. Healthy habits come first for most young people, a balanced diet, regular exercise proper sleep and enough rest are the foundation of good health and fitness. Protein supplements can be helpful in specific situations but they should not be used simply because they are popular. If extra protein is needed it is best to choose the right amount and product with guidance from a qualified health professional.

Leave a Reply

Your email address will not be published. Required fields are marked *