hallucination trap 8211

The hallucination trap – information convincing but factually incorrect

ByJustpaste.in

By Syeda Samar Zahra Zaidi

When you ask an AI chatbot a question it does not know the answer to, an odd thing can happen: instead of hesitating or saying, “I am not sure!” it confidently delivers a tidy, well-structured, completely fabricated response—often with fake citations, fictional figures, and an authoritative tone. This phenomenon is known as the ‘hallucination trap ’, and it may be the most significant barrier between trust and artificial intelligence.

I was introduced to the term “AI hallucination” for the first time in the workshop under the project titled “Digital Trust and Free Expression in the AI Era” at Department of Media and Development Communication, University of the Punjab, supported by the U.S. Mission to Pakistan in partnership with the Pakistan-U.S. Alumni Network (PUAN). I learned that a “hallucination” occurs when a language model produces information that sounds convincing but is factually incorrect or completely made up. Examples include inventing a legal case that never existed, citing a research paper that doesn’t exist or boldly misrepresenting a historical date. What is disturbing is not merely that AI can be wrong-humans make mistake too- but rather the way it presents that incorrect information with clearly, confidence and without a trace of doubt.

Large language models are essentially highly complex pattern predictors trained to produce the most likely next word in a sequence. As a result, when a model has encountered a topic thousands of times in its training data, the predictors are typically accurate. However, when it comes across a gap, an unidentified fact or a question at the outer edge of its knowledge, it doesn’t shift into a hesitant mode. Instead, it continues doing exactly what it was trained to do: generate a logical, fluent piece of writing, producing a response that is structurally sound and grammatically correct but based on nothing.

In human communication, confidence is generally perceived as a sign of strength which is important. We naturally prefer to trust a calm, reliable voice over a hesitant one. AI systems unintentionally exploit the tendency because their language remains confident whether they are right or wrong.

The risks increase with the use of AI, as students may unintentionally include false information into their work and journalists have published articles citing artificially created sources and quotes, negatively affecting the credibility of their publications. Such inaccuracies influence what millions of people see, believe or share, thereby amplifying fabricated content.

The reason AI does not simply say “I don’t know” is partly due to the way these systems are trained. Many models are designed to provide helpful, comprehensive-sounding answers and are rarely rewarded for expressing doubt during training. This means that a model that frequently acknowledges uncertainty may be judged as less helpful than one that consistently provides an answer, even when that confidence is occasionally misplaced. Such incorrectly aligned incentives arise when the training process gradually teaches the model that sounding confident is more valuable than being accuracy.

Retrieval-augmented generation, which relies on responses in actual, verifiable records rather than internal memory alone, improved training techniques that explicitly account for uncertainty; and systems built to simply cite sources. So, users can independently verify claims are just a few of the ways developers are using to addresses this problem.

While none of these solutions fully eliminate hallucination yet, taken together they represent a major shift from blind confidence toward earned trust. The most dangerous outcome is not an AI that makes mistakes but a culture of users who stop questioning because the system always sounds so sure of itself.

 

Therefore, until AI becomes more reliably aware of it own limitation, part of the responsibility falls on the people who use it: treating AI-generated output as a starting point rather than an endpoint, cross checking important facts against credible sources. In the end, the hallucination trap serves as a reminder that illusion is not the same as truth. As AI becomes increasingly common in education, digital media and everyday life, understanding why it occasionally lies with confidence is not only a technical curiosity but also a fundamental aspect of digital literacy. We must strengthen our ability to verify the information provided by AI as they become more persuasive.

The views, thoughts, and opinions expressed in this blog are solely those of the author and do not necessarily reflect the official policy or position of the U.S. Mission to Pakistan or USEFP.

The writer, Syeda Samar Zahra Zaidi, is a student of Media and Development Communication at  University of the Punjab, Lahore and can be reached at samarzahra456@gmail.com.

 

Similar Posts

  • 80 Years, still no justice

    ByJustpaste.in

    Chiniot: A family in Chiniot is still waiting for justice in a theft case that was reportedly registered shortly after Pakistan came into being in 1947. The case dates back nearly 80 years. According to the affected family, a large amount of gold silver expensive clothes and other valuables were stolen from their home on the night between August 14 and 15, 1947. The family says the case was among the first cases registered in Chiniot after independence and was recorded as FIR No. 8. According to the family, around 112 to 120 tolas of gold, silver items, Boski fabric and other expensive clothes were stolen.  The value of these items would be worth millions of rupees today. Despite the passage of almost eight decades the stolen property has never been recovered and the family says there is still no clear record of what happened to the case. To mark 80 years of waiting for justice the family held a unique protest. They had a cake made featuring the text of the old FIR and cut it to draw the attention of the authorities. Family members say their elders spent years visiting police stations and courts in the hope of recovering their belongings.  However several generations have passed without any clear result. A family member Sajid Ismail Dar, said that applications had also been submitted to senior Punjab Police officials in the past.  Some officials took notice of the matter but the case later went quiet again. The family has now appealed to the Inspector General of Punjab Police and the Chief Minister of Punjab to review the decades old case investigate whether the stolen property can still be traced and provide justice to the family.

  • High sugar intake in early life may raise dementia risk

    ByJustpaste.in

    A new study has found that children who consume high amounts of sugar at an early age may face a higher risk of developing dementia later in life. The study suggests that pregnant women who avoid sweets, chocolates and other sugary foods may help reduce their child’s risk of developing the disease by up to 20 percent. The research published in the medical journal Neurology also found that consuming very small amounts of sugar during early life may provide protection against dementia. The study’s lead author, Professor Jiazheng Zheng said the findings suggest that limiting sugar intake during the early stages of life could have long-term benefits for brain health. He further said the findings highlight the potential importance of early-life nutrition in reducing the risk of dementia decades later. Researchers from the Hong Kong University of Science and Technology compared the health of 64,737 people who were born before and after sugar rationing was introduced in Britain during World War II. The participants were divided into groups based on the timing of sugar rationing: those who experienced limited access to sugar before birth and during their first year of life, those who experienced it before birth and until the age of two and those who were not exposed to sugar rationing. When the participants reached an average age of 55, the research team began analyzing their medical records to determine which individuals were diagnosed with dementia during the following 15 years. Among the 15,256 people who had limited access to sugar before birth and during their first two years of life, only 2 percent were later diagnosed with dementia. Although researchers say the findings do not conclusively prove that eating less sugar directly prevents dementia, experts believe the results are consistent with growing evidence that sugar can affect brain function. Experts also say that the brain is highly sensitive to fluctuations in blood sugar levels. Other research has found that people with high blood sugar levels may face up to a 69 percent higher risk of Alzheimer’s disease.

  • |

    Kashmir is beyond a geographic location

    ByJustpaste.in

    For centuries, Kashmir has occupied a singular space in the poetic imagination. It is a region defined by a paradox. On one hand, earthly paradise of pristine lakes, towering snow-capped peaks and crimson autumn chinars. On the opposite, centuries of political upheaval, exile and grief. In literature, Kashmir is beyond a geographic location. It is a metaphor for divine beauty, and a testament to human endurance. The poetic tradition of Kashmir took root in spiritual mysticism and poignant lyricism during the medieval period. In the 14th century, the mystic poet Lal Ded pioneered the Vakh: four-line spiritual verse couplets in the Kashmiri vernacular. Her poetry bridged Hinduism and Sufism. It’s essence was inner purity, liberation, and the transcendence of physical suffering. I searched for my Self until I grew weary, No one, I thought, could reach this hidden knowledge. I plunged into it, and there found the jar of nectar. Habba Khatoon was known as the Nightingale of Kashmir. The 16th-century peasant-turned-queen introduced the Lol: a short, melodic form of love lyric. Her husband, King Yousuf Shah Chak, was exiled by the Mughal Emperor Akbar. Then, her poetry transformed into immortal songs of separation and longing. The spring has come, but you have not returned; My heart bleeds like the red bloom of the pomegranate. During the Mughal and Persian era, Kashmir became synonymous with heavenly superiority. The iconic Persian couplet often attributed to Amir Khusrow or Mughal Emperor Jahangir summarized this adoration: Agar firdaus bar roo-e zameen ast, Hamin ast-o hamin ast-o hamin ast. (If there is a paradise on the face of the earth, it is this, it is this, it is this.) In the 20th century, Allama Iqbal, whose ancestors hailed from Kashmir, brought a nuanced perspective to this paradise. In works like Javid Nama, he celebrated Kashmir’s breath-taking landscape while lamenting the subjugation and suffering of its people. He reflected on the region’s immense dormant potential in Payam-e-Mashriq: ​Pani tere chashmon ka hai aab-e-hayat, Aur tere kohsar hain qasran-e-kibriya. ​The water of your natural springs is the elixir of life, And your mountain ranges are towering palaces of divine grandeur. Iqbal’s verse moved beyond aesthetic wonder, using poetry as a call to dignity, resilience, and self-realization for the Kashmiris. In modern poetry, Kashmir’s narrative shifted dramatically toward exile, memory, and war. No poet captured this transition more powerfully than Agha Shahid Ali (1949–2001). He wrote primarily in English while employing traditional Urdu ghazal forms. Ali gave voice to the tragedy of late 20th-century Kashmir. In his seminal collection, The Country Without a Post Office (1997), Kashmir becomes a landscape of ghost letters, curfews, and faded memories. I write on fallen leaves and floating petals, I write to you from a country without a post office. Ali’s verse knits together global literary influences from Mahmoud Darwish to James Merrill. His poetry creates a poignant eulogy for a lost homeland. Their memory is anything but green, an white-hot fire. They burn down Kashmir in my veins. From the ascetic reflections of Lal Ded to the haunting elegies of Agha Shahid Ali, poetry has served as Kashmir’s truest archive. A disputed land of changing maps, borders, and historical conflicts. It’s the poetry that preserves the living soul of the land. The verses anchor its beauty, its heartbreaks, and its unyielding hope. Kashmir remains forever intact. It is an eternal paradise written in ink, surviving through the memory and voices of its poets.  

  • China’s Rising Global Image: Insights from the 2026  Pew Research Survey

    ByJustpaste.in

    By Absara Kashaf  The international political landscape is undergoing a noticeable transformation. For many years, the United States was widely regarded as the world’s most influential political, economic and military power. However, recent global opinion surveys indicate that public perceptions are changing. Countries around the world are increasingly evaluating global powers not only by their military strength but also by their economic cooperation, development assistance, investment and diplomatic engagement. The Latest Pew Research Center Global Attitudes Survey (july 2026) provides important evidence of this shift. Based on interviews with 42,151 adults across 36 countries, the survey reveals that China now enjoys a more favorable public image than the United States in a majority of the countries included in the study. The findings highlights China’s growing international influence, particularly among developing and middle-income nations. One of the survey’s most significant findings is that China is viewed more favorably than the United States in 30 of the 36 countries surveyed. This represents a remarkable change in global public opinion. While the United States continues to enjoy strong support in few countries, particularly among some of its long-standing allies, China has gained considerable public approval across Asia, Latin America, and parts of Europe. This shift suggests that many people now associate China with economic opportunity, infrastructure development, and long-term cooperation rather than viewing it solely as an emerging global competitor. China’s growing popularity is closely linked to its expanding economic partnerships around the world. Over the past two decades, China has invested billions in infrastructure projects, transportation networks, energy development, industrial zones, digital connectivity and trade agreements. Through initiatives such as Belt and Road Initiative (BRI), China has financed highways, railways, ports, power plants, and industrial zones in numerous developing countries. These projects have contributes to economic growth, employment opportunities and improved connectivity in many regions. As a result, public opinion in several countries increasingly reflects appreciation for China’s contribution to national development. The survey further shows that 69 percent of respondents in 17 middle-income countries consider China to be somewhat or very reliable international partner. This finding is particularly important because middle-income countries often seek foreign investment, technology and infrastructure financing to support their development goals. Many respondents appear to believe that China provides practical economic cooperation without imposing extensive political conditions. Whether this perception fully reflects reality remains a subject of academic debate, but it undoubtedly contributes to China’s improving international image. Another major finding concerns confidence in Chinese President Xi Jinping. According to the survey, global confidence in Xi Jinping has improved compared to previous years. Across many countries,  larger number of respondents believe that President Xi will make responsible decisions regarding international affairs. Although confidence levels differ from one country to another, the overall trend indicates that China’s leadership is gaining broader international acceptance. Leadership perceptions often influence how countries are viewed internationally, making this finding particularly significant for understanding China’s growing diplomatic influence. Among all the countries surveyed, Pakistan recorded one of the strongest levels of support for China. According to the survey, 90 percent of Pakistanis expressed a favorable opinion of China, while 83 percent reported confidence in President Xi Jinping to do the right things regarding world affairs. These are among the highest approval ratings recorded anywhere in the survey. In contrast, only 15 percent of Pakistanis expressed a favorable opinion of the United States, while confidence in former U.S President Donald Trump stood at just 12 percent. These figures demonstrate the exceptionally positive image that China currently enjoys among the Pakistani public. Several factors help explain Pakistan’s strong support for China. The two countries have maintained close diplomatic and strategic relations for decades, often referring to their friendship as an “all-weather strategic partnership”. In recent years, this relationship has expanded significantly through the China-Pakistan Economic Corridor (CPEC), one of the flagship projects under the Belt and Road Initiative. CPEC includes investments in roads, highways, ports, power generations, industrial zones, and communication infrastructure. Many Pakistanis associate these projects with improved economic opportunities, enhanced connectivity, and future development. Consequently, China’s image among Pakistani Public has become increasingly positive Beyond Pakistan, the survey also suggests that China is increasingly perceived as a contributor to global peace and stability. One notable example is South Africa, where the proportion of respondents who believe China contributes positively to global peace increased from 47 percent in 2023 to 64 percent in 2026. Similar improvements were observed in several other developing countries. China’s active participation in diplomatic negotiations, peacemaking missions, humanitarian assistance, and international development initiatives appears to have strengthened its reputation among many respondents. The survey also explores whether people believe China considers the interest of developing countries when making international policy decisions. Among respondents in the 17 middle-income countries, 57 percent stated that China takes the interests of countries like their own into account. This finding reflects an important aspect of China’s international strategy. Many developing countries view China as a partner that understands their development challenges and provides economic cooperation through investment, trade, infrastructure financing, and technology transfer. Whether this perception continues in the future will depend on China’s policies and long-tern outcomes of its international projects Despite China’s growing popularity, the survey also demonstrates the global opinion remains diverse. Several countries continue to express stronger support for the United States than for the China. These include Japan, India, Philippines, Israel, Poland, and South Korea. Historical alliances, security partnerships, regional geopolitical concerns, and territorial disputes continue to influence public opinions across countries. The findings also illustrated the growing importance if soft power illustrates the growing importance of soft power in international relations. Soft power refers to a country’s ability to influence others through attraction, cooperation, culture, diplomacy and economic engagement rather than military force. China’s engagement in infrastructure, trade, education techonolgy in many developing countries have strengthened its soft power in many developing countries. Public opinion surveys such as Pew’s demonstrate that these efforts are increasingly shaping how ordinary citizens perceive China’s global role. The finding offer important insights

  • |

    China’s Chang’e-7 Moon mission to launch on August 24

    ByJustpaste.in

    China is preparing to launch a complex, multi-spacecraft mission to the Moon. The mission will land near the Moon’s south pole and search for evidence of water and ice. The mission is scheduled to launch on August 24 from the Wenchang Satellite Launch Center on China’s Hainan Island. According to a statement issued by the China Manned Space Agency, the Chang’e-7 mission will be launched aboard a Long March 5 rocket. The mission will focus on the Moon’s south pole and attempt to determine whether water and ice are present inside the craters as well as their quantity and other related details. Water vapour has previously been detected in this region of the Moon through remote sensing but scientists have not yet been able to measure it directly or obtain samples. Chang’e-7 will also help lay the technological groundwork for China’s crewed lunar mission planned for 2030. The mission will consist of an orbiter, lander, rover and hopper spacecraft. Five days after launch, the spacecraft is expected to enter lunar orbit. The orbiter will then identify and determine the target landing area. Chinese authorities have not yet announced the exact landing date and the landing is expected to take place several months after launch. The hopper spacecraft will make multiple flights over the permanently dark craters near the Moon’s south pole. It will also be equipped with landing legs to allow it to land and analyze the surface of the selected locations. The mission will also carry scientific payloads from several countries. China’s Chang’e-5 mission in 2020 and Chang’e-6 mission in 2024 successfully collected lunar samples and returned them to Earth.

  • Hala fruit explained

    ByJustpaste.in

    Have you ever seen a fruit that looks like a brain when it’s whole and a bursting planet when it’s opened? That’s the Hala fruit one of the world’s most unusual fruits. The Hala fruit grows in Southeast Asia eastern Australia the Pacific Islands and Hawaii. It is made up of many separate sections called keys or cones giving it a very unique appearance. The fruit comes from the Pandanus tree which includes more than 750 species. A Hala tree can grow up to 14 meters (46 feet) tall. Hala fruit has a sweet and pleasant taste. It can be eaten fresh added to different dishes for extra flavor and is also used in traditional medicine. People have traditionally used the fruit to help relieve headaches and constipation and it is believed to support a healthy immune system. It is also rich in vitamin C making it a nutritious tropical fruit. Growing Hala fruit is not easy. The tree is very sensitive to cold weather and thrives only in warm humid climates where temperatures stay above 18°C (64°F) throughout the year.

Leave a Reply

Your email address will not be published. Required fields are marked *