top of page

Is the development of Artificial Intelligence out of control?

  • Writer: John Scoble
    John Scoble
  • 2 days ago
  • 8 min read

Purpose


The history of religious traditions demonstrates that prophets arise from time to time. These prophets are not fortune tellers. They are generally wise people with high levels of consciousness who interpret current events and emerging trends. They call on the people to wake up and change course. Their message is unwelcome to the powerful and those who benefit from the trend. Consequently, they are often ostracized and driven out of society.


When we look at artificial intelligence, there are prophetic voices who are screaming out warnings that AI is developing at a rate that humanity cannot control. These voices include former senior executives of AI development companies who, for ethical reasons, have decided not to collaborate in the development. These include Dario Amodei (who left Open AI in 2020 and co-founded Anthropic), Jan Leike (who left Open AI in 2024) and Ilya Kutskeva (who left Open AI in 2024 and founded Safe Superintelligence Inc.).


In October 2025 in Australia, the Castlereagh Statement was developed following a national summit hosted by the University of Sydney. This summit brought together educators from schools, universities, vocational providers as well as representative of government departments, the arts and industry. The Statement provided a unified vision for engaging with AI in education settings. https://castlereagh.ai/


In March 2026 in the USA, a broad coalition of business, religious, government and academic leaders issued the Pro-Human AI Declaration https://humanstatement.org/ The declaration contains five sections on keeping humans in charge, avoiding concentration of power, protecting the human experience, human agency and Liberty, and the accountability of AI developers.


The prophetic voices also include Pope Leo XIV, whose May 2026 encyclical “Magnifica Humanitas - on the care of the human person in the time of artificial intelligence” issued similar warnings. https://www.vatican.va/content/leo-xiv/en/encyclicals/documents/20260515-magnifica-humanitas.html


Artificial Intelligence developments


It is worth declaring immediately that I am not an expert in AI. I am interested in the technology and have followed newspaper and television reports on the industry e.g. Four Corners https://iview.abc.net.au/video/NC2603H017S00 I have used Chat GPT and Perplexity for research and drafting purposes. I have read the Pope’s encyclical in full. These are the sources of my knowledge. I have also used Ai Assistants to draft some of the technical aspects of this paper.


It is important to recognise that whenever new technology is developed, there are positive and negative applications and impacts. I acknowledge that AI has the potential to be of great benefit to humanity, particularly in the medical and education fields. However the focus of this paper is on the potential downsides.


For those who may not be familiar with AI, here is a simplified version:


Level

Description

Examples

1. AI Assistant

Responds to prompts and answers questions.

ChatGPT, Claude, Gemini.

2. AI Agent

Can plan, use tools, search the web, write code, send emails, book appointments, and carry out multi-step tasks.

Emerging "agentic AI" systems from OpenAI, Anthropic, Microsoft, etc.

3. AI System that Improves Itself

Can modify or create better versions of its own software or design new AI models.

An active research goal, but not yet autonomous in the strong sense.


Most experts would say that current frontier systems like ChatGPT, Claude, and Gemini are moving from AI assistants toward agentic AI. They can already use tools, reason over long tasks, and help build software—including AI software itself. But they are not yet autonomous self-improving systems in the sense usually discussed in AI safety and futurist debates. However, some suggest the technology is evolving so fast that we may see autonomous self-improving systems within 3 to 5 years. If so, elderly citizens would be unwise to ignore the developments on the basis that they won’t be around to worry about it.


Some technological breakthroughs including artificial intelligence
Some technological breakthroughs including artificial intelligence

Pope Leo’s encyclical


Magnifica Humanitas is a detailed analysis of AI in the context of Catholic social teaching. It contains the wisdom of more than a decade of consultation between the Vatican and industry participants. There is also a helpful Pastoral Kit designed for group prayer and reflection. https://religionsforpeaceaustralia.org.au/?p=23085  


I will not attempt a summary here. There are many summaries and commentaries in the Catholic and secular media. One helpful commentary is “Ten takeaways from Magnifica Humanitas”, published by Global Catholic - see


My main concerns


Lack of awareness/ slow response.

There is an unhealthy lack of awareness in the community of both the speed of development and the potential implications. It has taken decades for the world to understand and respond to humanity’s impact on the climate; the global response has been inadequate, and we may be unable to recover. In the case of artificial intelligence, the world doesn’t have decades to respond.


Power and Money are driving AI development.

The power and control of humanity’s future is in the hands of a small, wealthy, predominantly white male elite, whose primary motivation is financial gain. The race is on between large private corporations and between nations (especially US and China) to dominate industry and control the future. The main drivers seem to be power and money, with little consideration of the impact on the world’s population and future generations. Pope Leo quotes his predecessor, the late Pope Benedict XVI: “Like the natural environment, the “digital ecosystem” can be preserved or exploited, shared or monopolized. Solidarity demands that decisions regarding data, algorithms, platforms and artificial intelligence take into account not only the immediate benefit for a few, but also the impact on all peoples and on future generations.” (MH Kindle 44)


No ethical guidelines.

There are no known ethical guidelines for AI development, and the world may be incapable of establishing guidelines and effectively holding key players accountable for their actions. Pope Leo writes: “It is not enough to invoke ethics in the abstract; robust legal frameworks, independent oversight, informed users and a political system that does not abdicate its responsibility are required. Otherwise, change will be governed only by technocratic thinking and presented as necessary and inevitable, ultimately imposing rules shaped by those who control data, infrastructure and computing power.” (MH Kindle 58) It is difficult to have confidence in the capacity of humanity to achieve this when one considers the current decline in the moral authority of the United Nations and the willingness of some world leaders to ignore international standards of behaviour that have been hard won since World War 2.


Potential malevolent use.

It is conceivable that autonomous self-improving systems will be developed and adopted by malevolent actors for widespread data fraud, unrestrained warfare, damaging terrorism or widescale unemployment with associated social disruption.


Pope Leo notes that “Important and sensitive decisions—concerning employment, credit, access to public services or even a person’s reputation—risk being fully delegated to automated systems”. (MH Kindle 56).

 

Regarding the use of AI in warfare, It has been widely reported that when Anthropic tried to impose limits upon the US government’s use of Claude for warfare purposes, the government removed Anthropic from its preferred list of AI providers. On this general subject, Pope Leo wrote: “armed force should be used only as a last resort in cases of legitimate self-defence. For this reason, the development and use of AI in warfare must be subject to the most rigorous ethical constraints, to guarantee respect for human dignity and the sanctity of life and to avoid a race to develop such arms.” (MH Kindle 101) and “it is not permissible to entrust lethal or otherwise irreversible decisions to artificial systems”.(MH Kindle 102).

 

On the topic of data fraud, it is not inconceivable that a malevolent hacker could invite an AI agent to improve their hacking capability, leading ultimately to an autonomous system constantly improving its hacking. No personal data would be safe under this scenario.


Take action


How can we influence this situation? It would be easy to sit back and do nothing, on the basis that it is all too hard, and individuals can’t make a difference. I disagree. Here are some possible courses of action:


  • Educate yourself. Read up on the topic. Keep abreast of developments.

  • Use AI and learn how to do safely and intelligently.

  • Read the Castlereagh Statement mentioned above

  • Read the Pro-Human AI Declaration mentioned above

  • Read Pope Leo’s encyclical Magnifica Humanitas. Indeed, I strongly recommend this to Christians. Chapter 4 contains proposals for change.

  • Educate others; speak with family and friends about the topic

  •  Raise your concerns with State and Federal politicians – advocate for regulations which put at least some control with elected governments.

  • Use only AI systems with established ethical standards

  • Join public campaigns in favour of ethical development of AI


Through individual and collective action, we may be able to achieve what Pope Leo called for when he wrote: “Let us cultivate what Pope Francis called a “situated anthropocentrism,” which recognizes the human being as a creature embedded in a network of relationships with other living beings and with all of creation. Fidelity to the truth requires integrating the possibilities offered by technology within a framework marked by wisdom, which is capable of safeguarding both the dignity of each person and the future of our common home. (MH Kindle 119)





FAQs - Is the development of Artificial Intelligence out of control?


 What is the main concern raised in this paper?

The paper argues that artificial intelligence is developing at an unprecedented rate and may soon exceed humanity's ability to control it. It points to warnings from former AI executives, educators, religious leaders and Pope Leo XIV, who believe society is not paying sufficient attention to the potential risks.


Source: John Scoble, A St Lucia Spirituality perspective


What are the three levels of AI described in the paper?

The paper describes three stages of AI development: AI Assistants that answer questions, AI Agents that can perform complex tasks, and Self-Improving AI Systems that could redesign or enhance themselves. While current systems such as ChatGPT, Claude and Gemini are moving towards the agent stage, some experts believe self-improving systems could emerge within the next few years.


Source: John Scoble, A St Lucia Spirituality perspective


Why are the current developments of AI risky?

AI development is being driven primarily by powerful corporations and nations competing for wealth, influence and technological dominance. Ethical safeguards, effective regulation and international accountability are not keeping pace with technological advances, creating significant risks for humanity.


Source: John Scoble, A St Lucia Spirituality perspective


What are some of the potential dangers of advanced AI?

The paper warns that advanced AI could be used for large-scale fraud, cybercrime, warfare, terrorism and the automation of important decisions that affect people's lives. It also raises concerns that autonomous AI systems could be exploited by malicious actors in ways that are difficult or impossible for humans to control.


Source: John Scoble, A St Lucia Spirituality perspective

What action does the author recommend?

The author encourages readers to become informed about AI, learn to use it responsibly and participate in public discussion about its future. He also advocates supporting ethical standards, reading key statements and declarations on AI, and urging governments to introduce appropriate safeguards and regulation.


Source: John Scoble, A St Lucia Spirituality perspective


At St Lucia Spirituality we believe the journey is richer when it’s shared. If you’re seeking a place to explore questions, practice mindfulness, or simply belong to an inclusive spiritual community, we invite you to join us. From online discussion groups and meditation gatherings to our growing library of resources, there’s space here for every seeker. Step into the conversation, connect with others, and discover how community can nurture your spiritual growth.





About the Author - John Scoble

John's journey began in the heart of a traditional Roman Catholic family in Sydney, where he was raised with steadfast faith and reverence. Now residing in the serene surroundings of St Lucia, Brisbane, alongside his beloved wife, John finds solace and inspiration in the tranquil rhythms of life. With four adult children and a cherished grandchild also calling Brisbane home, John's family is his anchor, providing love, support, and a sense of belonging.

While spirituality has always been a cornerstone of his life, it was three transformative events in 2012, including a sacred pilgrimage to the Holy Lands, that ignited a profound shift in John's spiritual trajectory. Embracing retirement as an opportunity for deeper exploration, John immersed himself in extensive reading and soulful reflection.

Over the course of a decade, this journey of self-discovery has led John to reevaluate and transcend many of his traditional beliefs, embracing instead the timeless wisdom and cosmic perspective inherent in Christianity. Influenced by luminaries such as St. Francis of Assisi, St. Teresa of Avila, and Richard Rohr, John's spiritual evolution has been marked by a deepening resonance with the essential truths of his faith and a profound connection to the divine unfolding within and around him.



 

Comments


EXPLORING SPIRITUALITY

SPIRITUAL RESOURCES AT YOUR FINGERTIPS

Welcome to the St Lucia Spirituality Resources - your refuge for wisdom, wonder, and growth. Here you’ll find reflections, reviews, teachings, podcasts, videos, and tools that help you explore what it means to live a mindful, connected life. Whether you’re just beginning your spiritual journey or you’ve walked the path for years, you’ll discover something here to stir your heart, challenge your assumptions, and enrich your soul.

 

Why trust us for your spiritual nourishment? Because we believe that spirituality is not “extra” - it is essential. It shapes how we see ourselves, others, and the invisible threads that bind all of us together. We sift through ancient traditions and modern insights so you don’t have to wander alone. We include authors and voices who question and journey, not those who pretend to have all the answers.


Here’s what you’ll find inside:

  • Thought-provoking articles and book reviews that illuminate hidden springs of meaning.

  • Video and podcast picks that provoke curiosity.

  • Guides, practices, and spiritual tools for reflection, self-growth, and compassion.

  • A community of seekers sharing stories, doubts, and breakthroughs.
     

If you’ve ever wondered “What spiritual path fits me?” or “How do I bring more peace, purpose, or connection into my everyday life?” then this blog is for you. Let’s explore, question, and awaken together.

ABOUT ST LUCIA SPIRITUALITY - AN INCLUSIVE SPIRITUAL COMMUNITY FOR SEEKERS

St Lucia Spirituality positions itself as a  critical friend in the realm of spirituality, offering a modern and innovative approach to timeless wisdom and practices. We distinguish ourselves through warmth, authenticity, and transparency, creating a welcoming and inclusive community where individuals feel empowered to explore their spirituality with openness and authenticity.

 

However, we do not hold ourselves out to be theologians or experts. We seek only to help you in your own journey by providing information and connections with other seekers.

  • Facebook

AWAKEN THE SPIRIT WITHIN - RECEIVE OUR SPIRITUAL NEWSLETTER STRAIGHT TO YOUR INBOX

Thanks for joining our community!

© 2025 St Lucia Spirituality. Designed by Uforia.com.au

bottom of page