Skip to main content

AI Governance for Australian Businesses 2026: The Practical Guide

25 May 2026 | David and Goliath

Quick answer

AI governance for Australian businesses in 2026 centres on the Privacy Act reforms taking effect in December 2026, APRA CPS 230 operational resilience from 1 July 2026, and existing sector standards (CPS 234, ASIC RG 271, AHPRA, NSQHS, Aged Care Quality Standards). Boards need a governance framework, an internal AI register, a deployment approval process, and an incident response plan before any production AI ships.

  • Privacy Act reforms effective December 2026 require AI transparency to data subjects
  • APRA CPS 230 operational resilience deadline: 1 July 2026
  • CPS 234 information security applies to any AI handling regulated financial data
  • Voluntary AI Safety Standard published by DISR remains the baseline reference
  • Boards must approve AI use cases, not just budgets

Mentioned: OAIC, APRA, ASIC, AHPRA, DISR, Anthropic, Claude

If you sit on an Australian board or executive committee in 2026, AI governance has stopped being a future agenda item. The Privacy Act reforms land in December 2026. APRA CPS 230 takes effect on 1 July 2026. ASIC, AHPRA, AUSTRAC, and the sector regulators are already asking how production AI is being controlled. This guide gives you the practical answer on what the framework needs to cover, where boards typically get it wrong, and what should be in place before any production AI ships.

What is AI governance in the Australian context?

AI governance is the set of policies, controls, evidence, and approval gates that govern how an organisation deploys and operates AI systems in production. It is not a separate workstream from existing risk and compliance frameworks. It is an extension of them, applied to a class of system that behaves differently from the deterministic software those frameworks were designed for.

The Australian regulatory pattern in 2026 is layered. There is no equivalent of the EU AI Act in force domestically. Instead, AI governance is regulated through existing instruments: the Privacy Act (OAIC), prudential standards (APRA), corporations law (ASIC), health practitioner standards (AHPRA), and the Voluntary AI Safety Standard published by the Department of Industry, Science and Resources (DISR) in September 2024 (Source: DISR, Voluntary AI Safety Standard, September 2024). For most organisations, the framework is built by mapping AI use cases against the applicable existing instruments, not by waiting for a new AI specific Act. Boards that align to the Voluntary AI Safety Standard now will not be retrofitting later.

What changes with the Privacy Act reforms in December 2026?

The Privacy Act reforms passed in 2025 take effect in December 2026 and materially change the obligations on Australian organisations that use AI on personal information (Source: Attorney General's Department, Privacy Act Review Report 2023, reforms enacted 2025). The substantive changes for AI are three. First, organisations must provide transparency to data subjects about automated decision making that significantly affects them, including a description of how the decision was reached. Second, purpose limitation tightens: personal information collected for one purpose cannot be silently repurposed to train or operate AI systems serving a different purpose. Third, breach response timelines tighten and the definition of a notifiable breach extends to certain AI specific incidents (for example, prompt injection that exposes other customers' data).

The practical implication is that every production AI system handling personal information needs a Privacy Impact Assessment that explicitly addresses the new requirements. The PIA documents what personal information enters the system, what decisions it supports, where automated decision making is in scope, what the human review point is, and how data subject transparency is met. PIA work takes four to six weeks once it starts. The runway to December 2026 is short, so boards should be asking which systems are in scope and what the status of each PIA is.

How does APRA CPS 230 affect AI deployment?

APRA CPS 230 on operational resilience takes effect on 1 July 2026 across all APRA regulated entities, including banks, insurers, and superannuation trustees (Source: APRA, CPS 230 final standard, 2024). The standard requires regulated entities to identify critical operations, define tolerance levels for disruption, document dependencies on material service providers, and demonstrate they can recover within tolerance after a severe but plausible disruption.

For AI, the standard has two direct implications. Any AI system supporting a critical operation is itself part of that critical operation and needs to be inside the operational resilience evidence. The AI provider (Anthropic, OpenAI, or others) is a material service provider, requiring SLAs with measurable recovery objectives, documented dependency mapping, and assurance evidence that the provider can meet the entity's tolerance levels. The practical work is to map each AI use case to the critical operations it supports, document the provider in the third party register, and ensure mid 2026 resilience scenario testing covers AI provider disruption.

What about CPS 234 information security?

APRA CPS 234 on information security has been in force since 2019 and applies to any AI system that handles regulated financial data (Source: APRA, CPS 234 final standard, 2019). The standard requires regulated entities to maintain information security capability commensurate with the size and complexity of the entity, to clearly define information security roles and responsibilities, and to test the effectiveness of information security controls.

For AI, CPS 234 means three things. The provider needs to be assessed against the entity's information security policy. The entity must define and test controls specific to the deployment, including controls against prompt injection, data exfiltration through model outputs, and unauthorised access to model context. The deployment must be included in the information security testing programme. The common 2026 gap is treating AI as software procurement rather than as an information security event, which surfaces a CPS 234 evidence gap on the next APRA review.

What does the Voluntary AI Safety Standard cover?

The Voluntary AI Safety Standard published by DISR in September 2024 sets out ten guardrails for organisations deploying AI systems (Source: DISR, Voluntary AI Safety Standard, September 2024). The guardrails cover accountability, risk management, data governance, testing and evaluation, human oversight, transparency to end users, contestability of automated decisions, accountability for outcomes, engagement with stakeholders, and compliance with applicable law.

The standard is not law. For organisations operating across multiple sectors or without a sector regulator setting AI specific expectations, it is the most credible baseline available. It is also useful as a structuring device for board reporting: each guardrail becomes a heading in the quarterly AI risk report covering what is in production, the risk treatment, and what has changed since the last cycle.

What must boards approve before AI ships to production?

Boards should not be approving AI budgets in isolation. They should be approving specific use cases against a documented framework. The minimum approval pack for a production AI deployment in 2026 includes: a use case description with the business problem, proposed workflow, and success measures; a risk assessment covering Privacy Act, sector regulator obligations, information security, and reputational risk; a Privacy Impact Assessment where personal information is in scope; a vendor due diligence pack covering enterprise terms, data residency, and assurance evidence; a governance plan covering human oversight, audit logging, incident response, and review cadence; and a measurement plan covering what the board will see on each subsequent cycle.

This is the baseline regulators and assurance providers will be looking for during 2026 reviews. The practical implementation is an internal AI register, owned by the chief risk officer or general counsel, that lists every production use case with the approval pack attached. New use cases go through the same pipeline. The register is reviewed at every board cycle.

How does this compare to the EU AI Act?

The EU AI Act is the most comprehensive AI specific legislation globally in 2026. It classifies AI systems by risk tier (unacceptable, high, limited, minimal) and imposes obligations that scale with the tier. For Australian organisations selling into the EU, the Act applies and obligations are substantive: conformity assessment, technical documentation, risk management system, human oversight, and accuracy and robustness requirements for high risk systems.

Australia has not adopted an equivalent risk tiered Act. DISR has signalled a direction to harmonise where it reduces friction for Australian businesses operating internationally, but to apply existing instruments domestically. For most organisations, the practical answer is to align to the Voluntary AI Safety Standard plus the applicable sector instruments and to layer EU AI Act compliance only on products that touch the EU market. Designing once to the higher EU bar avoids retrofitting later.

What does a practical governance framework look like?

A practical AI governance framework for an Australian organisation in 2026 has five components. A policy that defines what AI is, what use cases are in scope, and what the approval gates are. An AI register that lists every production system with the use case description, risk assessment, Privacy Impact Assessment, and vendor due diligence pack. An approval process that takes a proposed use case through risk assessment, PIA where required, and board or executive committee approval before production deployment. An operational governance layer covering human oversight, audit logging, incident response, and supplier management. A review cadence that updates the register quarterly, reviews each use case at least annually, and reports to the board at every cycle.

The framework does not need to be elaborate. It needs to exist, be applied consistently, and produce the evidence regulators will ask for.

Where do most ANZ organisations get governance wrong?

The most common failure pattern in 2026 is treating governance as a blocker rather than as an enabler. The board hears that governance is being built, the deployment is paused for six months while the framework is debated, and the operational opportunity passes. The framework that eventually lands is over engineered for the actual risk profile.

The second failure is delegating AI governance to IT or to procurement without engaging the chief risk officer, the privacy officer, or the general counsel. The result is a deployment that meets technical security standards but misses the Privacy Act, sector regulator, or contractual obligations that surface later.

The third failure is treating the AI provider as a software vendor rather than as a material service provider. The contracts get signed without the material service provider treatment, the operational resilience evidence is missing, and the next regulator review surfaces the gap.

The pattern that works is the inverse. Build the framework lightly, apply it consistently from the first deployment, and update it as use cases reveal what it needs to cover. The first production use case becomes the proof point that governance and deployment can move together rather than against each other.

To scope a Claude activation with governance documentation as a deliverable, visit davidandgoliath.ai/claude-activation/how-it-works or book a scoping call at davidandgoliath.ai/claude-activation/start.

Sources: DISR, Voluntary AI Safety Standard, September 2024. Attorney General's Department, Privacy Act Review Report 2023, reforms enacted 2025. APRA, CPS 230 final standard, 2024. APRA, CPS 234 final standard, 2019. EU AI Act, in force 2024 to 2026. Anthropic Enterprise Terms, May 2026.

Ready to move from reading to shipping?

Ten business days. Four modules. One agent live by the end.