The Performance Audit Report

Maura Hayes-Chaffe is the Deputy Comptroller for Audit in New York City.

Maura joined us to discuss the Bureau of Audit, including:
the challenges with recruiting and attracting performance auditors
new approaches to conducting PAs
the changing environment (e.g., economics)
equity in PA, citizen powered audits, and a recent housing related audit
the use of data, including open data, by the audit team.

Links
NYC Office of the Comptroller
This episode's web page

About this podcast 
The podcast for performance auditors.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by PA Reports - Performance Audit Research.  

Get updates
New episodes, and a fortnightly newsletter with a selection of PA reports and practices from audit offices.
https://pareports.com/#cta-subscribe


This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit performanceaudit.substack.com

Our guest is Cathy O'Neil, author of Weapons of Math Destruction: how big data increases inequality and threatens democracy.

Cathy joined us to discuss critical aspects for auditors to consider, including:
The human element: why understanding 'for whom an algorithm might fail' is more important than the detailed technical design of an algorithm.
Algorithm testing: the importance of post-deployment testing to ensure there are no unintended adverse outcomes. 
Setting standards: the need for industry-wide standards so that regulators can ensure there is no bias or discrimination in how algorithms operate. 
Laggers and leaders: the four big industries/domains using algorithms that need to step up audit in their space and how law-makers and regulators are catching up.
Emerging AI, e.g. language models/chatbots - why trust by users is key, and the pros and cons of using these models.
Links
Cathy's company, ORCAA 
Weapons of Math Destruction (book)  
This episode's web page: https://pareports.com/podcast/24 

About this podcast 
The podcast for performance auditors.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by PA Reports - Performance Audit Research. 

Get updates
New episodes, and a fortnightly newsletter with a selection of PA reports and practices from audit offices.
https://pareports.com/#cta-subscribe


This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit performanceaudit.substack.com

This episode featured guests from the North Dakota State Audit Office:
Allison Bader, Performance Audit Manager and Claudia Kuball, Performance Auditor.

In this episode we discuss:
Team diversity – the value of recruiting performance auditors from different backgrounds, incl. how specialist expertise can help focus on major risks
Impact – their communications team is instrumental in engaging citizens and maximising audit impact
Significant audit – their audit of Storage and Handling of COVID Vaccines including its design, execution and findings
Citizen engagement – how North Dakotans can get involved, and even speak to the State Auditor directly on radio every Wed morning

Links:
Office of the State Auditor, North Dakota: https://www.nd.gov/auditor 
Submit ideas for audit topics here 
What’s On Your Mind – the radio program that Josh Gallion (State Auditor) guest appears on from 10-11 CST every Wednesday: https://kfyr.iheart.com/ 
Sign up for the office's quarterly e-newsletter here 
The office on Facebook, LinkedIn and YouTube 
This episode's webpage: https://pareports.com/podcast/23

About this podcast 
The podcast for performance auditors.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by PA Reports - Performance Audit Research.

Get updates
New episodes, and a fortnightly newsletter with a selection of PA reports and practices from audit offices.
https://pareports.com/#cta-subscribe


This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit performanceaudit.substack.com

In this episode, we discuss how audit offices are engaging citizens in performance audits.

The show notes here and the full article here contain further details and examples.

We delve into how audit offices are engaging citizens:
Forward work plans – consulting broadly for focus areas
Refining the broad focus areas for specific citizen concerns
 Audit planning – citizen input on audit scope
 Audit execution – seeking agency staff views during fieldwork 
Reporting – tailoring reports for citizens and civil society organisations 

Links: 
This episode's web page with further details and examples - https://pareports.com/podcast/22 
The full accompanying article - https://riskinsights.com.au/engaging-citizens-in-pa/

About this podcast 
The podcast for performance auditors.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by PA Reports - Performance Audit Research.

Get updates
New episodes, and a fortnightly newsletter with a selection of PA reports and practices from audit offices.
https://pareports.com/#cta-subscribe


This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit performanceaudit.substack.com

This originally aired as episode 50 of The Assurance Show.

In this episode, we discuss the benefits of adopting a data focused approach during audit planning.

Link: This episode's web page - https://pareports.com/podcast/21

About this podcast 
The podcast for performance auditors.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by PA Reports - Performance Audit Research.

Get updates
New episodes, and a fortnightly newsletter with a selection of PA reports and practices from audit offices.
https://pareports.com/#cta-subscribe


This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit performanceaudit.substack.com