{"id":91194,"date":"2026-04-24T08:10:45","date_gmt":"2026-04-24T08:10:45","guid":{"rendered":"https:\/\/outliereditor.co.za\/?p=91194"},"modified":"2026-04-24T11:05:50","modified_gmt":"2026-04-24T11:05:50","slug":"south-africas-economic-data-is-public-getting-to-it-is-another-matter","status":"publish","type":"post","link":"https:\/\/outliereditor.co.za\/index.php\/2026\/04\/24\/south-africas-economic-data-is-public-getting-to-it-is-another-matter\/","title":{"rendered":"South Africa&#8217;s economic data is public. Getting to it is another matter"},"content":{"rendered":"\n<p>Most of the numbers that describe South Africa&#8217;s economy are, technically, available. They sit in PDFs on government websites, in spreadsheets attached to Stats SA releases, in budget review annexes, in dashboards scattered across a dozen institutions that don&#8217;t talk to each other. Each source has its own format, its own naming conventions, its own idea of what a header row looks like. Pulling a single clean time series out of that landscape can take a researcher a morning. Keeping it up to date takes another morning every month.<\/p>\n\n\n\n<p>That friction \u2014 between data being published and data being usable \u2014 was the underlying theme when Dr Daan Steenkamp, chief executive of <a href=\"https:\/\/codera.co.za\/\">Codera Analytics<\/a>, joined The Outlier&#8217;s Out to Lunch session this week.<\/p>\n\n\n\n<p>Steenkamp is perhaps best known for the daily charts he posts on LinkedIn: inflation breakdowns, exchange rate scenarios, and an occasional braai-weather index, but under the hood, Codera has built its own data management called <a href=\"https:\/\/codera.co.za\/econdata\/\">EconData<\/a>. The platform centralises economic and financial data into a single, consistently structured format, ready to plot or model. When a new release lands, ingestion scripts pull it in, validate it against what came before, and push it through chart templates that auto-update. The analyst doesn&#8217;t reshape anything. The chart refreshes itself.<\/p>\n\n\n\n<p>The platform is also built using standards like SDMX \u2014 Statistical Data and Metadata Exchange \u2014 promoted by Eurostat and used by the IMF and the World Bank. That matters for two reasons. It makes the data interoperable with tools analysts actually use: a website view for casual users, an Excel add-in for spreadsheet people, and an API for anyone working in R or Python. And it bakes metadata into the data itself, so quality control can be automated rather than done by eye.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The vintage problem<\/h2>\n\n\n\n<p>One of Codera&#8217;s less obvious contributions is how it handles revisions. Economic data changes after the fact, sometimes heavily. A model trained on today&#8217;s cleaned-up historical series will look accurate in backtesting and underperform in practice, because it never had to work with the provisional numbers analysts actually saw at the time.<\/p>\n\n\n\n<p>Codera stores every vintage: what was published on the day, not just what it was later corrected to. That makes it possible to show, for example, how National Treasury&#8217;s debt projections have ratcheted upwards budget after budget, each one expecting a stabilisation that never came.<\/p>\n\n\n\n<p>The same philosophy extends to timeliness. Official house price indices run months behind. Codera is building alternative-data indicators that estimate current-month prices from private sources, and extending the approach across industries \u2014 weekly farm-gate prices feeding into food inflation outlooks, input costs helping anticipate producer prices before Stats SA confirms them.<\/p>\n\n\n\n<p>Steenkamp was careful here. Real-time private-sector data sounds compelling, but it carries its own hazards: odd seasonality, aggregation traps, and selection bias. &#8220;Pure data science can get you into trouble with alternative data,&#8221; he said. Statistical training still earns its keep.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The AI question<\/h2>\n\n\n\n<p>Asked how artificial intelligence is changing Codera&#8217;s work, Steenkamp&#8217;s answer was more cautious than the industry average. The team uses AI to automate lower-stakes tasks and for suggestions, but still builds its core systems from scratch. Two reasons: the work has to be correct and fixable when it breaks, and Codera doesn&#8217;t want its models training someone else&#8217;s.<\/p>\n\n\n\n<p>His advice to young analysts followed the same logic. Learn to build things from scratch. Understand frameworks deeply. Don&#8217;t let AI become a substitute for knowing how the machinery works, because the machinery keeps changing and the people who can adapt are the people who understand it.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">A wish list<\/h2>\n\n\n\n<p>Pushed on what data he most wants to see, Steenkamp named two gaps.<\/p>\n\n\n\n<p>The first is public data that is already meant to be public. Many government departments have a legal mandate to publish and don&#8217;t, for reasons ranging from funding to capability to unresolved data quality issues. The cost is that researchers, journalists and policymakers can&#8217;t monitor performance or diagnose what&#8217;s actually broken.<\/p>\n\n\n\n<p>The second is a framework for responsible data sharing. South Africa has reasonably developed rules for data protection. It has close to nothing on how public institutions should share data with each other, with private firms, or with researchers. Without that, Steenkamp argued, a thriving domestic tech sector is hard to imagine.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The through-line<\/h2>\n\n\n\n<p>The argument running through Codera&#8217;s charts, its real-time experiments and Steenkamp&#8217;s policy critique is a single proposition: data is infrastructure. Published as an afterthought \u2014 locked in PDFs, scattered across incompatible formats, guarded by institutions that aren&#8217;t quite sure why \u2014 it becomes something analysts spend their time wrestling rather than using.<\/p>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":91195,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1409],"tags":[],"newsletter-post":[],"site":[],"class_list":["post-91194","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-webinar"],"acf":{"post_style":"bc","show_on_front":"Yes","link_through":"Yes","big_number":"","big_number_caption":"","big_number_link":"","big_number_background":"","big_number_text_colour":"#000000","big_number_icon":false,"big_number_wide":"yes","featured_chart":false,"flourish_chart_id":"","flourish_sub_title":"","flourish_chart_width":"medium","is_newsletter_post":"No","chart_url":"","background_colour":"#0089AA","text_colour":"#FFFFFF"},"_links":{"self":[{"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/posts\/91194","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/comments?post=91194"}],"version-history":[{"count":3,"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/posts\/91194\/revisions"}],"predecessor-version":[{"id":91200,"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/posts\/91194\/revisions\/91200"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/media\/91195"}],"wp:attachment":[{"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/media?parent=91194"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/categories?post=91194"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/tags?post=91194"},{"taxonomy":"newsletter-post","embeddable":true,"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/newsletter-post?post=91194"},{"taxonomy":"site","embeddable":true,"href":"https:\/\/outliereditor.co.za\/index.php\/wp-json\/wp\/v2\/site?post=91194"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}