APIs make the digital world go round. According to Gartner, they are an essential element of every digital strategy. They enable systems and applications to interact, connecting disparate data sources and bridging access protocols. APIs can unlock your organisation’s digital assets and allow them to be consumed in a...

This article is co-written with Robert Li 

Robert is a Lead in the Data Team at AMP Capital.

He is passionate about building data and analytics applications that empower people to do their best work.

What this article is not

We love dbt and believe it is a great tool to manage your data transformation. This article...

APIdays returns to Melbourne on September 19 and 20. This is our seventh event in Australia/New Zealand on top of 40+ APIdays events globally. As we plan for this year and our call for speakers it is worth looking back at the last 12 months in an API connected world.

Open Banking and Open Data

Financial services...

Overview

Apache Kafka is being leveraged very commonly and forms some of large scale and important systems in the world processing trillions of messages per day. It is serving as pipeline backbone for many companies in financial and tech industry.

Before I continue, I want to set some expectations. The point of this...

Overview 

Apache Beam is a unified programming model and the name Beam means Batch + strEAM. It is good at processing both batch and streaming data and can be run on different runners, such as Google Dataflow, Apache Spark, and Apache Flink. The Beam programming guide documents on how to develop a pipeline and the ...

Overview

Apache Kafka allows both local and cloud deployment so you can publish data from on premise environment and trigger services in the cloud. It is at the heart of our stacks that require real time processing. Confluent KSQL (streaming engine) allows stream processing in a simple and interactive SQL interface...