Cloud & Engineering

We regularly write about our technical experiences (good and bad) and what we're learning from the market.

  • There are no suggestions because the search field is empty.

Tags

Simplify Stream Processing With Serverless Apache Flink® From Confluent and Deloitte

Posted by Thaddeus Treloar on 19 March 2024

In today's hyperconnected world, businesses are inundated with vast amounts of data streaming in from a multitude of sources at unprecedented speeds. From customer interactions to machine-generated telemetry data, the sheer volume and velocity of this data present both opportunities and challenges for organisations...

Continue reading

Integrating CRM Dynamics 365 with Downstream Systems Using Events

Posted by Mae Decelo on 17 November 2023

Integration, mule, mulesoft

Context

A common requirement often encountered when implementing a system of record (SOR) is to allow near real-time dissemination of a record change to disparate systems. One example of a SOR is customer relationship management (CRM), which is responsible for maintaining records about an organisation’s customers.

Continue reading

Azure Data Factory - CICD with YAML Pipelines

Posted by Shane Wei on 17 October 2023

CICD, Azure Pipelines, Azure Data Factory

Introduction Overview

Azure Data Factory (ADF) is Azure's cloud ETL service for scale-out serverless data integration and data transformation. It has a code-free UI with many maintenance-free connectors, allowing it to be maintained by non-coders. No matter how much or little code is needed for the ADF, it is still...

Continue reading

Assessing Azure API Management Authorisation Approaches

Posted by Paco de la Cruz on 24 April 2023

Azure, Azure API Management, api, security, OAuth 2.0

Introduction

As part of consulting engagements, it is common that customers ask for guidance on the different authentication and authorisation approaches available on API Management and how these approaches meet their security needs while offering support to existing legacy API clients. While many people now know...

Continue reading

Bicep deployment of an Azure Data Factory with source control

Posted by Aaron Douglas on 18 April 2023

Azure Key Vault, Azure Bicep, Azure Data Factory

Introduction

My first introduction to Azure Bicep involved creating a large repository of Azure Bicep deployment templates. I was able to see firsthand the benefits of using Bicep to simplify Azure deployments. Recently I have utilised Azure Data Factory (ADF) for integrating a new enterprise solution. It is an...

Continue reading

Avoid the Robot Spaghetti Machine

Posted by Saul Caganoff on 04 April 2023

Architecture, governance, AI, ChatGPT

With the recent release of GPT-4, many people are voicing concern about the impact of AI on the job market. A Goldman Sachs report concluded that up to two-thirds of white-collar jobs are open to partial automation through AI. They argue that this is overall good news for global productivity.

Programming is forecast...

Continue reading

Cloud Migration Factory - Automated, Innovative and Agile

Posted by Gaurav Sapra AND Varun Karthik on 17 February 2023

Cloud Strategy, Digital Transformation, strategy, innovation, aws, agility, Infrastructure as Code, Solution Architecture, terraform, GitLab, Hybrid-cloud, governance, runsheet, customer-centric, Cloud Migrations

“Cloud Migration Factory increases the velocity of migration and helps provide discovery & planning guidelines with architectural best practices, automated tools & templates, collaboration with migration experts & different subject matter experts, with complete governance & reporting around all the different...

Continue reading

Assisted API Design with ChatGPT

Posted by Saul Caganoff on 01 February 2023

API Design, AI, ChatGPT

The Experiment

I recently tried an experiment using OpenAI's ChatGPT to design a simple OpenAPI specification. My aim was to exercise the following workflow which reflects my typical manual design process:

  • Start with a JSON Schema for a simple Business Entity comprising basic attributes and relationships with people...
Continue reading

Is It Time to Migrate to Isolated Azure Functions?

Posted by Emile Dawalibi on 23 November 2022

App Service Isolated, App Services, Azure, Azure Functions, Service Bus, ASP.NET Core, APIs, .NET, Isolated Azure Functions

Introduction

On November 10, 2020, Microsoft released .NET 5. But at that point in time, the current version of the Azure Functions runtime host (version 3.x) couldn’t support any code targeting .NET 5. That’s because version 3 of the runtime utilises NET Core 3.1, and therefore all the functions you code had to...

Continue reading

Effectively deploying a network-locked Function App – Part 3: App Service Environment v3

Posted by Abhinav Sharma on 21 October 2022

App Service Environment, Azure Functions, Microsoft Azure, cloud infrastructure

Overview

In the previous posts, I talked about different scenarios of deploying a Function App with a Consumption Plan and an App Service Plan in a network-locked architecture. In this post, I will cover a different architectural solution using App Service Environment v3. I will go through the complete deployment...

Continue reading