Pipelines to Prompts: Getting started with Databricks and AWS
Author(s): Devi Originally published on Towards AI. A Beginner’s Guide to Building GenAI Applications from Raw Data Using Databricks and AWS As with my other blogs, we start with the theory, practice, and wrap up with some lessons learnt. NAVIGATION: Why Data …
The Data Stack for AI: RDBMS, Graph, and HTAP
Author(s): Vicky’s Notes Originally published on Towards AI. Earlier this year, I was working with an insurance client who was eager to adopt generative AI to improve customer engagement, but they kept hitting a wall. The AI models were fine; the real …
Beyond Pandas: The Modern Data Processing Toolkit for Data Engineering (Part 1)
Author(s): Gift Ojeabulu Originally published on Towards AI. Image by author Outline Introduction The Data Size Decision Framework & Comprehensive Decision Flowchart A Diagrammatic representation based on Team Syntax Preference, and Performance or Integration Requirements Real-World Examples: Log file Analysis, E-commerce instance …
Premium SSD vs Ultra SSD: Azure Storage Performance for Distributed Databases
Author(s): Richie Bachala Originally published on Towards AI. When building distributed systems in the cloud, storage performance can make or break your application’s success. In this post, we’ll explore how different Azure disk types perform under distributed database workloads, using YugabyteDB as …
Premium SSD vs Ultra SSD: Azure Storage Performance for Distributed Databases
Author(s): Richie Bachala Originally published on Towards AI. When building distributed systems in the cloud, storage performance can make or break your application’s success. In this post, we’ll explore how different Azure disk types perform under distributed database workloads, using YugabyteDB as …
When Scripts Aren’t Enough: Building Sustainable Enterprise Data Quality
Author(s): Richie Bachala Originally published on Towards AI. Beyond Scale: Data Quality for AI Infrastructure The trajectory of AI over the past decade has been driven largely by the scale of data available for training and the ability to process it with …
Anyone Can Build GenAI Apps
Author(s): Jiazhen Zhu Originally published on Towards AI. written by Jiazhen Zhu, Michael Pfaffenberger, Wallace Dalmet, Sriram Ranganathan, Ahmed Noufel, and Anveshrithaa Sundareswaran Photo credit: Pixabay We conducted a brown bag session at the Walmart Global Tech Reston site to discuss this …
Conditional (Case When) Statements in SQL
Author(s): Kamireddy Mahendra Originally published on Towards AI. A Must-Know Concept to Work in the Real World Projects This member-only story is on us. Upgrade to access all of Medium. Image by author In real-world projects, It’s necessary to understand that the …
How to Build Your First Data Engineering Project Step by Step?
Author(s): Nishtha Nagar Originally published on Towards AI. How to Build Your First Data Engineering Project Step by Step? “Data engineering is the bridge that connects broad business goals with detailed technical implementation.” — Michael Hausenblas. Did you know that by 2026, …
Why Every Health Data Scientist Should Know About OMOP CDM
Author(s): Mazen Ahmed Originally published on Towards AI. Standardising Healthcare Data This member-only story is on us. Upgrade to access all of Medium. Image by Author A large issue I struggle with at work is standardising healthcare data. I gather data from …
Innovations in Analytics: Elevating Data Quality with GenAI
Author(s): Jonas Dieckmann Originally published on Towards AI. Data analytics has become a key driver of commercial success in recent years. The ability to turn large data sets into actionable insights can mean the difference between a successful campaign and missed opportunities. …
Demystifying Google’s Data Gemma
Author(s): Chirag Agrawal Originally published on Towards AI. Photo by Alvaro Reyes on Unsplash Discover how Google’s Data Gemma leverages the Data Commons knowledge graph to tackle AI hallucinations. In this blog post, we’ll explore how Data Gemma aims to improve the …
How I’d Learn to Become a Data Engineer in 2025.
Author(s): Kamireddy Mahendra Originally published on Towards AI. A Clear Guide, If I could start over again from the beginning. This member-only story is on us. Upgrade to access all of Medium. Photo by ThisisEngineering on Unsplash My journey into the world …
What are Vector Databases?
Author(s): Ayo Akinkugbe Originally published on Towards AI. Photo by おにぎり on Unsplash Introduction Vector databases are databases designed specifically for storing vector embeddings. If a vector is a data representation having magnitude and direction, what then are vector embeddings? Vector embeddings …
Build and Run Data Pipelines with Sagemaker Pipelines
Author(s): Jake Teo Originally published on Towards AI. Leverage AWS’s MLOps Platform to run on your large data processing workloads seamlesslyImage from Amazon’s sagemaker official website [1] In this article, I will show how you can run long-running, repetitive, centrally managed and …
Recent Posts
