Developer Portfolio

Akshat Rai Laddha

Software Engineer▌

Software Engineer who can work in sales, and Sales engineer who loves to build reliable software.

My work Contact me

Github LinkedIn Twitter Medium Mail

Hero image 20250902_145439 — Self hosted LLMs , built mini cluster on mac mini

Hero image 20251014_181648 — With Ismael Faro, VP AI Foundations Engineering at IBM Research

Hero image 20251017_090915 — with high rise in Dubai

Hero image 20251017_092745 — At GITEX AI Festival 2025, Dubai

Hero image IMG_7596 — I hike, Chandrashila trek Jan 2026

Hero image IMG-20231016-WA0120 — InterNIT Silver Medalist 2024 Badminton Captain

Hero image IMG-20241130-WA0032 — NITW Convocation Batch of 2024

Hero image IMG-20251014-WA0057 — With Ismael Faro, explaining the next edge innovation he was working on at IBM Research

Hero image IMG-20251016-WA0071 — With Managing director of a Healthcare Fortune 500 company on the sidelines of GITEX AI Festival 2025, Dubai

Hero image IMG-20251025-WA0042 — GITEX AI DUBAI 2025

Focus

AI systems, full-stack engineering, developer tooling.

Approach

Ship practical products with strong UX and measurable outcomes.

Open to work

Available for engineering roles and project collaborations.

Selected work

Projects

Blogs

I love to write and share my learnings, have a look at it maybe?

Self-Hosting LLaMA 70B on Apple Silicon Hardware with Exo and MLX

Running LLMs via AWS Bedrock or other managed services is convenient, but costs can spiral quickly once you scale to many queries. We faced this problem during one of our projects and decided to experiment with a self-hosted LLM system — first for R&D, then for broader internal use.

AILLaMAExoMLXApple Silicon

Sep 5, 2025Read on Medium

Kafka for E-commerce: A Practical Guide

Story of Kafka started with the utmost need of real time streaming platform. Wait what’s that? Platforms like Uber, Netflix etc. process trillions of datapoints every sec and every minute, both ingesting and exporting the data to users. But ever wondered how they engineer this requirement? They use a real-time streaming platform named Apache Kafka.

KafkaReal-time StreamingE-commerceData Engineeringservices Communication

Sep 5, 2025Read on Medium

My Linux Root Partition Was Full at 98%, Here’s How I Fixed It Without Reinstalling

The problem? My system’s disk space was booting from the wrong partition. All my new installations, downloads, and even system updates were trying to squeeze into that tiny 21GB partition. It was like trying to fit a whole library into a single bookshelf. No wonder it was always full! I needed to redirect my system to use the larger partition for its root directory, but how? After some research and trial-and-error, I found a solution that didn’t involve reinstalling my OS or losing any data.

LinuxSystem AdministrationData ManagementMemory Management

Apr 9, 2026Read on Medium

Let's build

Get in Touch

I am always open to discussing engineering opportunities, collaboration ideas, and product problems worth solving.

laddhaakshatrai@gmail.com