Skip to content
View Arifuzzamanjoy's full-sized avatar
🏠
Working from home
🏠
Working from home

Block or report Arifuzzamanjoy

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Arifuzzamanjoy/README.md

Arifuzzaman Joy

I put LLM and AI-agent systems into production on serverless and rented GPUs, for a fraction of what the managed APIs cost.

Upwork

Email · LinkedIn · Portfolio · Scholar · Hugging Face · ORCID


Anyone can claim GPU experience. Here's what you can click on:

14 PRs merged into Osmantic/ODS a 4.6k-star self-hosted AI server platform
Merged into casys-kaist/LLMServingSim LLM-serving simulator from a KAIST research lab
Featured extension in Gen-Verse/LatentMAS official repo of an ICML 2026 Spotlight paper
5 papers, 75 citations, h-index 5 Google Scholar

What I actually do all day

Most of it is unglamorous. The Dockerfile that builds on the first try. The installer that survives a Vast.ai box shipping the wrong CUDA driver. The health check that had been quietly dropping half your services since March and nobody noticed.

I came up through research before infrastructure, which mostly means I can read a paper on Monday and have it deployed by Friday instead of bookmarking it and feeling good about myself.

People hire me to:

  • Deploy models as serverless GPU endpoints on RunPod, Modal, or Vast.ai. Dockerized, CI/CD, autoscaled down to near-zero idle cost.
  • Build RAG and document pipelines that can prove they work: retrieval, citation tracking, multi-hop reasoning, LLM-as-judge evals so "it feels better" becomes a number.
  • Stand up multi-agent systems, including latent-space designs where agents pass hidden states instead of burning tokens regenerating text.
  • Serve hot-swappable LoRA adapters off one base model, routed by domain. I train the adapters too.
  • Rescue deployments that almost work. Multi-GPU OOM, driver mismatch, topology-aware placement, squeezing a model onto a card that shouldn't fit it.

Three things I built, and what was hard about them

Health checks that don't lie · ODS #1343

ODS assumed every service spoke HTTP. Anything exposing only TCP or a CLI failed its health check, got marked dead, and disappeared from the dashboard without an error anyone would see. Silent data loss, basically, but for services.

I threaded a health_type: http|tcp|none field through the whole stack: JSON schema, catalog generator, dashboard API, and the shell scripts underneath. The interesting part wasn't the feature, it was the migration. Dozens of existing manifests had to keep working untouched, so the default had to infer correctly from what was already declared.

Same codebase, also merged: a node diagnostics endpoint for runtime hardware introspection, gpu_backends schema validation, and compatibility blocks across 25 manifests.

Agents that think without talking · LatentMAS-SLoRA

Multi-agent systems waste enormous money re-serializing thoughts into English so the next agent can re-parse them. LatentMAS (ICML 2026 Spotlight) showed you can skip that and pass hidden states directly.

I extended it with role-specialized LoRA adapters that hot-swap at runtime, so one base model plays Planner, Critic, Refiner, and Judger without four sets of weights in VRAM. Critic and Refiner never generate a token, about 200ms each. Ships with VLM support on Qwen2.5-VL-7B, RAG integration, and a RunPod serverless deployment with CI/CD.

The authors added it to their README as community extension #5, next to work from MIT's LAMM group. Demo video.

The README is also explicit about what it isn't: PEFT-based adapter management, not true S-LoRA. No custom CUDA paging kernels, no heterogeneous batching. I'd rather you read that there than discover it on a call.

Making rented GPUs behave · ODS #983

Vast.ai and similar marketplaces hand you a box that is technically the GPU you paid for and broken in a dozen quiet ways. Wrong driver, missing ACLs, a container runtime that isn't wired up.

I wrote a multi-phase hardened installer for it: set -euo pipefail throughout, hard-fail ACL checks, GPU-tier detection, and roughly 28 documented host-environment failure modes with the fix for each. That documentation was most of the value. Anyone can write the happy path.


What I want to work on

I care where this ends up. My research has been in solar cell optimization and medical imaging, and the client work I chase is in health, energy, education, and scientific tooling. Good rates matter, I'm not shy about that. But I do the best work when the thing being built has some reason to exist beyond a funding round.

If that's what you're building, lead with it.


Projects

Project What it is Stack
LatentMAS-SLoRA Multi-agent reasoning, dynamic LoRA routing, latent-space collaboration PyTorch, PEFT, Qwen2.5-VL, RunPod
gpu-broker-mcp MCP server brokering GPU compute for agents. Discover, reserve, dispatch, poll, with no SSH keys or provider APIs to manage MCP, Python, Streamable HTTP
RAG + LLM-as-Judge Eval Retrieval over URL/JSON/CSV with citation tracking and automated evaluation Python, embeddings, evals
Wan 2.2 Multi-GPU Topology-aware multi-GPU video pipeline, per-GPU VRAM capping to kill multi-GPU OOM torch.distributed, FSDP, Gradio
FLUX.2 klein Worker Serverless text-to-image and image-to-image, near-zero idle cost RunPod, Docker, Flux
WordPress Cloner Async site cloner, 8-signal WP detection, REST extraction, WXR export. Packaged with tests and CI Python, aiohttp
Whisper Worker Speech-to-text as a scalable on-demand endpoint Whisper, RunPod
Diffusion Serverless Ecosystem End-to-end serverless diffusion inference, Dockerized with CI/CD Diffusers, Docker
More: LoRA training, Bangla NLP, low-VRAM inference
Project What it does
Flux LoRA Studio Self-hosted Flux LoRA platform, A40 48GB through H200, 4-bit quantization and batch inference
Self-Hosted AI Starter Kit Low-cost CPU-friendly self-hosting with secure external sharing
bangladeshi-tts-finetuning Fine-tuning TTS for Bangla speech
bangla-punctuation-restoration Transformer-based punctuation restoration for Bangla
time-series forecasting Modern forecasting model implementations
Wan2GP Low-VRAM video generation for consumer GPUs
Ltx-Image-to-Video Image-to-video with a Gradio interface

Stack

GPU & serving — RunPod, Modal, Vast.ai, vLLM, Docker, Docker Compose, torch.distributed, FSDP, 4-bit quantization

LLM & agents — PyTorch, Transformers, PEFT/LoRA, LangChain, MCP, RAG, LLM-as-judge evaluation, Qwen2.5-VL

Backend & ops — Python, FastAPI, Bash, GitHub Actions, pytest, ShellCheck, SQL, MongoDB

Also — Diffusers, TensorFlow, JavaScript, TypeScript, Git


Research

5 peer-reviewed papers · 75 citations · h-index 5Scholar · ORCID · ResearchGate

Paper Venue Year
ML-assisted revelation of the best-performing single heterojunction thermophotovoltaic cell Sustainable Energy Technologies & Assessments (Elsevier), Q1 2025
ML-enabled performance exploration of AuCuSe₄ in a thermophotovoltaic cell Solar Energy (Elsevier), Q1 2024
Numerical studies on a ternary AgInTe₂ chalcopyrite thin-film solar cell · first author Heliyon (Cell Press), Q1 2023
Numerical prediction of PV performance of a CZTS-based thin-film solar cell Nano Select (Wiley), Q2 2023
Open-source transformers in medical imaging — brain MRI, 99.60% accuracy, 0.90 Dice IJACSA 2024

Quartiles follow the latest JCR/Scopus release and vary by database and subject category.

B.Sc. Electrical & Electronic Engineering, University of Rajshahi (AI & Solar Energy Laboratory). SQL Advanced and REST API Intermediate (HackerRank), Deep Learning with TensorFlow (IBM), Prompt Engineering (Vanderbilt).


Got a model that needs to go live?

Send the model, your latency target, and the budget. You'll get a straight answer about what it takes, including when the answer is that you don't need me.

Upwork Email

Pinned Loading

  1. latent_mas_slora latent_mas_slora Public

    Python 6

  2. Osmantic/ODS Osmantic/ODS Public

    Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

    Python 5.1k 753

  3. casys-kaist/LLMServingSim casys-kaist/LLMServingSim Public

    LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure

    Python 380 103