Skip to content

About

Infrastructure observability project with Go services, a Python/FastAPI AI engine, a Next.js dashboard and Docker-based local infrastructure.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

57 Commits

Folders and files

Repository files navigation

InfraWhisper

AI-Powered Kubernetes Infrastructure Observability Platform

Go Next.js ClickHouse Kafka License

Real-time monitoring, anomaly detection, and intelligent alerting for Kubernetes clusters.


About

InfraWhisper is an AI-powered observability SaaS platform designed to monitor Kubernetes infrastructure in real time. It collects metrics, logs, and traces from your clusters, detects anomalies using intelligent algorithms, and delivers actionable alerts — all through an intuitive Next.js dashboard with an AI query copilot.

Whether you're managing a single cluster or scaling across multiple environments, InfraWhisper gives you deep visibility into your infrastructure's health, performance, and cost.


Key Features

  • Real-Time Monitoring — Collect metrics, logs, and traces via OTLP gRPC from Kubernetes nodes
  • Anomaly Detection — Welford-based statistical anomaly detection on streaming data
  • AI Query Copilot — Natural language interface to ask questions about your infrastructure
  • Intelligent Alerting — Configurable alert rules with real-time evaluation and notifications
  • WebSocket Live Feeds — Instant updates pushed to the dashboard via Redis pub/sub
  • Multi-Tenant — Full tenant isolation enforced at every storage layer
  • Cost Tracking — Monitor and analyze infrastructure costs across clusters

Architecture

K8s Nodes → Rust Agent → OTLP gRPC → Collector → ClickHouse (raw storage)
                                              └→ Kafka → Stream Processor → Anomaly Detection
                                                                          └→ Alert Evaluation
                                                                          └→ Redis Pub/Sub → WebSocket → Dashboard

REST Clients → API Server → Postgres (metadata) / ClickHouse (queries) / Redis (cache)

Services

Service Description Port
API Server REST API (Chi router) + WebSocket hub 8080
Collector OTLP gRPC receiver → ClickHouse + Kafka 4317
Stream Processor Kafka consumer → anomaly detection + alerting —
Dashboard Next.js frontend with AI copilot 3000

Storage

Store Purpose Retention
PostgreSQL Clusters, tenants, users, incidents, alert rules Persistent
ClickHouse Metrics (30d), logs (7d), traces (7d), costs TTL-based
Redis Query cache, real-time pub/sub In-memory
Kafka Event streaming between services Configurable

Tech Stack

Layer Technology
Backend Go 1.23, Chi, pgx, Kafka, gRPC
Frontend Next.js 16, React, Tailwind CSS, TanStack Query
Databases PostgreSQL, ClickHouse, Redis
Messaging Apache Kafka
Infra Docker, Docker Compose

Quick Start

# Clone the repository
git clone https://github.com/mejba13/infrawhisper.git
cd infrawhisper

# One-command setup
bash scripts/dev-setup.sh

# Start dependencies (Postgres, ClickHouse, Redis, Kafka)
make docker-up

# Start the API server with hot reload
make dev

# Start the dashboard
cd dashboard && npm install && npm run dev

Build

# Build all binaries
make build

# Run tests
go test ./... -race -cover

# Lint
golangci-lint run ./...

Project Structure

infrawhisper/
├── cmd/                    # Service entry points
│   ├── api-server/         # HTTP REST API + WebSocket
│   ├── collector/          # OTLP gRPC receiver
│   └── stream-processor/   # Kafka consumer + anomaly detection
├── internal/               # Core packages
│   ├── api/                # Handlers, middleware, WebSocket hub
│   ├── auth/               # JWT, RBAC, context helpers
│   ├── collector/          # OTLP processing pipeline
│   ├── config/             # Viper config loading
│   ├── storage/            # Postgres, ClickHouse, Redis
│   └── stream/             # Kafka consumer/producer, anomaly detector
├── dashboard/              # Next.js frontend
├── migrations/             # Database migrations
├── scripts/                # Dev setup & utilities
└── docker-compose.yml      # Local dev dependencies

Developed By

engr-mejba-ahmed

Engr Mejba Ahmed

AI Developer | Software Engineer | Entrepreneur

Portfolio LinkedIn GitHub


Hire / Work With Me

I build AI-powered applications, mobile apps, and enterprise solutions. Let's bring your ideas to life!

Platform Description Link
Fiverr Custom builds, integrations, performance optimization fiverr.com/s/EgxYmWD
Mejba Personal Portfolio Full portfolio & contact mejba.me
Ramlit Limited Software development company ramlit.com
ColorPark Creative Agency UI/UX & creative solutions colorpark.io
xCyberSecurity Global cybersecurity services xcybersecurity.io

About

Infrastructure observability project with Go services, a Python/FastAPI AI engine, a Next.js dashboard and Docker-based local infrastructure.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages