Technical Overview.

What is Bitflux

The goal of BitFlux is to let you squeeze more value out of your compute resources. The BitFlux solution provides the following benefits:

  • Actively improves EC2 instances efficiency
    • Smaller or fewer instances
    • Reduce your compute costs by up to 50%
  • Accurate sizing of EC2 instances
  • Better insight into your workload resource usage

Basic Solution Components

bitfluxeval

A readonly version of bitfluxd that runs on an EC2 instance to provide the user with memory usage statistics through the bitflux_mcp service.

AMI for AWS EC2 instances

The AMI is derived from the Ubuntu Server 24.04 LTS AMI modified to include:

  • A customized Linux kernel
  • The bitfluxd system service

The bitfluxd daemon runs as service using a high performance custom AI model to predict which memory isn't needed then instructs the custom kernel to proactively free it.

MCP server

To help the user interact with the instance for monitoring purposes the Model Contect Protocol server, bitflux_mcp, runs on the users local workstation and interacts with an AI agent to aid in querying the instance for memory usage statistics through the cloud service.

Cloud service

The cloud service is a gateway for the APIs the MCP server uses to interact with BitFlux on each instance. Using the MCP server your AI agent can identify your EC2 instances running bitfluxd and query them for memory usage statistics directly in realtime.

Open Source Code

Open Sourced patches and build scripts used to create the custom kernel build can be found at https://github.com/bitflux-ai/bitflux_kernel