Search results

feat: introduce a ComputeBackend seam to abstract the forward-execution engine

area:architectureArchitecture and code structure changesArchitecture and code structure changes

priority:mediumMedium priorityMedium priority

status:readyReady to be worked onReady to be worked on

type:enhancementNew features, capabilities, or significant additionsNew features, capabilities, or significant additions

Status: Open.

#338 In lablup/mlxcel;

· inureyes opened on Jun 17, 2026

perf(inference): adaptive MTP enable/decline policy from per-pair profiling

area:inferenceGeneration, sampling, decoding (incl. speculative, DRY)Generation, sampling, decoding (incl. speculative, DRY)

priority:lowLow priorityLow priority

type:performancePerformance improvementsPerformance improvements

Status: Open.

#333 In lablup/mlxcel;

· inureyes opened on Jun 17, 2026

perf(server): split batched prefill into compatible cohorts instead of all-or-nothing fallback

area:coremlxcel-core: MLX FFI, primitives, KV cache, layersmlxcel-core: MLX FFI, primitives, KV cache, layers

area:inferenceGeneration, sampling, decoding (incl. speculative, DRY)Generation, sampling, decoding (incl. speculative, DRY)

priority:mediumMedium priorityMedium priority

type:performancePerformance improvementsPerformance improvements

Status: Open.

#332 In lablup/mlxcel;

· inureyes opened on Jun 17, 2026

perf(core): adaptive selector for the native paged-attention decode kernel

area:coremlxcel-core: MLX FFI, primitives, KV cache, layersmlxcel-core: MLX FFI, primitives, KV cache, layers

area:inferenceGeneration, sampling, decoding (incl. speculative, DRY)Generation, sampling, decoding (incl. speculative, DRY)

priority:mediumMedium priorityMedium priority

type:performancePerformance improvementsPerformance improvements

Status: Open.

#331 In lablup/mlxcel;

· inureyes opened on Jun 17, 2026

perf(moe): backend-aware fused-MoE Dff cap (CUDA crossover) and dispatch heuristic

area:coremlxcel-core: MLX FFI, primitives, KV cache, layersmlxcel-core: MLX FFI, primitives, KV cache, layers

area:modelsModel architectures, weights, loading, metadataModel architectures, weights, loading, metadata

priority:mediumMedium priorityMedium priority

type:performancePerformance improvementsPerformance improvements

Status: Open.

#330 In lablup/mlxcel;

· inureyes opened on Jun 17, 2026

fix(olmoe): OLMoE-1B-7B produces corrupted/degenerate output beyond the q_norm fix (pre-existing, not MoE-related)

area:inferenceGeneration, sampling, decoding (incl. speculative, DRY)Generation, sampling, decoding (incl. speculative, DRY)

area:modelsModel architectures, weights, loading, metadataModel architectures, weights, loading, metadata

platform:macosmacOS (Apple Silicon) specificmacOS (Apple Silicon) specific

priority:highHigh priorityHigh priority

status:readyReady to be worked onReady to be worked on

type:bugBug fixes, error corrections, or issue resolutionsBug fixes, error corrections, or issue resolutions

Status: Open.

#318 In lablup/mlxcel;

· inureyes opened on Jun 16, 2026

perf(moe): wire minimax to the fused decode-MoE kernel

area:inferenceGeneration, sampling, decoding (incl. speculative, DRY)Generation, sampling, decoding (incl. speculative, DRY)

area:modelsModel architectures, weights, loading, metadataModel architectures, weights, loading, metadata

platform:macosmacOS (Apple Silicon) specificmacOS (Apple Silicon) specific

priority:lowLow priorityLow priority

status:blockedBlocked by dependencies or other issuesBlocked by dependencies or other issues

type:performancePerformance improvementsPerformance improvements

Status: Open.

#304 In lablup/mlxcel;

· inureyes opened on Jun 16, 2026

perf(nemotron-h): decode gap is MoE-block op-density (routed + shared expert), not SSM/attention

area:inferenceGeneration, sampling, decoding (incl. speculative, DRY)Generation, sampling, decoding (incl. speculative, DRY)

area:modelsModel architectures, weights, loading, metadataModel architectures, weights, loading, metadata

platform:macosmacOS (Apple Silicon) specificmacOS (Apple Silicon) specific

priority:mediumMedium priorityMedium priority

type:performancePerformance improvementsPerformance improvements

Status: Open.

#284 In lablup/mlxcel;

· inureyes opened on Jun 14, 2026

chore: Bump mlxcel-core to Rust edition 2024 to match the root crate

priority:lowLow priorityLow priority

status:readyReady to be worked onReady to be worked on

type:choreMaintenance tasks (build, CI, etc.)Maintenance tasks (build, CI, etc.)

Status: Open.

#272 In lablup/mlxcel;

· inureyes opened on Jun 13, 2026

perf(models): apertus and seed_oss dense decode at ~0.83x of mlx-lm

area:inferenceGeneration, sampling, decoding (incl. speculative, DRY)Generation, sampling, decoding (incl. speculative, DRY)

area:modelsModel architectures, weights, loading, metadataModel architectures, weights, loading, metadata

platform:macosmacOS (Apple Silicon) specificmacOS (Apple Silicon) specific

priority:lowLow priorityLow priority

status:readyReady to be worked onReady to be worked on

type:performancePerformance improvementsPerformance improvements

Status: Open.

#269 In lablup/mlxcel;

· inureyes opened on Jun 13, 2026

perf(models): general MoE decode gap vs mlx-lm (dots.llm1 0.51x, qwen3_moe 0.69x, nemotron MoE)

area:inferenceGeneration, sampling, decoding (incl. speculative, DRY)Generation, sampling, decoding (incl. speculative, DRY)

area:modelsModel architectures, weights, loading, metadataModel architectures, weights, loading, metadata

platform:macosmacOS (Apple Silicon) specificmacOS (Apple Silicon) specific

priority:mediumMedium priorityMedium priority

status:in-progressCurrently being worked onCurrently being worked on

type:performancePerformance improvementsPerformance improvements

Status: Open.

#268 In lablup/mlxcel;

· inureyes opened on Jun 13, 2026

Disaggregated serving: multi-node routing, load balancing, and failover

area:architectureArchitecture and code structure changesArchitecture and code structure changes

priority:mediumMedium priorityMedium priority

status:readyReady to be worked onReady to be worked on

type:enhancementNew features, capabilities, or significant additionsNew features, capabilities, or significant additions

Status: Open.

#201 In lablup/mlxcel;

· inureyes opened on Jun 9, 2026