Lists (1)
Starred repositories
🌍 Terraform Model Context Protocol (MCP) Tool - An experimental CLI tool that enables AI assistants to manage and operate Terraform environments. Supports reading Terraform configurations, analyzin…
LLMPerf is a library for validating and benchmarking LLMs
The LLM API Benchmark Tool is a flexible Go-based utility designed to measure and analyze the performance of OpenAI-compatible API endpoints across different concurrency levels.
A collection of benchmarks and datasets for evaluating LLM.
Handy tool to measure the performance and efficiency of LLMs workloads.
go-gorm / bigquery
Forked from guypeled76/go-bigquery-driverBigQuery golang sql driver/GORM dialect
Stateful load balancer custom-tailored for llama.cpp 🏓🦙
Interactive Redis: A Terminal Client for Redis with AutoCompletion and Syntax Highlighting.
Finetune Qwen3, Llama 4, TTS, DeepSeek-R1 & Gemma 3 LLMs 2x faster with 70% less memory! 🦥
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
PyTorch native quantization and sparsity for training and inference
Create virtual machines and run Linux-based operating systems in Go using Apple Virtualization.framework.
Pretrained models for TensorFlow.js
Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and performing real-time speech generation.
AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highli…
LangChain for Go, the easiest way to write LLM-based programs in Go
Large Language Model Text Generation Inference
SGLang is a fast serving framework for large language models and vision language models.
A Go implementation of the Model Context Protocol (MCP), enabling seamless integration between LLM applications and external data sources and tools.
Open-source vector similarity search for Postgres
A plugin to edit and view Excalidraw drawings in Obsidian
⚙️ Convert HTML to Markdown. Even works with entire websites and can be extended through rules.