SelfHostLLM
SelfHostLLM is a specialized GPU memory calculator designed to help users efficiently plan and manage the resources needed for self-hosted large language model (LLM) inference. It supports popular models such as Llama, Qwen, DeepSeek, and Mistral, enabling users to estimate GPU VRAM requirements and the maximum number of concurrent requests their hardware can handle. By factoring in model size, quantization, context length, and system overhead, SelfHostLLM provides a detailed breakdown of memory usage, helping developers and AI infrastructure planners optimize deployment configurations. This tool is essential for anyone running LLMs locally or on private servers, ensuring cost-effective and performant AI inference without over-provisioning hardware. With its clear formulas and step-by-step calculations, SelfHostLLM empowers users to make informed decisions about GPU allocation, model selection, and expected throughput, bridging the gap between complex AI models and practical hardware constraints.
Share your honest experience with SelfHostLLM
Website
selfhostllm.orgCategory
Open SourceTags
Ikiform
Ikiform is an open-source form builder designed as a powerful alternative to popular platforms like Google Forms and Typeform. It enables users to create beautiful, interactive, and customizable forms and surveys with ease. Ikiform focuses on providing a budget-friendly solution without compromising on features or user experience. With Ikiform, users can effortlessly build questionnaires, collect responses, and analyze data in a streamlined manner. Its open-source nature offers flexibility and transparency, allowing developers and organizations to tailor the platform to their specific needs. Ikiform is ideal for businesses, educators, and developers seeking a reliable, privacy-conscious, and extensible form creation tool. It supports a variety of use cases including customer feedback, event registrations, market research, and more, making data collection simple and efficient.
Agentic Signal
Agentic Signal is a cutting-edge platform designed to empower users to build AI workflows visually with an emphasis on privacy and local execution. It enables developers, data scientists, and AI enthusiasts to create complex, extensible automation pipelines without relying on cloud services, ensuring that all data and processes remain fully local and secure. The platform supports a modular node ecosystem, allowing users to integrate various AI models, data sources, and custom logic into seamless workflows. By providing a visual interface for workflow construction, Agentic Signal lowers the barrier to entry for AI automation, making it accessible to a broader audience. Its architecture supports extensibility and customization, enabling users to tailor AI-driven solutions to their specific needs. With a focus on privacy, local intelligence, and ease of use, Agentic Signal is ideal for organizations and individuals seeking to harness AI capabilities while maintaining full control over their data and infrastructure.
mcp-use
MCP-USE is an open source software development kit (SDK) and infrastructure platform designed to facilitate the deployment and management of MCP (Multi-Channel Protocol) servers and agents. It provides developers and organizations with the tools necessary to build scalable, reliable, and efficient MCP-based communication systems. By leveraging MCP-USE, users can easily integrate multiple communication channels, automate messaging workflows, and maintain robust server-agent interactions. The platform emphasizes open source principles, ensuring transparency, flexibility, and community-driven enhancements. MCP-USE is ideal for applications requiring multi-channel communication capabilities, such as customer support systems, IoT device management, and distributed messaging networks. Its modular architecture and comprehensive SDK enable rapid development and seamless integration into existing infrastructures, making it a valuable resource for developers aiming to implement advanced communication protocols with minimal overhead.
AGENTS.md
AGENTS.md is an open, simple format designed to guide AI coding agents effectively. Serving as a README specifically for AI agents, it provides a structured and predictable way to deliver context and instructions to help these agents understand and work on coding projects. With adoption by over 20,000 open-source projects, AGENTS.md enables developers to streamline collaboration with AI by clearly defining tasks, goals, and relevant project information. This format enhances the productivity and accuracy of AI coding assistants by making their operational environment transparent and well-documented. By standardizing how AI agents receive guidance, AGENTS.md fosters better integration of AI into software development workflows, making it easier for teams to leverage AI capabilities in coding, debugging, and project management.
Polyglot STEM Buddy
Polyglot STEM Buddy is an open-source educational web application designed to simplify STEM learning for users of all ages by providing multilingual support. It aims to make science, technology, engineering, and mathematics accessible to a diverse global audience by offering content in multiple languages, breaking down language barriers in education. The platform features an intuitive interface where users can select their age group and preferred language, ensuring a personalized and inclusive learning experience. By combining interactive STEM content with language accessibility, Polyglot STEM Buddy empowers learners worldwide to engage with complex subjects in a way that suits their linguistic and developmental needs. Its focus on ease of use and broad accessibility makes it an ideal tool for educators, students, and self-learners seeking to enhance their STEM knowledge across different languages and cultures.
Compozy
Compozy is a next-level agentic orchestration platform designed to empower organizations by automating and managing complex workflows involving multiple AI agents. It enables seamless coordination, task delegation, and execution across diverse AI systems, enhancing productivity and operational efficiency. By leveraging advanced orchestration capabilities, Compozy facilitates intelligent automation that adapts dynamically to evolving business needs. The platform is ideal for enterprises seeking to streamline processes, improve decision-making, and scale AI-driven initiatives without manual intervention. With a focus on agentic autonomy, Compozy supports sophisticated multi-agent collaboration, enabling users to orchestrate AI workflows that handle intricate tasks and workflows end-to-end. Its intuitive interface and robust architecture make it a powerful tool for developers, businesses, and AI practitioners aiming to harness the full potential of AI orchestration in real-world applications.