SelfHostLLM
SelfHostLLM is a specialized GPU memory calculator designed to help users efficiently plan and manage the resources needed for self-hosted large language model (LLM) inference. It supports popular models such as Llama, Qwen, DeepSeek, and Mistral, enabling users to estimate GPU VRAM requirements and the maximum number of concurrent requests their hardware can handle. By factoring in model size, quantization, context length, and system overhead, SelfHostLLM provides a detailed breakdown of memory usage, helping developers and AI infrastructure planners optimize deployment configurations. This tool is essential for anyone running LLMs locally or on private servers, ensuring cost-effective and performant AI inference without over-provisioning hardware. With its clear formulas and step-by-step calculations, SelfHostLLM empowers users to make informed decisions about GPU allocation, model selection, and expected throughput, bridging the gap between complex AI models and practical hardware constraints.
Share your honest experience with SelfHostLLM
Website
selfhostllm.orgCategory
Open SourceTags
A2A Registry
A2A Registry is a community-driven directory that hosts live, production-ready AI agents compliant with the A2A (Agent-to-Agent) Protocol. It enables developers and organizations to easily discover, explore, and integrate AI agents that communicate seamlessly using a standardized protocol. The registry provides detailed information about each agent, including capabilities and integration examples, facilitating smooth adoption and interoperability. With Python SDK support, developers can connect to these agents programmatically, accelerating AI integration workflows. The platform promotes transparency and collaboration by listing verified agents and offering open access to the registry and client tools. A2A Registry serves as a vital resource for anyone looking to leverage AI agents in real-world applications, fostering an ecosystem where AI agents can interact, cooperate, and deliver enhanced automation and intelligence across diverse domains.
Agentic Signal
Agentic Signal is a cutting-edge platform designed to empower users to build AI workflows visually with an emphasis on privacy and local execution. It enables developers, data scientists, and AI enthusiasts to create complex, extensible automation pipelines without relying on cloud services, ensuring that all data and processes remain fully local and secure. The platform supports a modular node ecosystem, allowing users to integrate various AI models, data sources, and custom logic into seamless workflows. By providing a visual interface for workflow construction, Agentic Signal lowers the barrier to entry for AI automation, making it accessible to a broader audience. Its architecture supports extensibility and customization, enabling users to tailor AI-driven solutions to their specific needs. With a focus on privacy, local intelligence, and ease of use, Agentic Signal is ideal for organizations and individuals seeking to harness AI capabilities while maintaining full control over their data and infrastructure.
AGENTS.md
AGENTS.md is an open, simple format designed to guide AI coding agents effectively. Serving as a README specifically for AI agents, it provides a structured and predictable way to deliver context and instructions to help these agents understand and work on coding projects. With adoption by over 20,000 open-source projects, AGENTS.md enables developers to streamline collaboration with AI by clearly defining tasks, goals, and relevant project information. This format enhances the productivity and accuracy of AI coding assistants by making their operational environment transparent and well-documented. By standardizing how AI agents receive guidance, AGENTS.md fosters better integration of AI into software development workflows, making it easier for teams to leverage AI capabilities in coding, debugging, and project management.
Compozy
Compozy is a next-level agentic orchestration platform designed to empower organizations by automating and managing complex workflows involving multiple AI agents. It enables seamless coordination, task delegation, and execution across diverse AI systems, enhancing productivity and operational efficiency. By leveraging advanced orchestration capabilities, Compozy facilitates intelligent automation that adapts dynamically to evolving business needs. The platform is ideal for enterprises seeking to streamline processes, improve decision-making, and scale AI-driven initiatives without manual intervention. With a focus on agentic autonomy, Compozy supports sophisticated multi-agent collaboration, enabling users to orchestrate AI workflows that handle intricate tasks and workflows end-to-end. Its intuitive interface and robust architecture make it a powerful tool for developers, businesses, and AI practitioners aiming to harness the full potential of AI orchestration in real-world applications.
Ikiform
Ikiform is an open-source form builder designed as a powerful alternative to popular platforms like Google Forms and Typeform. It enables users to create beautiful, interactive, and customizable forms and surveys with ease. Ikiform focuses on providing a budget-friendly solution without compromising on features or user experience. With Ikiform, users can effortlessly build questionnaires, collect responses, and analyze data in a streamlined manner. Its open-source nature offers flexibility and transparency, allowing developers and organizations to tailor the platform to their specific needs. Ikiform is ideal for businesses, educators, and developers seeking a reliable, privacy-conscious, and extensible form creation tool. It supports a variety of use cases including customer feedback, event registrations, market research, and more, making data collection simple and efficient.
Autumn
Autumn is a streamlined and flexible platform designed to simplify pricing and billing for app founders, especially AI startups. By integrating directly with Stripe, Autumn enables users to effortlessly set up and manage complex pricing models with just a few functions. The platform supports tracking usage limits, managing feature entitlements, credits, and add-ons, providing comprehensive control over monetization strategies. Autumn’s intuitive approach reduces the complexity of payment infrastructure, allowing developers to focus on building their products rather than handling billing logistics. Its seamless integration and developer-friendly API make it an ideal solution for startups looking to scale efficiently while maintaining precise control over customer billing and feature access. Autumn effectively bridges the gap between product development and payment management, making Stripe easy and accessible for AI-driven businesses.