SelfHostLLM
SelfHostLLM is a specialized GPU memory calculator designed to help users efficiently plan and manage the resources needed for self-hosted large language model (LLM) inference. It supports popular models such as Llama, Qwen, DeepSeek, and Mistral, enabling users to estimate GPU VRAM requirements and the maximum number of concurrent requests their hardware can handle. By factoring in model size, quantization, context length, and system overhead, SelfHostLLM provides a detailed breakdown of memory usage, helping developers and AI infrastructure planners optimize deployment configurations. This tool is essential for anyone running LLMs locally or on private servers, ensuring cost-effective and performant AI inference without over-provisioning hardware. With its clear formulas and step-by-step calculations, SelfHostLLM empowers users to make informed decisions about GPU allocation, model selection, and expected throughput, bridging the gap between complex AI models and practical hardware constraints.
Share your honest experience with SelfHostLLM
Website
selfhostllm.orgCategory
Open SourceTags
Website Threat Scanner
Website Threat Scanner is a powerful web-based security tool designed to analyze websites for common vulnerabilities and security risks. It helps website owners, developers, and security professionals identify critical issues such as SQL Injection, Cross-Site Scripting (XSS), exposed API keys, personal information leaks, Cross-Site Request Forgery (CSRF), insecure cookies, directory traversal, command injection, exposed webhooks, and SSL/TLS misconfigurations. By scanning a website URL, the tool provides a comprehensive overview of potential security threats, enabling users to proactively protect their web assets from attacks and data breaches. Its user-friendly interface and real-time scanning capabilities make it an essential resource for maintaining robust web security and ensuring compliance with best practices. Website Threat Scanner empowers users to detect vulnerabilities early, reduce risk exposure, and strengthen their overall cybersecurity posture.
Autumn
Autumn is a streamlined and flexible platform designed to simplify pricing and billing for app founders, especially AI startups. By integrating directly with Stripe, Autumn enables users to effortlessly set up and manage complex pricing models with just a few functions. The platform supports tracking usage limits, managing feature entitlements, credits, and add-ons, providing comprehensive control over monetization strategies. Autumn’s intuitive approach reduces the complexity of payment infrastructure, allowing developers to focus on building their products rather than handling billing logistics. Its seamless integration and developer-friendly API make it an ideal solution for startups looking to scale efficiently while maintaining precise control over customer billing and feature access. Autumn effectively bridges the gap between product development and payment management, making Stripe easy and accessible for AI-driven businesses.
ResumeLink
ResumeLink is a powerful web application designed to transform your resume, CV, and portfolio into a professional, mobile-responsive website instantly. With over 100+ customizable templates, ResumeLink enables users to create visually appealing and SEO-optimized personal websites without any design or coding skills. The platform focuses on making resumes ATS-friendly, ensuring compatibility with applicant tracking systems to improve job application success rates. ResumeLink caters to job seekers and professionals who want to showcase their skills, experience, and projects online in a polished and accessible format. By offering a free, easy-to-use interface, ResumeLink streamlines the resume-building process, allowing users to quickly generate and share their personal brand with potential employers and recruiters worldwide. Its cloud-based service supports instant publishing and sharing, making it an ideal tool for career advancement and personal marketing.
Puck
Puck is an open-source visual editor designed specifically for React applications. It empowers developers to seamlessly integrate powerful visual editing capabilities into their own React projects, enabling the creation of intuitive and dynamic content editing experiences. By leveraging Puck, teams can build next-generation content tools that simplify the process of managing and customizing UI components without sacrificing developer control or flexibility. The editor supports a highly customizable and extensible architecture, making it ideal for a wide range of use cases, from content management systems to complex web applications. Puck’s open-source nature encourages community collaboration and continuous improvement, ensuring it evolves alongside the React ecosystem. Its focus on developer experience and user-friendly interfaces helps bridge the gap between design and development, accelerating workflows and enhancing productivity. Overall, Puck serves as a robust foundation for building sophisticated visual editing solutions that integrate deeply with React’s component model.
A2A Registry
A2A Registry is a community-driven directory that hosts live, production-ready AI agents compliant with the A2A (Agent-to-Agent) Protocol. It enables developers and organizations to easily discover, explore, and integrate AI agents that communicate seamlessly using a standardized protocol. The registry provides detailed information about each agent, including capabilities and integration examples, facilitating smooth adoption and interoperability. With Python SDK support, developers can connect to these agents programmatically, accelerating AI integration workflows. The platform promotes transparency and collaboration by listing verified agents and offering open access to the registry and client tools. A2A Registry serves as a vital resource for anyone looking to leverage AI agents in real-world applications, fostering an ecosystem where AI agents can interact, cooperate, and deliver enhanced automation and intelligence across diverse domains.
mcp-use
MCP-USE is an open source software development kit (SDK) and infrastructure platform designed to facilitate the deployment and management of MCP (Multi-Channel Protocol) servers and agents. It provides developers and organizations with the tools necessary to build scalable, reliable, and efficient MCP-based communication systems. By leveraging MCP-USE, users can easily integrate multiple communication channels, automate messaging workflows, and maintain robust server-agent interactions. The platform emphasizes open source principles, ensuring transparency, flexibility, and community-driven enhancements. MCP-USE is ideal for applications requiring multi-channel communication capabilities, such as customer support systems, IoT device management, and distributed messaging networks. Its modular architecture and comprehensive SDK enable rapid development and seamless integration into existing infrastructures, making it a valuable resource for developers aiming to implement advanced communication protocols with minimal overhead.