SelfHostLLM
SelfHostLLM is a specialized GPU memory calculator designed to help users efficiently plan and manage the resources needed for self-hosted large language model (LLM) inference. It supports popular models such as Llama, Qwen, DeepSeek, and Mistral, enabling users to estimate GPU VRAM requirements and the maximum number of concurrent requests their hardware can handle. By factoring in model size, quantization, context length, and system overhead, SelfHostLLM provides a detailed breakdown of memory usage, helping developers and AI infrastructure planners optimize deployment configurations. This tool is essential for anyone running LLMs locally or on private servers, ensuring cost-effective and performant AI inference without over-provisioning hardware. With its clear formulas and step-by-step calculations, SelfHostLLM empowers users to make informed decisions about GPU allocation, model selection, and expected throughput, bridging the gap between complex AI models and practical hardware constraints.
Share your honest experience with SelfHostLLM
Website
selfhostllm.orgCategory
Open SourceTags
NuxtPro
NuxtPro is an open-source SaaS boilerplate built with Nuxt.js, designed to accelerate the development of scalable, production-ready web applications. It provides developers with a robust foundation that includes essential features such as authentication, billing, user management, and API integrations, all pre-configured to reduce setup time and complexity. By leveraging the power of Nuxt.js, NuxtPro ensures server-side rendering, optimized performance, and SEO-friendly architecture out of the box. This boilerplate is ideal for startups and developers looking to launch SaaS products quickly without reinventing the wheel, allowing them to focus on unique business logic and user experience. NuxtPro combines modern web technologies with best practices, offering a flexible and extensible codebase that supports customization and growth. Its open-source nature encourages community contributions and transparency, making it a reliable choice for developers who want a solid starting point for their SaaS projects.
VibeKit CLI
VibeKit CLI is a universal command-line interface wrapper designed to provide a robust safety layer for AI-powered coding agents such as Claude Code, Gemini CLI, Codex, and others. It enables developers to run any coding agent within a secure, isolated sandbox environment that ensures sensitive data redaction and comprehensive observability. By encapsulating coding agents in a controlled execution context, VibeKit CLI mitigates risks associated with data leaks, unauthorized access, and unintended code execution. This tool is essential for developers who want to leverage AI coding assistants securely, maintaining privacy and compliance while enhancing productivity. VibeKit CLI supports seamless integration with multiple AI coding agents, offering a consistent interface and enhanced safety features. It is open source under the MIT license and is maintained by Superagent Technologies Inc., emphasizing developer safety and security in AI-assisted software development workflows.
OpenSource Fiesta
OpenSource Fiesta is a unique platform dedicated to open-sourcing Dhruv Rathee's AI startup, providing users with the ability to compare and interact with multiple open AI models seamlessly. The platform fosters transparency and collaboration within the AI community by making cutting-edge AI technologies accessible and customizable. Users can engage in dynamic chats with various AI models, enabling diverse applications ranging from productivity enhancements to creative assistance. OpenSource Fiesta emphasizes an open, community-driven approach to AI development, encouraging innovation and shared growth. By leveraging open-source principles, it empowers developers, researchers, and enthusiasts to explore, contribute to, and benefit from advanced AI tools without proprietary restrictions. The platform's sleek, user-friendly interface combined with its robust backend offers a compelling environment for AI experimentation and real-world problem solving. OpenSource Fiesta stands as a bridge between AI innovation and open collaboration, making sophisticated AI capabilities available to a broader audience.
Maia Framework
Maia Framework is a specialized UI dashboard designed for reviewing and debugging tests of multi-agent AI systems. It provides developers and QA teams with a comprehensive interface to monitor, analyze, and validate the behavior of agentic AI before deployment. By focusing on multi AI agent interactions, Maia Framework helps ensure reliability and correctness in complex AI-driven workflows. The platform supports detailed test visualization, enabling users to track agent decisions, test outcomes, and potential issues in a streamlined and intuitive manner. This makes Maia Framework an essential tool for teams building sophisticated AI applications that require rigorous testing and debugging to maintain high-quality performance and safety standards.
VSCode Extensions Hub
VSCode Extensions Hub is a centralized platform designed to help developers discover, explore, and manage powerful extension packs for Visual Studio Code. It serves as a curated collection of extension bundles that enhance productivity, streamline coding workflows, and add valuable features to the VSCode environment. By aggregating various extension packs, the Hub simplifies the process of finding compatible and useful tools tailored to different development needs, whether for web development, debugging, or language support. The platform offers an intuitive interface with search and category filters, making it easy to browse and select extensions that match specific project requirements. VSCode Extensions Hub is ideal for developers looking to optimize their coding experience by leveraging community-driven and expertly curated extensions, ultimately boosting efficiency and coding quality within the popular VSCode editor.
ResumeLink
ResumeLink is a powerful web application designed to transform your resume, CV, and portfolio into a professional, mobile-responsive website instantly. With over 100+ customizable templates, ResumeLink enables users to create visually appealing and SEO-optimized personal websites without any design or coding skills. The platform focuses on making resumes ATS-friendly, ensuring compatibility with applicant tracking systems to improve job application success rates. ResumeLink caters to job seekers and professionals who want to showcase their skills, experience, and projects online in a polished and accessible format. By offering a free, easy-to-use interface, ResumeLink streamlines the resume-building process, allowing users to quickly generate and share their personal brand with potential employers and recruiters worldwide. Its cloud-based service supports instant publishing and sharing, making it an ideal tool for career advancement and personal marketing.