SelfHostLLM
SelfHostLLM is a specialized GPU memory calculator designed to help users efficiently plan and manage the resources needed for self-hosted large language model (LLM) inference. It supports popular models such as Llama, Qwen, DeepSeek, and Mistral, enabling users to estimate GPU VRAM requirements and the maximum number of concurrent requests their hardware can handle. By factoring in model size, quantization, context length, and system overhead, SelfHostLLM provides a detailed breakdown of memory usage, helping developers and AI infrastructure planners optimize deployment configurations. This tool is essential for anyone running LLMs locally or on private servers, ensuring cost-effective and performant AI inference without over-provisioning hardware. With its clear formulas and step-by-step calculations, SelfHostLLM empowers users to make informed decisions about GPU allocation, model selection, and expected throughput, bridging the gap between complex AI models and practical hardware constraints.
Share your honest experience with SelfHostLLM
Website
selfhostllm.orgCategory
Open SourceTags
Konsta UI
Konsta UI is a comprehensive library of mobile UI components designed specifically for Tailwind CSS. It provides developers with a rich set of ready-to-use, customizable components that enable rapid development of mobile applications with a consistent and modern design. Konsta UI supports multiple frameworks including React, Vue, and Svelte, making it versatile for various development environments. The components are optimized for mobile experiences, featuring iOS and Material Design styles, which help developers build native-like user interfaces efficiently. By leveraging Tailwind CSS utility classes, Konsta UI ensures that the components are highly customizable and easy to integrate into existing projects. This UI kit is ideal for developers looking to accelerate their mobile app development process while maintaining high design standards and responsiveness.
VibeKit CLI
VibeKit CLI is a universal command-line interface wrapper designed to provide a robust safety layer for AI-powered coding agents such as Claude Code, Gemini CLI, Codex, and others. It enables developers to run any coding agent within a secure, isolated sandbox environment that ensures sensitive data redaction and comprehensive observability. By encapsulating coding agents in a controlled execution context, VibeKit CLI mitigates risks associated with data leaks, unauthorized access, and unintended code execution. This tool is essential for developers who want to leverage AI coding assistants securely, maintaining privacy and compliance while enhancing productivity. VibeKit CLI supports seamless integration with multiple AI coding agents, offering a consistent interface and enhanced safety features. It is open source under the MIT license and is maintained by Superagent Technologies Inc., emphasizing developer safety and security in AI-assisted software development workflows.
Notes Migrator
Notes Migrator is a free, secure, browser-based tool designed to seamlessly convert and migrate notes between popular platforms such as Google Keep, Apple Notes, Evernote (.enex), and Markdown formats compatible with Notion. It operates entirely on the client side, ensuring 100% privacy and security by never uploading your data to any server. The tool supports easy import and export workflows, allowing users to handle their notes effortlessly without losing formatting or content integrity. With a user-friendly interface, Notes Migrator simplifies the complex process of transferring notes across different ecosystems, making it ideal for users switching devices or consolidating their note-taking apps. It supports large file uploads up to 200 MB and provides clear instructions for exporting and importing notes, enhancing productivity and data portability for individuals and professionals alike.
Kelma
Kelma is an open-source, drop-in comment section provider designed for every website. It offers an ad-free and privacy-respecting platform that ensures minimal telemetry collection and never sells user data. Kelma is built for speed, delivering an incredibly snappy user experience where comments load instantly and interactions feel smooth. The solution is fully transparent and auditable, allowing users to choose between hosted or self-hosted deployments. Kelma supports effortless setup with easy customization, offering 35 themes to seamlessly integrate with any website design. It also supports multiple languages, making it accessible globally. Pricing is fair and usage-based, with no tiers, plans, hidden fees, or monthly subscriptions, allowing users to pay only for what they use. Overall, Kelma provides a modern, privacy-conscious, and highly customizable comment system that enhances user engagement without compromising performance or user data privacy.
Hunyuan-GameCraft
Hunyuan-GameCraft is an innovative platform that transforms a single image into rich, interactive game worlds. Leveraging advanced video and image generation technologies, including diffusion transformers, it enables creators to craft immersive virtual environments effortlessly. The platform focuses on generating dynamic, explorable game content from minimal input, streamlining the game development process and enhancing creativity. By automating the creation of interactive scenes from static images, Hunyuan-GameCraft empowers developers and designers to rapidly prototype and build engaging experiences without extensive manual effort. Its cutting-edge AI-driven approach bridges the gap between concept art and playable game worlds, making it a valuable tool for game studios, indie developers, and digital artists aiming to innovate in interactive storytelling and game design.
NuxtPro
NuxtPro is an open-source SaaS boilerplate built with Nuxt.js, designed to accelerate the development of scalable, production-ready web applications. It provides developers with a robust foundation that includes essential features such as authentication, billing, user management, and API integrations, all pre-configured to reduce setup time and complexity. By leveraging the power of Nuxt.js, NuxtPro ensures server-side rendering, optimized performance, and SEO-friendly architecture out of the box. This boilerplate is ideal for startups and developers looking to launch SaaS products quickly without reinventing the wheel, allowing them to focus on unique business logic and user experience. NuxtPro combines modern web technologies with best practices, offering a flexible and extensible codebase that supports customization and growth. Its open-source nature encourages community contributions and transparency, making it a reliable choice for developers who want a solid starting point for their SaaS projects.