Offline On-Prem Open-Source LLM Demo
2 weeks ago

Job summary
I need a fast working demo of an open-source LLM running fully on premise no internet access The demo must provide A ChatGPT like chat interface that can answer questions based on a local database dataset sample e commerce company DB is fine A talk to a document feature to chat with one selected uploaded document PDF DOCX with citations I m open to your architecture stack choice but the requirements below are strict to keep implementation fast and demo readyJob description
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Access all high-level positions and get the job of your dreams.
Similar jobs
LLM / AI Engineer (Short-term, High-impact Demo)
Only for registered members
We are building a demo product for a live product showcase next Monday. · The product generates a professional pre-match AI report · for football commentators and analysts. ...
1 month ago
LLM / AI Engineer / RAG (Short-term, High-impact Demo)
Only for registered members
We are building a demo product for live product showcase next Monday. The product generates pre-match AI report for football commentators and analysts. · Design the LLM orchestration logic · Define the report section structure · Implement multicall LLM generation flow · ...
1 month ago
We're building Hobbes, an AI demo agent that runs product demos with the nuance of a top sales engineer. · LLM integrations, · prompt engineering, · and API development. · ...
3 weeks ago
Been part of an early-stage startup or founding team with strong command of ReactJS on the frontend and solid backend skills in Python with frameworks like FastAPI. · ...
1 hour ago
I'm building Mara AI — an agentic AI infrastructure product (missions + tool gateway + approvals + audit + monitoring). I need a public face who already has a strong LinkedIn audience in AI agents / LLMs / enterprise AI and can make this trend through credible founder-style conte ...
1 month ago
Join us as a Solution Engineer on our Digital Service Operations Management Presales team As a Solution Engineer in the CoE, you will be at the forefront of driving technical excellence, customer engagement, and innovation across ITOM and ITSM domains. · ...
4 days ago
I'm looking for an experienced AI/LLM developer to build an LLM-based RAG system that can solve STEM questions submitted by users through text or image (OCR/vision). · ...
3 weeks ago
We need an expert consultant to help us demo n8n and compare its AI capabilities with · other platforms. ...
2 weeks ago
A Full Stack Engineer for GenAI-powered applications using Python and LLMs. · Design and build GenAI-powered applications using Python and LLMs · Implement RAG pipelines, prompt engineering, and LLM integrations · Builddemos PoCs customer-facing AI solutions · ...
2 weeks ago
+Job summary · Seeking a neo4j developer/mentor to guide me building a mini AI demo through testing and validating a Neo4j + LLM workflow using a GitHub repository and a provided sample article.Mandatory skills: Neo4j, Python · ...
4 weeks ago
We're building a privacy-first relationship counseling AI used by real people in emotionally vulnerable moments. · This is not a chatbot demo. This is a safety-critical, trust-based product. · We're looking for a senior AI engineer to own: · Prompt orchestration · Memory & summar ...
1 month ago
We're looking for someone to engage with existing free users, run product demos and convert them into paid customers. · ...
3 weeks ago
A US based well funded startup building low-latency agentic voice AI systems at production scale. · Build and maintain production backend services in Python and JavaScript · Implement agentic workflows LLM-driven systems orchestration stateful flows · ...
1 month ago
We're building an AI-powered product where language models and voice interaction are core parts of the experience.We're looking for an AI engineer who's comfortable working hands-on with LLMs. · Thinking about latency cost and edge cases earlyWorking on LLM-based logic Making sur ...
1 month ago
Senior GenAI Engineer for Semantic RAG and Word-Sense Disambiguation
Only for registered members
We're building a real-time Language interpretation system that converts live speech into accurate output with human-interpreter-level latency. · This is NOT: · a chatbot · a Q&A system · a prompt-only GenAI demo · This is a meaning-critical AI system where errors matter. · ...
2 weeks ago
We're building an AI-powered SaaS and are looking for an experienced AI developer or small agency to create a short-term pilot / POC. · ...
1 month ago
Develops GenAI-powered applications integrating backend modules and optimizing LLM performance to support client PoCs and demos. · ...
1 month ago
AI Engineer Needed for Generative AI Application
Only for registered members
We are looking for an AI engineer to help us build and enhance intelligent features within our product. · ...
3 weeks ago
We are building a serious AI product focused on transforming real-world business conversations into structured intelligence, insights, · and automation.This is a long-term role for someone who can design scalable AI pipelines, · ship fast, · and think like a system architect. · ...
2 weeks ago
I'm building an AI-native platform to make real, production-grade software accessible — and I'm looking for slightly mad people who want to build things that actually matter. · ...
1 month ago