Job Summary: We are seeking an AI Engineer to design, implement, and develop a corporate LLM Gateway, managing provider abstraction and implementing security. Key Highlights: 1. Corporate LLM Gateway development 2. Provider abstraction management 3. Security and access control implementation Work Mode: 100% remote Duration: Indefinite Salary: Up to USD 65K We are looking for an **AI Engineer** to develop a **corporate LLM Gateway**, focused on building a platform for abstraction and governance of generative AI models. Technical Requirements* Experience with LLM APIs and generative AI platforms. * Knowledge of cloud architectures (AWS / Azure). * Experience in security, authentication (OAuth, RBAC), and API design. * Familiarity with observability and cost control (FinOps). Responsibilities* Design, implement, and develop the corporate LLM Gateway. * Manage provider abstraction. * Implement security mechanisms, access control, and compliance. * Optimize model usage and consumption (cost, performance, latency). * Define usage policies, governance, and monitoring. If you are interested or know someone who might be a good fit, please send us your updated CV along with your expected rate and availability.
David Muñoz
Indeed · HR
David Muñoz
Indeed · HR
