Job Description: Technical Director (Enterprise AI Systems)We are seeking a Lead Software Designer to drive the architectural design and development of our enterprise-grade AI product. This role requires a deep understanding of AI/ML systems, cloud-native architectures, and scalable software design. Key Responsibilities:· Architect scalable, modular, and secure AI-driven software systems.· Design APIs, microservices, and cloud infrastructure for AI workloads.· Ensure seamless AI model integration and efficient scaling.· Set technical directions, select AI/ML frameworks, and define best practices.· Optimize performance, scalability, and resource utilization.· Implement caching, load balancing, and distributed computing.· Ensure security compliance (GDPR, SOC2) and secure data handling.· Enforce best practices in authentication, encryption, and API security.· Collaborate with cross-functional teams to deliver AI solutions.· Mentor engineers and communicate architectural decisions to stakeholders.Mandatory Skills & Qualifications:Experience: 10+ years in software architecture & design, with at least 3+ years focused on AI/ML product design & development.· Experience with design and developing applications with LLMs, RAG Applications, Gen AI Agents. · Fine-tuning open-source LLMs.· Experience with deploying and monitoring LLMs.· Experience with LLM evaluation frameworks or tools like DeepEval, Langfuse or similar.· Experience with frameworks like langchain, llamaindex, pydantic etc.· Proficiency in RDBMS like PostgreSQL and knowledge of vector databases (eg: chromadb,Pinecone, FAISS, Weaviate).· Strong background in microservices, RESTful & GraphQL APIs, event-driven architectures, Working experience with Kafka, RabbitMQ etc...· Proficient in Python, Java for backend development· Experience with TensorFlow, PyTorch, Hugging Face etc...· Skilled in data processing (NumPy, Pandas, Dask,NLTK) and front-end (TypeScript, React.js).· Experience in scalable AI systems, data pipelines, MLOps, and real-time inference.· Strong understanding of security protocols, IAM, OAuth2, JWT, RBAC.· Expertise in cloud platforms (AWS, GCP, Azure), Kubernetes, Docker.· Hands-on experience with CI/CD (Eg: github,Jenkins etc...) · Hands-on with system monitoring (Eg: ELK Stack,OpenTelemetry, Prometheus, Grafana).· Leadership in managing cross-functional teams and communicating technical concepts.Nice-to-Have Skills:· Ensuring AI model interpretability, fairness, and bias mitigation strategies.· Optimizing model inference using quantization, distillation, and pruning techniques.· Experience in deploying AI models in production at scale, including MLOps best practices.· Designing AI systems with privacy-preserving techniques (differential privacy, homomorphic encryption etc.).· Experience with knowledge graph-based AI applications.About CognuteCognute offers Intelligent Virtual Assistants for Consumer Lenders like banks, credit unions, fintech lenders, loan servicers and debt collection agencies. We are a very early-stage startup and looking to hire our early technology team who will be compensated through salary & equity.
Job Title
Technical Director