Note: The job is a remote job and is open to candidates in USA. Cloudera is a leading data partner for top companies across various industries, focusing on transforming complex data into actionable insights. They are seeking an AI Solutions Engineer to lead the technical architecture and execution for government organizations, helping them design and deploy mission-critical AI applications on the Cloudera Data Platform.
Responsibilities
- Evaluate and select optimal model architectures (LLMs, SLMs, or traditional ML) based on mission requirements, considering tradeoffs between accuracy, latency, and cost
- Guide customers on "Build vs. Buy vs. Fine-tune" decisions, prioritizing open-source models (Llama, Mistral, Falcon) that can run securely within a sovereign data perimeter
- Experience building Agentic Workflows (AI agents that can execute API calls and multi-step tasks)
- Design and implement robust data pipelines within CDP to transform "messy" legacy data into AI-ready formats
- Develop and optimize Vector Databases and Retrieval-Augmented Generation (RAG) architectures to ground AI responses in verified agency facts
- Build Data pipelines with Spark, Nifi, Kafka or other ETL tools
- Optimize model inference for production environments using quantization, pruning, and hardware acceleration (NVIDIA GPU orchestration)
- Implement LLMOps to monitor model performance, detect hallucination rates, and manage model versioning and drift
- Collaborate with the customer’s AI Center of Excellence (CoE) to establish automated guardrails for ethics, bias mitigation, and FedRAMP/IL5 compliance
- Translate complex technical AI concepts into mission-value briefings for GS-level stakeholders and agency leadership
Skills
- Experience: 5+ years in Data Engineering, Machine Learning, or Software Engineering, with at least 2 years focused on Generative AI or Deep Learning
- Technical Stack: Expertise in Python and deep learning frameworks (PyTorch, TensorFlow, Hugging Face)
- Hands-on experience with Cloudera (CDP), Spark, or similar big data ecosystems
- Proficiency in orchestration tools like LangChain, LlamaIndex, or Haystack
- Experience developing visual data representations and dashboards (Django, React, or Angular)
- Experience using a compiled programming language, preferably one that runs on the JVM (Java, Scala, etc)
- Data Expertise: Proven ability to build ETL/ELT pipelines and work with both SQL and NoSQL/Vector databases (e.g., Pinecone, Milvus, or PGVector)
- Public Sector Knowledge: Understanding of government security frameworks (NIST AI RMF, FedRAMP, SRGs, STIGs)
- Active Top Secret Security Clearance
- Experience fine-tuning of foundational models using techniques such as PEFT (Parameter-Efficient Fine-Tuning) and LoRA to adapt AI to domain-specific government nomenclature
- Experience training of specialized models on proprietary datasets while ensuring strict adherence to data privacy and sensitivity labels
- Experience installing and operating Cloudera Data Platform
- Experience installing and operating Kubernetes
- Experience in Air-Gapped deployments and managing AI workloads in disconnected environments
- Advanced degree (MS or PhD) in Computer Science, Data Science, or a related field
- Active Counterintelligence (CI) or Full Scope (FS) Poly is required
Benefits
- Generous PTO Policy
- Support work life balance with [Unplugged Days](https://www.youtube.com/watch?v=eXBMXiUHG8c)
- Flexible WFH Policy
- Mental & Physical Wellness programs
- Phone and Internet Reimbursement program
- Access to Continued Career Development
- Comprehensive Benefits and Competitive Packages
- [Paid Volunteer Time](https://www.youtube.com/watch?v=EHPK_ZRVRHA)
- Employee Resource Groups
Company Overview
Cloudera is a software development company that offers data management and cloud-native data analytic solutions. It was founded in 2008, and is headquartered in Santa Clara, California, USA, with a workforce of 1001-5000 employees. Its website is http://www.cloudera.com.