Note: The job is a remote job and is open to candidates in USA. Diverse Lynx is seeking a Data Engineer with strong hands-on experience in Azure Cloud technologies. The ideal candidate will design, develop, and optimize scalable data pipelines and cloud-based data solutions while collaborating effectively with cross-functional teams and business stakeholders.
Responsibilities
- Designing, developing, and optimizing scalable data pipelines and cloud-based data solutions
- Expertise in ETL/ELT processing, data modeling, performance tuning, and data governance
- Proficiency in Python, SQL, GitHub, and CI/CD practices
- Working with large-scale datasets in enterprise environments
- Strong analytical and problem-solving skills
- Ability to work independently
- Ownership of end-to-end solution delivery
- Collaborating effectively with cross-functional teams and business stakeholders
Skills
- Strong hands-on experience in Azure Cloud
- Azure Databricks
- PySpark
- Azure Data Factory (ADF)
- Delta Lake
- Unity Catalog
- Designing, developing, and optimizing scalable data pipelines and cloud-based data solutions
- Expertise in ETL/ELT processing
- Data modeling
- Performance tuning
- Data governance
- Proficiency in Python
- Proficiency in SQL
- Proficiency in GitHub
- Proficiency in CI/CD practices
- Experience working with large-scale datasets in enterprise environments
- Strong analytical and problem-solving skills
- Ability to work independently
- Ownership of end-to-end solution delivery
- Collaborating effectively with cross-functional teams and business stakeholders
- Strong experience building REST or GraphQL APIs
- Experience with Kubernetes (AKS preferred) for API deployment
- Understanding of API security, contracts, error handling, and performance
- Strong understanding of data governance, security, and CI/CD practices
- Experience working on large-scale, cloud-native data platforms (Azure preferred)
- Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.)
Company Overview
Diverse Lynx is a WBENC- and NMSDC-certified partner, helping organizations turn diversity goals into measurable impact through staffing and contingent workforce solutions. It was founded in 2002, and is headquartered in Princeton, New Jersey, US, with a workforce of 1001-5000 employees. Its website is http://www.diverselynx.com.Company H1B Sponsorship
Diverse Lynx has a track record of offering H1B sponsorships, with 1 in 2024, 1 in 2021. Please note that this does not guarantee sponsorship for this specific role.