SENIOR DATA ENGINEER (HEALTHCARE DOMAIN)
Sigmasoftware2
Full-timesenior
Job description
<ul><li>Collaborate with the Product Owner and team leads to define and design efficient pipelines and data schemas</li><li>Build and maintain infrastructure using Terraform for cloud platforms</li><li>Design and implement large-scale cloud data infrastructure, self-service tooling, and microservices</li><li>Work with large datasets to optimize performance and ensure seamless data integration</li><li>Develop and maintain squad-specific data architectures and pipelines following ETL and Data Lake principles</li><li>Discover, analyze, and organize disparate data sources into clean, understandable schemas</li></ul>
<ul><li>Hands-on experience with cloud computing services in data and analytics</li><li>Experience with data modeling, reporting tools, data governance, and data warehousing</li><li>Proficiency in Python and PySpark for distributed data processing</li><li>Experience with Azure, Snowflake, and Databricks</li><li>Experience with Docker and Kubernetes</li><li>Knowledge of infrastructure as code (Terraform)</li><li>Advanced SQL skills and familiarity with big data databases such as Snowflake, Redshift, etc.</li><li>Experience with stream processing technologies such as Kafka, Spark Structured Streaming</li><li>At least an Upper-Intermediate level of English </li></ul>
Skills
PythonPySparkAzureSnowflakeDatabricksDockerKubernetesTerraformSQLKafkaSpark Structured StreamingData ModelingData WarehousingData GovernanceETLData LakeBig Data DatabasesCloud ComputingInfrastructure as Code