Data Engineer

Описание вакансии

We fuse together exceptional talent who deliver outstanding software solutions. Our approach has helped us grow 60% in 2021, 94% in 2022, while in 2023 we joined forces with Insight, a Fortune 500 company and a leading solutions and systems integrator. With exciting growth plans and cutting-edge projects, there has never been a better time to join our incredible team.

Role Overview

We are seeking a Data Engineer to design, build, and maintain the pipelines and data platforms that power company's next-generation maritime applications. You will work closely with BI Developers, Data Architects, and Product teams to ensure data is collected, transformed, and delivered in a secure, scalable, and efficient manner using Microsoft and Azure technologies.

Key Responsibilities

• • Design, develop, and maintain data pipelines and ETL/ELT processes using Azure Data Factory, Synapse Pipelines, or Databricks.

• Build and optimize data lake and data warehouse architectures on the Microsoft Azure platform.

• Ensure data quality, reliability, and consistency across all systems through validation, monitoring, and governance practices.

• Collaborate with BI Developers and Analysts to deliver high-performance data models for reporting and analytics.

• Work with application and integration teams to ingest data from ERP, IoT, APIs, and external sources into the Azure Data Platform.

• Implement data security and compliance controls, including identity, access management, and data masking, aligned with maritime regulations.

• Optimize pipeline performance and manage cost-efficiency across Azure resources.

• Contribute to the automation of deployments using CI/CD, version control, and Infrastructure-as-Code (IaC).

• Stay updated on Microsoft Azure data ecosystem advancements and propose improvements to company's data architecture.

Skills and Qualifications

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field (or equivalent experience).

• 3–5 years of professional experience as a Data Engineer or in a related role.

• Hands-on experience with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.

• Strong proficiency in SQL and experience with Azure SQL Database or SQL Server.

• Experience with Databricks (PySpark, SparkSQL) or equivalent data processing frameworks.

• Familiarity with data modeling, dimensional design, and data warehouse best practices.

• Understanding of Azure DevOps, Git, and CI/CD for data pipeline deployment.

• Knowledge of Python, T-SQL, or PowerShell for scripting and automation.

• Familiarity with data governance, lineage, and cataloging tools (e.g., Azure Purview).

• Experience integrating multiple data sources, including APIs, IoT, ERP, or legacy systems.

• Nice-to-have: exposure to streaming data technologies (e.g., Azure Event Hubs, Kafka) and maritime IoT datasets.

• Strong analytical, problem-solving, and collaboration skills.

To see more roles, click here.