Senior Data Engineer

Описание вакансии

Important Information 

Location: Colombia

Work Mode: Hybrid

Job Summary 

As a *Senior Data Engineer (20103)*, you will be responsible for designing, developing, and maintaining high-quality software solutions. You will collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient software applications. Your role will involve leading technical projects, mentoring junior engineers, and continuously improving software development practices to ensure the delivery of robust and reliable software systems.  

Responsibilities and Duties 

• Design and build scalable data pipelines to ingest, process and transform high volume drilling data using Azure Data Factory and Azure Synapse.
• Implement complex logic to convert time based drilling sensor data into depth based datasets for geological and operational alignment.
• Develop ingestion frameworks to process diverse drilling data formats such as LAS, DLIS and WITSML from multiple vendors.
• Ensure data quality, availability and consistency by implementing automated validation checks and optimizing data pipelines for performance.

Qualifications and Skills 

• Strong experience designing and implementing data pipelines using Azure Data Factory and Azure Synapse Analytics.
• Advanced proficiency in SQL and experience working with large scale data processing.
• Strong programming skills in Python with experience using PySpark or Pandas for data processing.
• Experience working with big data technologies such as Spark for distributed data processing.
• Experience managing and organizing data in Azure Data Lake Storage Gen2.
• Knowledge of common data formats such as JSON, Parquet, Delta Lake and XML based formats.
• Understanding of ETL and ELT patterns and modern data engineering best practices.
• Experience processing time series or real time streaming data.
• Strong problem solving and analytical skills to handle complex data transformation logic.
• Experience optimizing data pipelines, Spark jobs or SQL queries for performance and scalability.
• Familiarity with data security practices such as access management and data governance in cloud environments.
• Microsoft Certified Azure Data Engineer Associate (DP 203) certification is a plus.

About Encora 

Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, DevSecOps, Cybersecurity, Quality Engineering, AI & LLM Engineering, among others.  

At Encora, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.