Senior Data Engineer

Описание вакансии

We are seeking a Data Engineer for a short-term, 8-week engagement to support the implementation of a Databricks Lakehouse on AWS for a global manufacturing client. The project focuses on modernizing financial data workflows by centralizing, automating, and governing data across multiple ERP systems.

The role involves building and maintaining ETL/ELT pipelines, developing transformations and data models in Databricks, supporting infrastructure setup, and implementing data governance and security practices. You’ll work closely with architects, stakeholders, and other engineers to deliver a proof-of-capability solution that replaces manual Excel-based reporting processes.

This position is ideal for an engineer experienced with Databricks, PySpark, and AWS, comfortable working in discovery-driven environments, and able to balance immediate project delivery with foundational data architecture work.

Key Responsibilities

• Build and maintain ERP data ingestion pipelines (e.g., SyteLine, Epicor iScala)
• Develop data transformation workflows across Lakehouse layers
• Implement data models for financial reporting (GL and sub-ledger focus)
• Configure and support Databricks infrastructure and clusters
• Apply data governance, security, and access controls using Unity Catalog
• Collaborate with architects and stakeholders on data architecture, compliance, and regulatory requirements
• Contribute to documentation, runbooks, and knowledge transfer
• Support delivery of reporting datasets and dashboards with validated accuracy

Required Skills & Qualifications

• 5+ years of professional experience in data engineering or similar roles
• Strong hands-on experience with Databricks and Apache Spark (PySpark)
• Solid SQL skills and experience with data transformations, modeling, and ETL/ELT pipelines
• Experience working with ERP or financial data systems
• Familiarity with AWS services and cloud-based data platforms
• Knowledge of data governance, security, and regulatory compliance requirements
• Comfortable working in complex, ambiguous, or inconsistent ERP data environments
• Strong collaboration and communication skills for technical and non-technical stakeholders
• Upper-intermediate English, written and spoken.

Nice to Have

• Experience with regulated or secure data environments.
• Prior involvement in data modernization or financial reporting automation projects.
• Exposure to version control workflows (GitHub) and CI/CD practices for data pipelines.

Soft Skills & Personal Competencies

• Quick learner, able to ramp up on existing systems and datasets.
• Pragmatic, solution-oriented approach to problem solving.
• Collaborative mindset and comfort working with distributed teams.
• Ability to balance short-term delivery with long-term foundational improvements.

Why Join Robots & Pencils?

At Robots & Pencils, you’ll join a global team of engineers, designers, and strategists who value engineering excellence, collaboration, and delivering solutions that make a real impact. You’ll contribute to a high-profile, short-term initiative while working in a supportive, innovative environment that encourages learning, ownership, and meaningful collaboration.