Senior Data Engineer - Oct

Overview

8 West Consulting is one of the country’s largest software development organisations. Formerly named DeCare Systems Ireland, the company has been operating successfully in Cork city since 1998.  8 West Consulting employ a wide range of technologies including Mobile (iOS, Android, Windows), Java SE/Java EE (WebLogic, WebSphere, Spring, Akka, Hibernate, GWT, etc.), Microsoft .NET (ASP.NET, C#, etc.), JavaScript (AngularJS, JQuery, dojo, etc.), various database management systems (MongoDB, Oracle, SQL Server, MySql, etc.). 8 West Consulting provides consultancy and leading-edge software solutions for a wide variety of US, EU and UK based clients in the insurance, healthcare, retail and public sector markets.                  

Position Summary

The Senior Data Engineer is responsible for designing, developing, and maintaining scalable data solutions across both legacy and modern cloud platforms. The role requires deep expertise in cloud-based data warehousing, strong hands-on skills in Python and ETL pipeline development, and the ability to work in dynamic, agile environments.

The successful candidate must demonstrate excellent verbal and written English communication skills and be able to collaborate effectively with stakeholders across the business.

Key Responsibilities

•      Design, develop, and maintain robust ETL/ELT processes, including pipelines for extraction, transformation, cleaning, pre-processing, aggregation, and loading of data from diverse sources

•      Develop, enhance, and maintain ETL solutions

•      Deliver across the full agile lifecycle, including design, coding, testing, and deployment of iterative data solutions

•      Collaborate with cross-functional teams to ensure data quality, integrity, availability, and auditability

Qualifications & Experience

•      Minimum 10 years’ experience in data engineering with a strong focus on cloud data platforms

•      Deep expertise in Snowflake and SQL Server, including cloud-based data warehousing, ELT/ETL pipeline development, and performance tuning

•      Demonstrated experience building and maintaining ETL processes, ideally using SSIS and Snowflake

•      Strong proficiency in Python for scripting, automation, and data pipeline development

•      Strong background in Git-based workflows (branching strategies, pull requests, CI/CD pipelines)

•      Experience in Visual Studio/VS Code or SSMS (SQL Server Management Studio) an advantage

•      Excellent verbal and written English communication skills

Skills & Competencies

•      Strong analytical and problem-solving skills

•      Ability to complete analysis of large data sets

•      Ability to design scalable, reliable, and high-performance data solutions

•      Clear communicator, capable of presenting complex technical concepts to varied audiences

•      Excellent documentation and technical writing skills

•      Proactive, adaptable, and able to deliver results in fast-paced environments