
Senior Data Engineer
- Remote
- Cork, Munster, Ireland
Job description
Overview
8 West Consulting is one of the country’s largest software development organisations. Formerly named DeCare Systems Ireland, the company has been operating successfully in Cork city since 1998. 8 West Consulting employ a wide range of technologies including Mobile (iOS, Android, Windows), Java SE/Java EE (WebLogic, WebSphere, Spring, Akka, Hibernate, GWT, etc.), Microsoft .NET (ASP.NET, C#, etc.), JavaScript (AngularJS, JQuery, dojo, etc.), various database management systems (MongoDB, Oracle, SQL Server, MySql, etc.). 8 West Consulting provides consultancy and leading-edge software solutions for a wide variety of US, EU and UK based clients in the insurance, healthcare, retail and public sector markets.
For more on 8 West Consulting visit our website www.8west.ie
Position Summary
The Senior Data Engineer is responsible for designing, developing, and maintaining scalable data solutions across both legacy and modern cloud platforms. The role requires deep expertise in cloud-based data warehousing, strong hands-on skills in Python and ETL pipeline development, and the ability to work in dynamic, agile environments.
The successful candidate must demonstrate excellent verbal and written English communication skills and be able to collaborate effectively with stakeholders across the business.
Key Responsibilities
Design, develop, and maintain robust ETL/ELT processes, including pipelines for extraction, transformation, cleaning, pre-processing, aggregation, and loading of data from diverse sources
Develop, enhance, and maintain ETL solutions using SSIS and cloud-based data platforms
Deliver across the full agile lifecycle, including design, coding, testing, and deployment of iterative data solution
Collaborate with cross-functional teams to ensure data quality, integrity, availability, and auditability
Job requirements
Qualifications & Experience
Minimum 10 years’ experience in data engineering with a strong focus on cloud data platforms
Deep expertise in Snowflake, including cloud-based data warehousing, ELT/ETL pipeline development, and performance tuning
Demonstrated experience building and maintaining ETL processes, ideally using SSIS and Snowflake
Strong proficiency in Python for scripting, automation, and data pipeline development
Hands-on experience with AWS (e.g., data lakes, Glue, S3, Redshift) and exposure to Azure data services
Practical experience using Terraform (or similar IaC tools) for provisioning and managing cloud infrastructure
Proficiency in working with JSON, XML, and other semi-structured data
Work with messaging and queuing systems (e.g., SQS, SNS) to support event-driven data flows
Familiarity with streaming data platforms (e.g., Kafka, Kinesis) is an advantage
Strong background in Git-based workflows (branching strategies, pull requests, CI/CD pipelines)
Excellent verbal and written English communication skills
Skills & Competencies
Strong analytical and problem-solving skills
Ability to design scalable, reliable, and high-performance data solutions
Clear communicator, capable of presenting complex technical concepts to varied audiences
Excellent documentation and technical writing skills
Strong understanding of infrastructure automation and best practices in cloud resource management
Proactive, adaptable, and able to deliver results in fast-paced environments
[Please note this is a daily rate contract position]
or
All done!
Your application has been successfully submitted!