Available to hire
Am experienced days engineer proficient in programming with Python, SQL, Shell scripting and others.
- Experienced in developing data integration pipelines with Databricks, Spark and PySpark.
- Extensive experience with data warehouse/data analytical applications/tools, including Delta
Lake and Databricks Unity Catalog, Snowflake and Redshift. - Considerable experience with cloud services, specifically AWS tools.
- Experienced with orchestration tools, including Databricks workflows (most recently), Airflow, Autosys and Control-M
Skills
Language
English
Fluent
Work Experience
Independent Consultant - Data Warehouse/ETL Specialist at Stirabout Hill Ltd
July 1, 2016 - November 21, 2025Specialist in data warehouse design, development and data integration (ETL) for policy, client and underwriter reporting. Built end-to-end pipelines using Spark (Spark SQL), EMR, Docker on ECS, PySpark, and Python Flask for REST APIs. Orchestrated with Apache Airflow on AWS. Led migration of data endpoints from Impala to Snowflake and from bespoke Spark on AWS EMR to Databricks; integrated sources including SQL Server, Oracle, SFTP, SharePoint and S3 through Delta Lake to parquet files and into Snowflake. Led migration to Databricks and Unity Catalog. Collaborated with Data Scientists, product owners and analysts on AI/ML initiatives.
Senior Data Warehouse and ETL Developer at Clavis Insight
March 1, 2017 - March 1, 2017Designed and built a new Master Data Management (MDM) for client/product data. AWS-based stack including PostgreSQL on EC2, MySQL on RDS, and S3. ETL delivered via Talend, shell scripting, and stored procedures.
Senior ETL Developer at Irish Life Investments (ILIM)
December 31, 2016 - December 31, 2016Developed ETL/data repository support for investment portfolios. Technologies included Oracle 12c, PL/SQL, Pervasive DI (ETL) and shell scripting.
Data Architect/Designer/Modeler/Developer at Clavis Technology (Ascensional)
July 1, 2016 - July 1, 2016Lead data modeller/designer/developer of the Clavis Data Warehouse. ETL/ELT using Talend Open Studio, PostgreSQL, MySQL, Redshift; some Python on AWS. Shell scripting. Version control with Git/Jenkins.
Technical Lead / Scrum Master at Fidelity Investments Ireland Ltd
March 31, 2014 - March 31, 2014Technical lead for the Fund Accounting data integration element of the data warehouse; architecture, development and maintenance. Led distributed teams in Ireland, the US, India and China. Scrum Master.
Principal Software Engineer / Team Lead at AOL Ireland Ltd
October 31, 2011 - October 31, 2011Design, development and maintenance of data warehousing/BI systems to improve management decisions for AOL Advertising. Led data migration to Oracle, Vertica, Netezza, MySQL and other platforms. ETL tools included Ab Initio, Talend, Perl. Involved in content management for AOL Money & Finance websites; data integration, reporting and web services.
Team Lead / Senior Developer at Experience IT Ltd
January 1, 2003 - January 1, 2003Designed, developed and maintained data warehouses and BI/reporting solutions for clients; led development teams and ensured delivery against requirements.
Team Lead / Senior Developer at Exact Software Ireland
January 1, 1999 - January 1, 1999Lead developer for online store audits, using PostgreSQL, MySQL and MongoDB on AWS/RDS or MongoDB; analyzed, cleansed and reported on brands/products. Lead data warehousing and BI initiatives.
Software Engineer at SoftSkills Limited
January 1, 1998 - January 1, 1998ETL and data warehousing work involving Ab Initio, Talend OSS, Perl and shell scripting; supported data integration for AOL and other clients.
Network Administrator at TM Blinds Ltd
January 1, 1997 - January 1, 1997Network administration and IT support; maintenance of local IT infrastructure.
Administrative Officer (Contract) at Department of Employment, Government of Canada
January 1, 1996 - January 1, 1996Administrative duties in the Employment department; supported operations and reporting.
Administrative Officer (Contract) at Unemployment Benefit Office
January 1, 1992 - January 1, 1992Administrative responsibilities in support of unemployment benefits administration.
Trainee Assistant Manager at Bradford & Bingley Building Society
January 1, 1990 - January 1, 1990Trainee role in retail banking; supported branch operations and customer service.
Education
BA (Honours) Political Science & History at University of Saskatchewan
January 1, 1982 - January 1, 1987Software Engineering Certificate at Griffith College, Dublin
January 1, 1996 - January 1, 1997Higher Diploma in Computing at Griffith College, Dublin
January 1, 1998 - January 1, 1999Qualifications
Higher Diploma in Computing
January 1, 1998 - January 1, 1999Software Engineering Certificate
January 1, 1996 - January 1, 1997Industry Experience
Software & Internet, Professional Services, Financial Services, Government, Education
Skills
Hire a Database Developer
We have the best database developer experts on Twine. Hire a database developer in Dublin today.