Report this ad

Inside IR35, financial services, 3 months initially, £500-£750 p/day
We need a Hadoop and Golden Gate Senior Software Engineer (combined role, approx. 75% - 25%) for a remote based 3 month initial contract starting on the 1st January 2021.
Expert skills needed in: Hadoop 3.0+, Spark, Hive, Golden Gate 12/18+
You will be delivering (design, build, test, document, etc.) end-to-end ingestion and processing of newly ingested data sources into a data hub as well as mapping ingested data into derived data content through newly defined complex transformations.
You will also deliver identification and reporting of data quality issues through newly defined complex data quality rules.
If you have 5+ years in multi-technology projects, 5+ years in data collection/processing/publishing projects, 3+ years in projects in corporate environments in (sectors comparable to) Insurance and recent 3+ years in agile way of working/scrum projects we'd really love to hear from you.
As well as the expert level skills needed above, the skills (or similar to) below would be ideal: IT and data architecture/modelling
Big data file system, file, and field formats
Sqoop
Ranger and Kerberos
Oracle, SQL Server, Informix, PostgreSQL RDBMS
Python 3.6+
SQL queries
Data and software pipeline automation
Linux incl. Bash scripts
Infrastructure incl. sizing and performance tuning
GitHub and version control
CI/CD (Ansible, Jenkins)
Jira (or similar tool), Confluence (or similar tool)
Azure cloud
Dell ECS S3 storage
Control-M
API's
Controlled refactoring
Peer reviews, unit testing, bug fixing
You don't have to have everything - the ones nearest the top are the most beneficial.
If you re available in January please apply now!