Data Engineer
The Virtual Forge
Data Engineer
£40000
The Virtual Forge, Draper's Fields, Coventry
- Full time
- Permanent
- Remote working
Posted 1 week ago, 7 May | Get your application in now before you miss out!
Closing date: Closing date not specified
job Ref: cf3eacc3b072460c8c72df8e31a16724
Full Job Description
- Coordinating with business stakeholders to determine business requirements and translate these into technical requirements.
- Assessing and prioritising business requirements against backlog.
- Maintaining and enhancing data pipelines to support business reporting processes
- Formulating test cases and test plan to validate all data pipeline changes
- Investigating potential data quality issues in the data pipeline to identify true root cause along with an action plan for immediate resolution and also for a permanent fix.
- Providing ad-hoc data to support business queries, including the creation of basic visualisation of data through Excel or Tableau to aid the process.
- Maintaining and continually enhancing data quality and data governance of data pipelines
- Maintaining documentation of the data pipeline process to ensure business continuity
- Maintaining documentation of the data stored in BigQuery to support business
To be successful, you should have in-depth knowledge of object-relational mapping, experience with server-side logic, above-average knowledge of Python programming and the ability to translate business requirements into technical requirements., More than 4 years of experience in a similar role - Advanced Python
- Data processing using Pandas
- Python client for Google BigQuery
- Advanced SQL (GoogleSQL, MySQL)
- Google Cloud Services
- Advanced BigQuery
- Advanced Google Cloud Storage
- Google Dataform
- Google Cloud Function
- Advanced Apache Airflow
- Basic Tableau: ability to create basic visualisations
- Ability to integrate multiple data sources and databases into one system
- Able to create database schemas that represent and support business processes
- Effective verbal and written communication skills
- Strong Excel skills (complex formulas, pivot tables), Python: 3 years (preferred)
- Data Engineering: 4 years (preferred)
The Virtual Forge is an international company with offices in the UK, Portugal, UAE and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work with one of our clients. - Send us your CV
- Gross Salary expectation and availability
- You need to be authorised to work in the United Kingdom
- Casual dress
- Company events
- Employee discount
- On-site parking
- Work from home
- Monday to Friday
You will be based in our clients offices in Coventry and in Warwick 2 days per week, with the remaining days being from your own home.
What do you need to do:
At The Virtual Forge, we have a dedicated recruitment team that works globally to fill all our recruitment needs. Therefore we don't need a response from recruitment companies. Thanks for understanding.
Job Type: Full-time
Pay: From £40,000.00 per year
Benefits:
Schedule: