Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Job Description:
Data Engineer Skills and Technologies Data Engineering:
– Strong understanding of data concepts
– data types, data structures, schemas (both JSON and Spark), schema management etc
– Strong understanding of complex JSON manipulation – Experience working with Data Pipelines using a custom Python/PySpark frameworks
– Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
– Strong understanding of Data Security principles
– data owners, access controls
– row and column level, GDPR etc including experience of handling sensitive datasets
– Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Requirements
Required Skills:
Languages / Frameworks
– JSON
– YAML
– Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
– SQL
– PySpark
– Delta Lake
– Bash (both CLI usage and scripting)
– Git
– Markdown
– Scala (bonus, not compulsory)
– Azure SQL Server as a HIVE Metastore (bonus) Technologies
– Azure Databricks
– Apache Spark
– Delta Tables
– Data processing with Python
– PowerBI (Integration / Data Ingestion)
– JIRA
...coming calls and direct them to the correct personnel or department, and to assist management with administrative duties. No previous experience required. Training will be provided. Part-Time or Full-Time. Bi-lingual English and Spanish preferred. Our dealership is on the...
...Non- Certified Chaplain at Providence Seaside Hospital in Seaside, OR. Per Diem/Variable Shift The Non-Certified Chaplain provides professional and competent spiritual care ministry, and is responsible for serving the spiritual, religious, and emotional needs of...
This is a LOCAL long term maintenance project and does NOT pay per-diem so the ideal candidate must live within 50 miles of Chalmette, LA. (Shifts are 5x8' s Monday - Friday) About the Company: At UPS Industrial Services excellence isn't just a goal, it is our baseline...
...Daily deliveries and pick-ups to and from clients Running errands for administration support Backup support to Receptionist Processing outgoing mail, including operating postage machine and verifying addresses Oversees weekly shredding process Backup for...
...Grace Community Care of NJ is looking to hire 1:1 Direct Support Professionals (DSP) one available for Monday-Wednesday 2:00pm-6:00pm Thursday-Friday 9am-3pm This Requires Accompanying and transporting 1:1 client to various community engagement outings. Must...