Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Job Description:
Data Engineer Skills and Technologies Data Engineering:
– Strong understanding of data concepts
– data types, data structures, schemas (both JSON and Spark), schema management etc
– Strong understanding of complex JSON manipulation – Experience working with Data Pipelines using a custom Python/PySpark frameworks
– Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
– Strong understanding of Data Security principles
– data owners, access controls
– row and column level, GDPR etc including experience of handling sensitive datasets
– Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Requirements
Required Skills:
Languages / Frameworks
– JSON
– YAML
– Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
– SQL
– PySpark
– Delta Lake
– Bash (both CLI usage and scripting)
– Git
– Markdown
– Scala (bonus, not compulsory)
– Azure SQL Server as a HIVE Metastore (bonus) Technologies
– Azure Databricks
– Apache Spark
– Delta Tables
– Data processing with Python
– PowerBI (Integration / Data Ingestion)
– JIRA
...innovative team and cutting-edge technology elevate and streamline delivery services in North America to meet customers demanding... ...delivery experience Responsibilities Drive and operate Cargo Van Pick up goods and materials, verify loads for accuracy, and...
...About the Role : We are seeking a Data Analyst to support Transmission and Distribution projects. In this remote role, you will be responsible for analyzing and interpreting data to help optimize project performance and deliver actionable insights. This is an exciting...
...Key Responsibilities: Take full ownership of client tax returns and accounting engagements, delegating work to Tax and Senior Tax Professionals as needed. Review and provide final technical approval on all tax filings and work products. Serve as the primary point...
...Are you a dedicated and compassionate Speech-Language Pathologist (SLP) seeking a rewarding opportunity to make a positive impact on the... ...insights. Requirements: Master's degree in Speech-Language Pathology or Communication Disorders. ASHA (American Speech-Language...
...hackajob has partnered with a global enterprise building large-scale Cloud & Infrastructure teams to support mission-critical applications across multiple industries. Role: DevOps Engineer Location: Jersey City, NJ (hybrid) Salary: $110K - $130K depending on...