Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Job Description:
Data Engineer Skills and Technologies Data Engineering:
– Strong understanding of data concepts
– data types, data structures, schemas (both JSON and Spark), schema management etc
– Strong understanding of complex JSON manipulation – Experience working with Data Pipelines using a custom Python/PySpark frameworks
– Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
– Strong understanding of Data Security principles
– data owners, access controls
– row and column level, GDPR etc including experience of handling sensitive datasets
– Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Requirements
Required Skills:
Languages / Frameworks
– JSON
– YAML
– Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
– SQL
– PySpark
– Delta Lake
– Bash (both CLI usage and scripting)
– Git
– Markdown
– Scala (bonus, not compulsory)
– Azure SQL Server as a HIVE Metastore (bonus) Technologies
– Azure Databricks
– Apache Spark
– Delta Tables
– Data processing with Python
– PowerBI (Integration / Data Ingestion)
– JIRA
...and service to our customers. At COTE, we follow a simple mantra: &##129385; + &##128293; + &##127864; = &##128522; Service Butchers are dynamic hospitality professionals responsible for handling, deboning, trimming, tying, grinding, and marinating cuts of meat....
...remote position that offers flexibility and the opportunity to work from home. Responsibilities: Enter data accurately and efficiently... ...work independently and meet deadlines Skills: Excellent typing speed and accuracy Strong communication skills Ability...
...The Patient Care Manager/Clinical Coordinator. The Registered Nurse (Rn) Assesses, Plans, Implements, Evaluates And Supervises Individual... ...Arrhythmia.~12.Demonstrates Competency In The Care Of The Pediatric Patient Using The Principles Of Child Growth And Development As...
...you are still eligible to apply. --- Dress A Med ( LLC., a leading global brand in medical apparel based in Los Angeles, is seeking PAID interns. The Dress A Med Studio internship is a significant opportunity to learn while providing assistance to the Creative...
Job Description GM Job Description - Lead a team of delivery drivers and csrs to ensure orders are expedited quickly and correctly - When closing, responsible for end of the night bank deposits - When closing, responsible for doing a nightly product inventory...