Job Description
Remote Lead Data Engineer needs 7+ years' experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
Remote Lead Data Engineer requires:
Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with:
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
- Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Mandatory Skills Advanced knowledge one of language: Java, Scala, Python, C#? Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
Proficient with Data mining/programming tools (e.g.?SAS, SQL, R, Python) Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
Remote Lead Data Engineer duties:
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services.
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
Employment Type: Full-Time
Salary: $ 110.00 Per Hour
Job Tags
Hourly pay, Full time,
Similar Jobs
Sun, Inc.
..., including dietary and allergen guidelines. Operates cash register and receives payment in cash or credit card, and accurately counts and provides... ...great pay, cool perks, and flexibility. ~ Get paid daily with ~401(k) Plan with employer matching contribution...
Veterans Affairs, Veterans Health Administration
...This exciting job opportunity awaits you in our state-of-the-art VA clinic! The clinic provides primary care, behavioral health, telemedicine, preventive medicine, neurology, infectious disease, lab, and audiology services. Community-based outpatient clinics allow...
North Country Healthcare
Assistant Clinical Support Supervisor RN or LPN This job is located in Payson, AZ North Country HealthCare is a non-profit health organization... ...approved written standing orders and protocols, enters medication refill requests for provider/RN/LPN review and approval...
Mercedes-Benz of Loveland
Responsibilities include: Process all tax, title and registration documents for new and used vehicles. Check for accuracy and ensure... .... Assist with Accounts Receivable.Requirements: Title Clerk experience, Office skills including Microsoft Word, Excel, and Outlook...
NoGigiddy
...Job Description: Enjoy the flexibility of working part-time from home with a leading virtual assistant provider. You can have a meaningful career working from home part-time while being present and available for loved ones, too. We are looking for highly motivated...