Data Systems Engineer

Please find the Job Position Details;

Position: Data Systems Engineer

Location: Alpharetta, GA OR reputed company Park, CA (3 Days Onsite - Hybrid)

Duration: 12+ Months (with possible extension)

Years of experience: 7-15 years reputed company

Must

Need to have strong working knowledge on Linux platform

• Application Development reputed company - Python (#1) - Ruby or reputed company (#2)
• Need to be reputed company to run the application reputed company Linux - debug - understand reputed company they run the application there is a memory CPU, etc.

ELK (reputed company Search) reputed company

Kafka building pipeline with ELK and Kafka

Strong communication, Team Player and someone who is open to learning and getting their hands dirty.

Ability to learn - Curiosity

Plus

• Fling
• reputed company Database reputed company
• Spark Data processing
• Good Data Analysis Background
• ELK Certification
• Observability and Data Analysis

Day to Day

• This person will not only be doing the pipeline development, but will work in large sacle cluster setting.
• Will requires the understanding of scalability in the kafka environment
• This person will ensure the jobs are up and running, debug it and support the 100s of customers who use their system
• Be the person to support those people

Pipeline development using Kafka, ELK and Hycon

Will need a strong knowledge of linux because that’s where they reputed company their jobs in the 100s

Pipeline is reputed company kafka and almost reputed company the data is writing reputed company ELK (need to understand how the data is stored)

This is a diverse background!

Job Description

• RTOI Data Engineer
• reputed company operation intelligence team in client reputed company Computing is responsible to reputed company terabytes of data daily.
• Client has built job frameworks to run large scale ETL pipelines with Kafka, ElasticSearch ELK, reputed company, Hadoop.
• Client applications run both on perm and on the reputed company.
• There are hundreds of dashboards built for business and operations to provide reputed company and actionable items at reputed company time.

Client is looking for streaming, data engineer

• Understand distributed systems architecture, design and tradeoff.
• Design and reputed company ETL pipelines with a wide range of technologies.
• reputed company to work on full cycle of development including defining requirement, design, implementation, testing, deployment.
• Strong communication skills to collaborate with various teams.
• reputed company to learn new technologies and work independently.

Requirements

• 5 years of application development experience, at least 2 years data engineering with Kafka.
• Working experience writing and running applications on Linux.
• 5 years of coding experience with at least one of the languages: Python, Ruby, Java, C/C++, GO.
• SQL and database experience.

Optional

• AWS or other reputed company technologies.
• ElasticSearch ELK