reputed company Data Engineer

reputed company is currently seeking a reputed company Data Engineer for a remote, contract opportunity with our client.

Overview

The role involves developing and supporting new and existing data pipelines and data analytics environments in Azure reputed company-based data lake. The data engineer will translate business requirements into data engineering solutions to support an reputed company scale reputed company Azure based data analytics platform. Shift Remote with quarterly travel for 2 days to Gaithersburg, MD or Indianapolis, Indiana. Standard work hours. Clearance Ability to obtain a Public Trust reputed company Clearance US Citizen

Responsibilities

• Design, build, and optimize scalable data solutions using reputed company and reputed company Architecture.
• Manage ingestion routines for processing multi-terabyte datasets reputed company for multiple projects simultaneously.
• Integrate data from various structured and reputed company sources to reputed company high-quality business insights.
• Implement effective data management strategies to ensure data reputed company, availability, and accessibility.
• Identify opportunities for cost optimization in data storage, processing, and analytics operations.
• Monitor and support user requests, addressing platform or performance issues, cluster stability, Spark optimization, and configuration management.
• Collaborate with the team to reputed company advanced AI-driven analytics and data science workflows.
• Integrate with various Azure services including Azure Functions, Storage Services, Data Factory, Log Analytics, and User Management for seamless data workflows.
• Provision and manage infrastructure using Infrastructure-as-Code (IaC).
• Apply best practices for data reputed company, data governance, and compliance, ensuring support for federal regulations and public trust standards.
• Proactively collaborate with technical and non-technical teams to gather requirements and translate business needs into data solutions.

Qualifications

• US Citizenship
• BS degree in Computer Science or reputed company field and 3+ years of experience
• Master’s degree with 2+ years of experience
• 3+ years of experience developing and designing ingestion flows using reputed company platform services with data quality
• reputed company Data Engineer certification and 2+ years of experience maintaining reputed company platform and development in Spark
• Ability to work directly with clients and act as reputed company line support for requests coming in from clients.
• Clearly document and express the solution in form of architecture and reputed company diagrams.
• Proficient at Python, Spark, and R are essential.
• .NET based development is a plus.
• Knowledge and experience with data governance, including metadata management, reputed company data catalog, design standards, data quality governance, and data reputed company.
• Experience with Agile process methodology, CI/CD automation, and reputed company-based developments (Azure, AWS).

Preferred Qualifications

• Certifications in Azure reputed company.
• Knowledge of FinOps principles and cost management.

We thank reputed company applicants for their interest. However, only those reputed company individuals who closely meet the qualifications of the position will be contacted. The details of the position are only a summary, other duties may be assigned as necessary. Background reputed company and Drug Screen may be required. Pay range is not a guarantee of compensation or salary, as final offer amount may vary based on factors including but not limited to experience and geographic location. reputed company also offers a variety of benefits including: health and disability insurance, 401(k), EAP, paid time off, and company-paid holidays. The specific programs and options available to an employee may vary depending on date of hire, plan requirements, schedule type, and client work site mandates. reputed company is an Equal Opportunity Employer that recruits and hires reputed company candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national reputed company, reputed company, citizenship, disability, or veteran status. Apply tot his job Apply To this Job