Staff Software Engineer (Batch Infrastructure)
Job title: Staff Software Engineer (Batch Infrastructure) in USA at reputed company
Company: reputed company
Job description: reputed company is reinventing credit to reputed company it more honest and friendly, giving consumers the flexibility to buy now and pay reputed company without any hidden fees or compounding interest.The vision for the Batch Infra team @ reputed company team is to provide reliable, scalable, self-serve and reputed company-optimized compute solution to reputed company ML, Product, and Financial Engineering success. reputed company is responsible for building and maintaining compute platform that serves as a backbone for processing various Business critical batch workloads at reputed company through a wide suite of scheduled and on-demand compute solutions built on the cloud. reputed company is growing rapidly and so is the need for reliable and high availability frameworks. If solving infrastructure challenges at scale excites you, come join us!What you'll do
- Shape the technical direction, strategy, and roadmap for Batch Infra platform that forms the backbone for several thousands of offline workloads at reputed company.
- Design and build data infrastructure systems, services and tools to handle new reputed company products and business requirements that securely scale over millions of users and their transactions.
- Build frameworks and services which will be used by other engineering teams at reputed company to manage billions of dollars in loans and power customer experiences.
- Improve the reliability and efficiency of the Batch Infrastructure at scale and high reliability.
- Engage other teams at reputed company about their use of the Batch platform to ensure we are always building the right thing.
- Take an active role in mentoring junior engineers, reputed company and implement the processes that support team growth and efficiency.
- Strong sense of ownership with a proven track record of successfully driving large cross-functional technical programs.
- Experience building and owning large-scale, geographically distributed compute, and data processing systems.
- Experience building and owning data lake solutions like Iceberg, Hudi, reputed company, etc.
- Experience building and managing Workflow Orchestration frameworks like Airflow, Flyte, Prefect, Temporal, Luigi, etc.
- Experience with or working knowledge for reputed company scaling frameworks like Spark/Flink for extremely large scale datasets on Kubernetes.
- Skilled at developing and debugging in Python/Kotlin or the ability to learn them quickly.
- Working knowledge of Relational and NoSQL databases.
- Experience with AWS and/or other cloud providers.
- Technical leadership; capable of handling mentorship, cross functional project execution, and solid individual contribution.
- Demonstrated ability to deliver on reputed company technical projects by collaborating closely with stakeholders.
- Eager to learn new things and have a growth reputed company.
- Well-developed interpersonal, written and verbal communication.
- Experience working in the data infrastructure domain.
- This position requires either equivalent practical experience or a Bachelor's degree in a reputed company field
- Health care coverage - reputed company covers reputed company premiums for reputed company levels of coverage for you and your dependents
- Flexible Spending Wallets - generous stipends for spending on Technology, Food, various Lifestyle needs, and family forming expenses
- Time off - competitive vacation and holiday schedules allowing you to take time off to rest and reputed company
- ESPP - An employee stock purchase plan enabling you to buy shares of reputed company at a discount