As an Infrastructure Engineer, you will be responsible for the technical design, planning, implementation, and optimization of performance tuning and recovery procedures for critical enterprise systems and applications. You will serve as the technical authority in system administration for complex SaaS, local, and cloud-based environments.
Your role is critical in ensuring the high availability, reliability, and scalability of our infrastructure components. You will also be involved in designing philosophies, tools, and processes to enable the rapid delivery of evolving products.
In this role, you will:
- Design and implement data ingestion, transformation, and visualization pipelines.
- Leverage AWS services (EC2, S3, RDS, Lambda) to build scalable solutions.
- Write clean, maintainable and well-tested code
- Develop scalable and highly performant distributed systems with everything this entails (availability, monitoring, resiliency)
- Communicate and document solutions and design decisions
- Propose new ways of doing things and contribute to the system architecture
- Be part of an agile team that is continuously learning and improving.
- Resolve problems and roadblocks as they occur with help from peers.
- Follow through on details and drive issues to closure.
Experience & Qualifications:
Minimum Qualifications:
- Bachelor’s degree in computer science or a related technical field; or equivalent related professional experience.
- 2+ years of professional experience in Amazon Web Services, particularly VPC, S3, EC2, and EMR.
- 2+ years of experience in maintaining infrastructure for Data Lake/Big Data systems built on the Spark framework and Hadoop technologies.
- Extensive programming experience in Scala, Java, or Python.
- Be self-motivated with drive and good organizational skills.
- Understand Agile methodologies including Scrum and Kanban.
Preferred Qualifications:
- Experience working with any NoSQL database.
- Knowledge of Distributed Systems Architecture.
- A passion for working with data and data technologies.
- Knowledge of AWS services (Lambda, CloudWatch, IAM, etc.)
- Experience with infrastructure automation tools (e.g., Terraform, Ansible, Chef)
- Experience supporting Airflow DAGs
