The Financial Solutions BizOps team is looking for a Site Reliability Engineer with strong expertise in Apache NiFi and Apache Spark to support our mission-critical data workflows and analytics platforms. This role is key to ensuring the smooth, reliability, and efficient operation of our production systems that power day-to-day business functions.
You will be responsible for monitoring, troubleshooting, and supporting complex data processing pipelines and integrations in real time. Your work will directly impact business operations, decision-making, and customer experience.
Business Operations is leading the DevOps transformation at Mastercard through our tooling and by being an advocate for change & standards throughout the development, quality, release, and product organizations. We need team members with an appetite for change and pushing the boundaries of what can be done with automation. Experience in working across development, operations, and product teams to prioritize needs and to build relationships is a must.
• Monitor and support production data pipelines and workflows preferably built on Apache NiFi and Apache Spark.
• Provide L2/L3 support for incidents affecting business operations, ensuring timely resolution and minimal downtime.
• Perform root cause analysis of failures, latency, or anomalies in data processing workflows and recommend long-term fixes.
• Collaborate with business analysts, data engineers, and IT operations to ensure business requirements are met and supported in production.
• Maintain SLAs and ensure data quality and processing timeliness for operational reports and dashboards.
• Support deployment, configuration, and performance tuning of NiFi and Spark in production environments.
• Participate in change management and release cycles, ensuring proper validation before changes are applied to production.
• Maintain documentation of workflows, playbooks, support procedures, and operational runbooks.
• Work in an on-call rotation to support 24/7 business-critical systems.
• 3+ years of experience in production support, business operations support, or data platform operations.
• Strong hands-on experience with Apache NiFi (flow design, error handling, queues, templates, and real-time monitoring).
• Proficiency in Apache Spark (batch and streaming), with knowledge of tuning, job monitoring, and debugging in production.
• Solid understanding of ETL processes, data ingestion, and transformation.
• Experience supporting data platforms in a Linux-based production environment.
• Proficient in writing and maintaining scripts in Bash, Python, or Shell for automation and monitoring.
• Strong knowledge of log analysis, monitoring tools (e.g., ELK stack, Splunk, Grafana), and incident management systems (e.g., xMatters, BMC Remedy).
• Excellent troubleshooting skills and the ability to work under pressure during production incidents.
• BS degree in Computer Science or related technical field involving coding (e.g., physics or mathematics), or equivalent practical experience.
• Familiarity with Kafka, Hive, or Hadoop ecosystem.
• Exposure to ITIL practices, incident/change management, and operational reporting.
• Experience in industries with strong operational requirements (e.g., finance, telecom, healthcare).Soft Skills• Strong analytical thinking with attention to detail.
• Ability to work effectively with cross-functional technical and business teams.• Excellent communication and documentation skills.
• Proactive attitude with a strong sense of ownership and accountability.
