Build and maintain high-performance backend services for the Data Catalog, enabling data processing pipelines, data discovery, and observability.
Work with engineering and analytics teams to understand their needs, ensure compliance, and provide tools that empower them to make data-driven decisions.
Solve performance and scale challenges, such as sharding storage to handle growing demand and optimizing our Python/Go clients and UI.
Contribute to large-scale projects like standardizing schemas across Datadog applications, improving navigation, detecting breaking changes, and powering customer-facing products.
Automate compliance tagging (e.g., PII/SOX) and develop tools for consistent data access management across platforms like Snowflake, S3, and Metabase.
Collaborate with a distributed team to deliver quarterly projects, participating in light Scrum processes with regular checkpoints and biweekly planning sessions.
Who You Are:
Experienced in API/backend development (we use Golang but welcome experience in other languages).
Knowledgeable about operating highly available applications, including deterministic rollouts and fallback strategies.
Familiar with Data Engineering concepts and tools, enabling effective collaboration with stakeholders.
Comfortable working with or learning technologies like Python, Postgres, Kafka, Kubernetes, and Spark.
Passionate about enabling governance at scale and building platforms that support performance and usability for diverse use cases.
Bonus points for:
Experience with access management, React UI development, Iceberg, or Trino.
An interest in solving large-scale challenges like schema standardization and compliance automation.
