Data Platform Engineer - Mercari

This position requires English language ability. JD is available in English only. 　本ポジションは日本語JDの用意がありません。

"What can I do to help society thrive with the finite resources we have?" The Mercari marketplace app was born in 2013 out of this thought by our founder Shintaro Yamada as he traveled the world. We believe that by circulating all forms of value, not just physical things and money, we can create opportunities for anyone to realize their dreams and contribute to society and the people around them. Mercari aims to use technology to connect people all over the world and create a world where anyone can unleash their potential.For more information about Mercari Group’s mission, see Mercari's Culture Doc.

Here at Mercari, we work to realize a world in which no one’s potential is limited by their background and everyone has the opportunity to freely create value. We also firmly believe that a mindset of Inclusion & Diversity is essential for us to achieve our mission.This, of course, extends to our hiring practices as well. Mercari is committed to eliminating discrimination based on age, gender, sexual orientation, race, religion, physical disability, and other such factors so that anyone who shares our mission and values can join us, regardless of their background. For more details, please read our I&D Statement.

• Design, develop, and maintain data ingestion pipelines for a high-volume data processing system that collects data from mobile and web applications (clients).
• Develop and maintain a very high RPS REST service to receive user events from clients.
• Develop and maintain streaming data pipelines to ingest raw data and write it to a data warehouse.
• Implement batch data transformation pipelines.
• Write SQL queries to extract, transform, and load data from various sources.
• Collaborate with data scientists, data analysts, and software engineers to understand data requirements, manage data schemas, and ensure successful data integration.
• Manage and maintain the CI/CD release pipeline.
• Utilize Docker, YAML, Bash scripting, Terraform, and other technologies to automate infrastructure provisioning and deployments.
• Monitor and troubleshoot pipeline issues to ensure smooth data flow and data quality.
• Write clean, maintainable, and well-documented code.
• Develop and execute on the long-term goals and roadmap of the data platform.

• Opportunity to build large-scale data infrastructure to support the massive amounts of data generated by Mercari Group, including the Mercari application with its over 20M monthly users.
• Work on the development of an ecosystem to support data-driven business expansion by addressing the data utilization needs of many domains including analytics/decision-making, marketing, machine learning, and more.

• Take on the entire data platform creation process, from design to development to operation, to revise existing data infrastructure and develop new features.
• Lead the development of the next generation of user event logging.
  

• Shared belief in Mercari’s mission and values.
• Experience in writing design documents or technical proposals and reaching agreements with stakeholders.
• Experience designing, developing, and operating large-scale services and/or distributed systems using a variety of programming languages including Go, Python, Java, Bash and SQL.
  

• Experience with building APIs and using data serialization formats (e.g., Protobuf, Avro, Parquet).
• Experience with streaming data processing frameworks like Apache Beam or Spark.
• Experience with Data Warehouse technologies like Google BigQuery,  Amazon Redshift, Hive/Hadoop.
• Familiarity with monitoring and alerting tools.
  

• English: Independent (CEFR - B2)
• Japanese: Independent (CEFR - B2) preferred

For details about CEFR, see here

• Istio is a long wild river: how to navigate it safely
• Mercari Platform Group Tech Talk #1 [Day1]
• Mercari Platform Group Tech Talk #1 [Day2]
• How we reorganize the platform team
• How we recreate and migrate our kubernetes cluster (only available in Japanese)

Full-time

• Probationary period: First 3 months after joining the company. (During this period your contract conditions will be the same as that of a permanent employee.)

Roppongi

• Smoking is prohibited within our offices
• Mercari has introduced a work style policy called “Your Choice.” Each member is free to choose whether they want to work in the office or work fully remote. *Exceptions made for certain kinds of work.

• Full flextime (no “core time” or “flex time”)
  *Does not apply to all positions

• Two days off per week (as well as national holidays, New Year's break, etc.)
• Paid leave, congratulatory and bereavement leave, relax days, sick leave

• Annual salary paid in 12 monthly installments (including fixed overtime allowance)
• Based on skills, experience, and abilities
• Reviewed twice a year
  
  
  
  

• Complete health and social insurance
• Incentive program
• Support systems, including those that benefit the employee’s family members
  *See this page for details.

• Relocation support
• Language learning support
• Translation/interpretation support
  *See this page for details.

• Mercari, Inc.
• Merpay, Inc. [Japanese]
• Mercoin, Inc.
• Mercari US

• Mercari Careers
• Mercari Engineering Portal
• Mercan - Introduces the people that make Mercari
• Mercari US Careers
• Mercari US Blog