VNG Career Site Header
VNVIE

Chia sẻ việc làm

  • Logo Footer
  • Logo Footer

Công việc liên quan

Tìm công việc

Data Engineer, VNGGames

OfficialDataData Engineering26-GDS-3599
locationThành phố Hồ Chí Min...

Mô tả công việc

  • Designing and developing data pipelines for processing game logs and extracting customer/player relevant information
  • Optimize data processing workflows to handle large-scale log data efficiently
  • Design, develop, and maintain high performance Golang applications for serving Customer Data
  • Contribute to architectural discussions and assist in the design and implementation of the Customer Data Platform

Yêu cầu

  • Bachelor in Computer Sciences or equivalent.
  • Experience in building mid/complex data pipelines, optimizing code, and handling large datasets efficiently.
  • Strong understanding of Apache Spark, including working with RDDs, DataFrames, and Spark SQL
  • Strong with Apache Airflow for managing and orchestrating complex data pipelines, including dependency management, scheduling, and error handling.
  • Knowledge of data validation techniques, data quality frameworks, and experience with testing data pipelines to ensure accuracy and reliability.
  • Understanding of RESTful APIs and microservices concepts
  • Familar with CI/CD tools and practices, such as Jenkins, GitLab CI/CD. Understanding of automating build, test, and deployment processes.
  • Experience with Golang is a big plus
  • Have ownership of one own's project: taking pro-active actions to remove road blocks when arisedCommunication and collaboration skills: strong with a proven ability to work effectively in cross-functional teams