
Senior/Staff Data Engineer (Relocation to Bangkok)
- Taipei City
- Permanent
- Full-time
- Building and maintaining high-performance data systems that enable faster and deeper insights for all parts of our organization
- Designing and Developing ETL/ELT pipelines for both batch and streaming data
- Deploying, managing and monitoring data infrastructure.
- Supporting Data Scientists and Analysts by streamlining and automating data processes and reporting.
- Improving and maintaining data quality and governance
- Communicating effectively with stakeholders
- Experience in working with large datasets in both batch and real-time
- Good understanding of data structures, data architecture and data warehousing
- Good understanding of data platforms architecture, infrastructure and best practices
- Expertise in Python and SQL
- Knowledge and practical experience in one or more back end programming languages (Java, Scala, Kotlin, Groovy, Go, C/C++, Rust, Python, C#, etc.) and the ability to learn new programming languages quickly
- Experienced in designing complex DAGs in Airflow or similar technology
- Experienced in working with data warehouse/lake platforms such as Databricks, Snowflake, AWS, Azure or GCP.
- Experienced in data modeling, cataloging, governance and quality monitoring
- Experienced in working with data streaming tools such as Spark Streaming and Kafka
- Experienced in creating, deploying and maintaining infrastructure using infra as code
- Experienced in developing scalable data warehouse in accordance with either one of GDPR-EU, CCPA-US, LGPD-BR or PDPA - SG