Acerca de
Data Engineer
Taipei City, Taiwan
Full Time
At SWAG Live's data team, our goal is to democratize data by building a self-service data platform. We strive to empower our internal teams with the ability to access, understand, and generate valuable insights from data.
In this role, you'll help develop data-driven decision-making tools for various stakeholders. These stakeholders may include software engineers, data analysts, and data scientists, among others. Your work will focus on building a unified data platform, aligning with SWAG Live's data mesh vision.
Responsibilities
-
Design, develop, and support pipelines and reporting warehouses to solve business, operations, and product problems.
-
Query optimization, schema design, and ELT/ETL pipelining.
-
Stream processing in event-driven architectures.
-
Collaborate with product and business stakeholders to ensure our data infrastructure meets the constantly evolving requirements.
-
Build developer tools to better support data scientists and data analysts.
Requirements
-
Proficient in Python and SQL.
-
In-depth knowledge for transactional DB and data warehouses.
-
Hands-on experience in query optimization and schema design.
-
Fundamental understanding of analytical data modeling (dbt).
-
Sufficient experience with one of the popular orchestration frameworks (airflow , kubeflow , dagster , prefect, argo).
-
Experience in stream processing (apache spark, apache beam, kafka , flink).
-
A self-directed learning mentality.
-
Comfortable working in an English-speaking environment.
Good to have
-
Basic knowledge (or interest) in common machine learning algorithms.
-
Have hands-on DevOps experience and value DevEx, especially focusing on GitOps.
-
Proficiency in the software development lifecycle and system design, particularly pertaining to data architecture.
Salary Range
Data Engineer 1,440,000 - 1,760,000 TWD per annum
Application for This Position
Please send your resume and CV with the subject title: (Job title you apply for – Candidate Name) via email to hr@swag.live.