(Remote) Data Engineer

Key Responsibilities

• Design & Build Scalable Data Pipelines: Develop robust ETL/ELT pipelines to process real-time and historical market data efficiently.
• Data Architecture & Infrastructure: Design and optimize data lakes, warehouses, and streaming solutions for algorithmic trading.
• DevOps & Automation: Implement CI/CD pipelines, containerization (Docker/Kubernetes), and infrastructure-as-code (Terraform) to automate deployment and monitoring.
• Real-time Data Processing: Work with Kafka, Apache Flink, or Spark Streaming to handle high-frequency trading data.
• Database Management: Optimize performance of SQL/NoSQL databases for high-throughput, low-latency operations.
• Cloud & On-Prem Deployment: Manage data infrastructure in AWS, GCP, or Azure, ensuring scalability and security.
• Monitoring & Logging: Implement observability tools (Prometheus, Grafana, ELK stack) to monitor system health and performance.
• Collaboration with Quant & Dev Teams: Work closely with quants, traders, and software engineers to ensure seamless data integration.
• Security & Compliance: Ensure data integrity, encryption, and regulatory compliance in financial data handling.

Requirements

• Strong Programming Skills: Proficiency in Python, Scala, or Java for data engineering tasks.
• Big Data Technologies: Experience with Apache Spark, Hadoop, Kafka, Airflow.
• Database Expertise: Strong knowledge of SQL (PostgreSQL, MySQL), NoSQL (MongoDB, Cassandra, Redis).
• Cloud & DevOps: Hands-on experience with AWS (S3, Redshift, Lambda), GCP, or Azure and Kubernetes, Docker, Terraform, CI/CD pipelines.
• Real-time Data Processing: Experience with Flink, Spark Streaming, or Kafka Streams.
• Algorithmic Trading Knowledge: Understanding of market data, order books, and trading infrastructure is a plus.
• Infrastructure Monitoring: Familiarity with Grafana, Prometheus, Datadog, Splunk.
• Security & Compliance: Experience in data encryption, authentication, and financial regulations is a bonus.
• Able to communicate in English effectively. Able to speak Chinese is a plus.

Preferred Qualifications:

• Experience in low-latency systems or quantitative finance.
• Familiarity with machine learning pipelines for trading signals.
• Knowledge of market microstructure and exchange connectivity.

Loại hình công việc: Toàn thời gian

Information :

• Company : Hexience Systems Limited
• Position : (Remote) Data Engineer
• Location : Hà Nội
• Country : VN