Hi, I'm Allen Shi 👋

👨‍💻 About Me

• A leading Expert in Data Engineering with years of hands-on experience designing scalable, high-performance data systems.
• Mastering cloud-native architectures on AWS and GCP to drive efficiency and innovation.
• Specializing in data modeling, pipeline automation, and efficient workflows optimizations.
• My goal: To become a world-class Data Architect and redefine how organizations leverage data.

⚙️ Tech Stack & Tools

Data Engineering

MySQL, Hadoop, Spark, Flink, Hive, Hbase, Redshift, dbt, Airbyte

Programming

Python, Java, SQL, Bash

Messaging & Streaming

RabbitMQ, Kafka

DevOps & Insfrastructur

Docker, K8S, Terraform, AWS, GCP

📈 GitHub Stats

✨ Fun Facts

• 🔗 Building pipelines so fast, even your boss thinks it's magic.
• 🤹 Data engineer by profession, street performer and juggler by passion.
• 🚴‍♂️ Cycling, music, and strategic problem-solving fuel my passion.

📜 Experience

• Lecturer - WiEDU TibaMe / III - Visit my TibaMe page
• Data Engineer - U.S Company
• Data Engineering & Big Data Solutions: Built and optimized distributed data systems across various industries.
• Key Contributions:
• Designed data models and restructured data architecture at Hengstyle.
• Refactored and optimized distributed ETL systems, implementing Spark at Gamania.
• Developed big data solutions (Hadoop) for customers at LnData.
• Automated pipeline monitoring at Taipei Fubon Bank.
• Education: Mathematics - National Central University