Search resumes and take the initiative to contact job applicants for higher recruiting efficiency. The Choice of Hundreds of Companies.
Currently, I am a Senior Data Engineer at Far EasTone Telecom, focusing on data warehousing, data transformation, CICD , automation, web scraping, data science, and providing data platform services and insights.
Data&ETL
: DataBricks ,Trinity ,Airflow, Prefect, Spark(pyspark), RabitMQCICD
: Docker, Jenkins, GitDatabase
: Teradata, MySQL, Oracle ,PostgreSQLProgramming languages
: Python, SQLMachine Learning
: Classification, Clustering, Regression, Natural Language Processing, Fraud Detection, Recommender System, Social Network MiningVisualization
: Tableau, Metabase, Python(Matplotlib, Seaborn, plotly, DASH), Data StudioCrawler
: python(BeautifulSoup, Selenium, Scrapy, Mitmproxy)Others
VSCode , Notion, HackmdFarEasTone Telecom • 六月 2021 - Present
1. DataBricks & TeraData ETL Pipeline Dev and OP
2. Data Domain on App/Web Log, Leads, ChatBot
3. Python+ Jenkins + Tableau TeraData DB Usage Monitor Dashboard & Alert
4. Using LightGBM Predict Sales and won 2021 Farestone Tableau Hakthon First Place
Anue - Data Application Department • 六月 2019 - 六月 2021
Web analytics platform: Matomo (piwik) data warehouse and ETL pipeline.
Maintain CICD infrastructure: AWS-Bitbucket-Docker-PHP and migrate to GCP-Gitlab-Docker-Python.
All web url tag and visitor tag for precision marketing and user profile analysis
Keywords network and news pv analysis
Web Crawl and automation for internal support
Dashboard build with metabase and dash
CrowdInsight • 三月 2019 - 六月 2019
Agricultural products Crawl
Database schema design and build test data for martech system
JS tech • 七月 2017 - 二月 2019
High frequency web crawl and stable data source supply
Build internal API application
Tools: Flask, Request, Selenium, Beautifulsoup, Mitmproxy, Prorxypool, RabitMQ
IES Academia Sinica • 一月 2013 - 六月 2017
1. NOAA satellite data and Gamma Ray radiation analysis for possible earthquake precursor
2. Experiment instruments and data pipeline build.
3. Data analysis and data visualization.
Applied Geophysics Master's Degree
09/2007- 06/2011
Department of Earth and Environmental Sciences Bachelor's Degree
06/2003- 06/2007
Currently, I am a Senior Data Engineer at Far EasTone Telecom, focusing on data warehousing, data transformation, CICD , automation, web scraping, data science, and providing data platform services and insights.
Data&ETL
: DataBricks ,Trinity ,Airflow, Prefect, Spark(pyspark), RabitMQCICD
: Docker, Jenkins, GitDatabase
: Teradata, MySQL, Oracle ,PostgreSQLProgramming languages
: Python, SQLMachine Learning
: Classification, Clustering, Regression, Natural Language Processing, Fraud Detection, Recommender System, Social Network MiningVisualization
: Tableau, Metabase, Python(Matplotlib, Seaborn, plotly, DASH), Data StudioCrawler
: python(BeautifulSoup, Selenium, Scrapy, Mitmproxy)Others
VSCode , Notion, HackmdFarEasTone Telecom • 六月 2021 - Present
1. DataBricks & TeraData ETL Pipeline Dev and OP
2. Data Domain on App/Web Log, Leads, ChatBot
3. Python+ Jenkins + Tableau TeraData DB Usage Monitor Dashboard & Alert
4. Using LightGBM Predict Sales and won 2021 Farestone Tableau Hakthon First Place
Anue - Data Application Department • 六月 2019 - 六月 2021
Web analytics platform: Matomo (piwik) data warehouse and ETL pipeline.
Maintain CICD infrastructure: AWS-Bitbucket-Docker-PHP and migrate to GCP-Gitlab-Docker-Python.
All web url tag and visitor tag for precision marketing and user profile analysis
Keywords network and news pv analysis
Web Crawl and automation for internal support
Dashboard build with metabase and dash
CrowdInsight • 三月 2019 - 六月 2019
Agricultural products Crawl
Database schema design and build test data for martech system
JS tech • 七月 2017 - 二月 2019
High frequency web crawl and stable data source supply
Build internal API application
Tools: Flask, Request, Selenium, Beautifulsoup, Mitmproxy, Prorxypool, RabitMQ
IES Academia Sinica • 一月 2013 - 六月 2017
1. NOAA satellite data and Gamma Ray radiation analysis for possible earthquake precursor
2. Experiment instruments and data pipeline build.
3. Data analysis and data visualization.
Applied Geophysics Master's Degree
09/2007- 06/2011
Department of Earth and Environmental Sciences Bachelor's Degree
06/2003- 06/2007