Description:
Will be responsible for maintaining and optimizing the enterprise-level big data platform, providing products and technical services according to requirements, and offering various system and business support for Shanghai Disney Resort. You will manage the log management platform and system big data platform and be responsible for quasi-real-time and non-real-time report development and data analysis.
Requirements:
- A bachelor’s degree or above in a computer – related major.
- Over 3 years of experience in data warehouse and big data development and operation. Participated in the construction or optimization projects of a complete big data platform, and understand the entire process of big data platform from planning, design to deployment and launch. Demonstrable track record of resolving data processing performance bottlenecks and data quality issues in past projects, with the ability to showcase how technical solutions were employed to enhance data processing efficiency and accuracy.
- Proficient in big data processing frameworks such as Hadoop, Spark, Flink, HBase, Hive, Hudi, and Kafka, and be able to use these tools for distributed data storage, computing, and real – time processing.
- Familiar with distributed system architectures, understand resource management, scheduling algorithms, and parallel data processing. Those with the ability to apply data mining and machine learning algorithms are preferred.
- Mastery of SQL syntax and a solid programming foundation. Familiarity with at least one of the following programming languages: Python, Scala, or Java.
- Excellent communication skills, a strong appetite for learning, and the ability to quickly adapt to and excel in new technological domains.
