工作职责:²
1.负责大数据平台Hadoop集群的业务运维工作(集群的监控、数据备份、数据监控、报警)针对集群故障进行快速排查和修复
2.负责公司大数据平台的Hadoop及其周边生态的规划和建设,主导集群的跨机房架构落地,实现在离线混部、存算分离、云原生等技术方向的创新应用,打造稳定高效安全的新一代大数据平台 3.负责大数据平台跨机房主备切换、本地云上融合架构等技术难点的攻关
5.深入研究大数据业务相关运维技术,持续优化集群服务架构,探索新的大数据运维技术及发展方向;
1. Responsible for the business operation and maintenance of the big data platform Hadoop cluster (cluster monitoring, data backup, data monitoring, alarm), and quickly troubleshooting and repairing cluster faults
2. Responsible for the planning and construction of Hadoop and its surrounding ecology on the company's big data platform, leading the implementation of the cluster's cross machine room architecture, achieving innovative applications in offline mixing, storage and computing separation, cloud native technology, and other directions, and creating a stable, efficient, and secure new generation big data platform. 3. Responsible for tackling technical difficulties such as cross machine room master backup switching and local cloud integration architecture on the big data platform
4. Proficient in big data components such as HDFS and Yarn, with deep performance experience in Hadoop clusters
5. Conduct in-depth research on operation and maintenance technologies related to big data business, continuously optimize cluster service architecture, and explore new big data operation and maintenance technologies and development directions
任职要求:²
1.全日制大学计算机相关专业本科以上学历,5年以上大数据运维或基础平台开发相关经验²
2.具备运维相关流程、工具、平台建设的能力,具备识别共性/重复性问题并转化为开发需求,实现通用性的运维平台或服务的能力.
3.精通Java语言编程,具备优秀的系统Debug/Profiling能力和经验,具备优秀的系统架构设计能力,具有大数据产品源码阅读能力者优先.
4.精通Linux操作系统及命令,
5.精通Shell编程² 了解虚拟化、Docker/K8S使用,有相关项目支持或运维经验;
6.英文四级以上水平,日常能够阅读并撰写英文文档,有一定的听说能力。
1. Bachelor's degree or above in computer science, with at least 5 years of experience in big data operation and maintenance or platform development ²
2. Possess the ability to build processes, tools, and platforms related operations and maintenance, identify common/repetitive issues, and transform them into development requirements to achieve universal operations and maintenance platforms or services
3. Proficient in Java language programming, with excellent system debugging/profiling skills and experience, excellent system architecture design skills, and ability to read big data product source code is preferred
4. Proficient in the Linux operating system and commands,
5. Proficient in Shell programming ² Understand virtualization, Docker/K8S usage, and have relevant project experiences;
6. At least CET-4 level in English, able to read and write English documents, with certain listening and speaking abilities.
What's In It For You?
Don't meet every single requirement? Apply anyway.
At TD SYNNEX, we're proud to be recognized as a great place to work and a leader in the promotion and practice of diversity, equity and inclusion. If you're excited about working for our company and believe you're a good fit for this role, we encourage you to apply. You may be exactly the person we're looking for!
1.负责大数据平台Hadoop集群的业务运维工作(集群的监控、数据备份、数据监控、报警)针对集群故障进行快速排查和修复
2.负责公司大数据平台的Hadoop及其周边生态的规划和建设,主导集群的跨机房架构落地,实现在离线混部、存算分离、云原生等技术方向的创新应用,打造稳定高效安全的新一代大数据平台 3.负责大数据平台跨机房主备切换、本地云上融合架构等技术难点的攻关
$ads={1}
4.精通hdfs,yarn等大数据组件,具有Hadoop集群的深度性能经验5.深入研究大数据业务相关运维技术,持续优化集群服务架构,探索新的大数据运维技术及发展方向;
1. Responsible for the business operation and maintenance of the big data platform Hadoop cluster (cluster monitoring, data backup, data monitoring, alarm), and quickly troubleshooting and repairing cluster faults
2. Responsible for the planning and construction of Hadoop and its surrounding ecology on the company's big data platform, leading the implementation of the cluster's cross machine room architecture, achieving innovative applications in offline mixing, storage and computing separation, cloud native technology, and other directions, and creating a stable, efficient, and secure new generation big data platform. 3. Responsible for tackling technical difficulties such as cross machine room master backup switching and local cloud integration architecture on the big data platform
4. Proficient in big data components such as HDFS and Yarn, with deep performance experience in Hadoop clusters
5. Conduct in-depth research on operation and maintenance technologies related to big data business, continuously optimize cluster service architecture, and explore new big data operation and maintenance technologies and development directions
任职要求:²
1.全日制大学计算机相关专业本科以上学历,5年以上大数据运维或基础平台开发相关经验²
2.具备运维相关流程、工具、平台建设的能力,具备识别共性/重复性问题并转化为开发需求,实现通用性的运维平台或服务的能力.
3.精通Java语言编程,具备优秀的系统Debug/Profiling能力和经验,具备优秀的系统架构设计能力,具有大数据产品源码阅读能力者优先.
4.精通Linux操作系统及命令,
5.精通Shell编程² 了解虚拟化、Docker/K8S使用,有相关项目支持或运维经验;
6.英文四级以上水平,日常能够阅读并撰写英文文档,有一定的听说能力。
1. Bachelor's degree or above in computer science, with at least 5 years of experience in big data operation and maintenance or platform development ²
2. Possess the ability to build processes, tools, and platforms related operations and maintenance, identify common/repetitive issues, and transform them into development requirements to achieve universal operations and maintenance platforms or services
3. Proficient in Java language programming, with excellent system debugging/profiling skills and experience, excellent system architecture design skills, and ability to read big data product source code is preferred
4. Proficient in the Linux operating system and commands,
5. Proficient in Shell programming ² Understand virtualization, Docker/K8S usage, and have relevant project experiences;
6. At least CET-4 level in English, able to read and write English documents, with certain listening and speaking abilities.
What's In It For You?
- Elective Benefits: Our programs are tailored to your country to best accommodate your lifestyle.
- Grow Your Career: Accelerate your path to success (and keep up with the future) with formal programs on leadership and professional development, and many more on-demand courses.
- Elevate Your Personal Well-Being: Boost your financial, physical, and mental well-being through seminars, events, and our global Life Empowerment Assistance Program.
- Diversity, Equity & Inclusion: It's not just a phrase to us; valuing every voice is how we succeed. Join us in celebrating our global diversity through inclusive education, meaningful peer-to-peer conversations, and equitable growth and development opportunities.
- Make the Most of our Global Organization: Network with other new co-workers within your first 30 days through our onboarding program.
- Connect with Your Community: Participate in internal, peer-led inclusive communities and activities, including business resource groups, local volunteering events, and more environmental and social initiatives.
Don't meet every single requirement? Apply anyway.
At TD SYNNEX, we're proud to be recognized as a great place to work and a leader in the promotion and practice of diversity, equity and inclusion. If you're excited about working for our company and believe you're a good fit for this role, we encourage you to apply. You may be exactly the person we're looking for!
$ads={2}
