岗位描述
Manulife is embarking on replacing and building new data capabilities to help fuel our bold ambition to become a digital customer leader! We are seeking a skilled and motivated Lead Data Engineer to join our diverse team and play a key role in implementing, optimizing, and maintaining assets that deliver these capabilities! The ideal candidate possesses a solid background in data engineering, ETL processes, and data integration, with a passion for understanding data to drive strategic business decisions.
Asia Group Functions Lead Data Engineer
Position Responsibilities:
• Leadership: Mentor and coach data engineers on the team, providing technical guidance and leadership to build a high-performing data engineering team. Use excellent leadership and communication skills to foster a collaborative and high-performing team culture. Ensure that team members are meeting project timelines and delivering high-quality solutions that meet the needs of the business.
• Domain Knowledge: Stay up-to-date with the latest tools and technologies and identify opportunities to enhance Manulife's data infrastructure. • Teamwork: Partner with other lead data engineers, data analysts, business collaborators, and data scientists to understand data requirements and translate them into effective data engineering solutions.
• Data Pipeline Development: Design, develop, and manage data pipelines that facilitate the detailed extraction, transformation, and loading of data from diverse sources. Leverage expertise in big data and cloud computing to ensure solutions are scalable, efficient, and effective.
• Data Mapping & Integration: Collaborate closely with multi-functional teams to understand and design schemas for data from various source systems and other transactional or application databases, ensuring accuracy and reliability.
• ETL Optimization: Continuously improve and optimize ETL processes to enhance data flow efficiency, minimize latency, and support real-time and batch processing requirements.
• Data Transformation: Implement data cleansing, enrichment, and transformation processes to ensure high-quality data is available for analysis and reporting.
• Data Quality Assurance: Design testing plans, develop and implement data quality checks, validation rules, and supervising mechanisms to maintain data accuracy and integrity.
•Platform Improvement: Collaborate with various technical resources from across the organization to identify and implement improvements to the infrastructure, integrations, and functionalities.
• Data Architecture: Work closely with business leads and data architects to design, implement, and lead end-to-end architecture based on business requirements.
• User Documentation: Develop and maintain detailed documentation for data pipelines, processes, and configurations to support seamless onboarding.
• Performance Monitoring: Monitor data pipeline performance and solve issues to ensure efficient data flow and proactively find opportunities for improvement.
• Data Governance and Compliance: Ensure consistency with data privacy and compliance standards throughout the data lifecycle.
Required Qualifications:
• Bachelor’s degree in computer science, Information Technology, or a related field. Master's degree is a plus.
• 10+ years of experience as a Data Engineer, with a track record of efficiently implementing and maintaining data pipelines, scheduling, monitoring, notification, and ETL processes using Azure Data Factory, Databricks, Python\Pyspark, Java, Scala.
• Understanding of Azure infrastructure; subscriptions, resource groups, resources, access control with RBAC (role-based access control), integrations with Azure AD and Azure security principles INTERNAL (user group, service principal, managed identity), network concepts (VNet, Subnet, NSG rules, private endpoints), password\credential\key management and data protection.
• Experience deploying and integrating Azure Data Services (ADF, Databricks) using DevOps tools and principles: GitHub Repository, Jenkins CI\CD pipelines, integrated unit tests, etc.
• Knowledge of Azure Data Lake Storage (ADLS Gen2) and its topology on blob storage with file hierarchy, storage account, containers, and folders.
• Proficient in data mart fact and dimension design concepts, ETL\ELT logic to perform upsert and type-2, and applying\implementing with Python\PySpark\store proc\SQL in ADLS (with Lakehouse architecture using Databricks) or in Azure Synapse (with Dedicated SQL pool).
Preferred Qualifications:
• Experience with LLM and AI tools.
• Experience using Unity Catalog.
• Experience using Power BI to connect to sources with ADLS (including Delta Lake), Databricks SQL, Azure Synapse (SQL pool), design semantic layer\data models, create\publish reporting content (data sets\paginate report\interactive dashboard), and manage workspaces.
• Solid understanding of data privacy and compliance regulations and standard methodologies.
• Excellent problem-solving skills and the ability to solve technical issues efficiently.
• Effective communication skills to collaborate with technical and non-technical partners.
• Thorough approach with a commitment to delivering high-quality work in a fast-paced environment.
When you join our team:
We’ll empower you to learn and grow the career you want.
We’ll recognize and support you in a flexible environment where well-being and inclusion are more than just words.
As part of our global team, we’ll support you in shaping the future you want to see.
宏利金融有限公司是全球领先的金融服务提供商,致力于帮助大众轻松作出明智抉择,实现精彩人生。如欲了解更多关于我们的信息,请访问人寿保险-养老保险-健康保险-中宏保险官网 (manulife-sinochem.com).
宏利是平等機會僱主
在宏利/恒康,我們擁抱多元。我們致力於吸引、培養及挽留和所服務客戶同樣多元的員工,並從而營造包容的工作環境,接納文化和個體差異。我們矢志維持公平的招聘、挽留、晉升及薪酬制度,我們管理的所有實踐及項目不會因種族、血統、原籍地、膚色、族裔、國籍、宗教或宗教信仰、信仰、性別(包括懷孕及其相關情況)、性取向、遺傳特徵、退伍軍人身份、性別認同、性別表達、年齡、婚姻狀況、家庭狀況、殘疾或受適用法律保護的任何其他因素而區別對待。
我們的首要任務是消除障礙,為員工提供平等就業機會。人力資源部代表將盡力為應徵過程中提出要求的申請人提供合理協助。申請人要求提供協助所分享的信息將會按照適用法律及宏利/恒康政策儲存及使用。應徵過程中如需協助,請聯絡 hr@manulife.com。
Working Arrangement
混合办公