Summary
The ideal candidate will have hands-on experience in building data pipelines, transforming data, and optimizing platforms using Python, Dataiku, Databricks, and Snowflake.
As a Data Engineer, you will play a key role in empowering data-driven decision-making across the organization.
About the Role
Key Responsibilities:
Data Pipeline Development:
Design, implement, and maintain efficient ETL/ELT pipelines to process large-scale data.
Automate data workflows and optimize pipelines using Python and Dataiku.
Data Integration and Collaboration:
Work closely with data analysts, scientists, and business stakeholders to understand requirements and ensure the delivery of accurate and timely data solutions.
Ensure seamless integration of third-party data sources and APIs into the data ecosystem.
Performance Optimization:
Optimize infrastructure, pipeline performance, and resource utilization for cost efficiency and scalability.
Develop robust monitoring and error-handling solutions to ensure data pipeline reliability.
Governance and Security:
Implement data quality frameworks, governance policies, and security best practices.
Ensure compliance with organizational and regulatory data standards.
Continuous Improvement:
Keep up with industry trends, explore emerging technologies, and recommend tools/processes to enhance the data engineering function.
Participate in code reviews, share best practices, and mentor junior team members when needed.
Required Skills & Qualifications:
Programming: Strong proficiency in Python with experience in writing clean and efficient code for data manipulations and pipelines.
Data Platforms: Hands-on expertise in Dataiku for building workflows and automating tasks.
Big Data Frameworks: Experience with Databricks to process and analyze large-scale datasets.
Cloud Data Warehousing: Proficiency in Snowflake database design, query optimization, and data warehouse management.
ETL/ELT: Expert knowledge of building ETL pipelines and designing scalable solutions.
SQL: Advanced SQL skills for querying, transforming, and optimizing relational databases.
Problem-Solving: Strong analytical and troubleshooting abilities, with experience solving complex data challenges.
Communication: Excellent written and verbal communication skills to interact with varied stakeholders effectively.
Why Novartis: Helping people with disease and their families takes more than innovative science. It takes a community of smart, passionate people like you. Collaborating, supporting and inspiring each other. Combining to achieve breakthroughs that change patients’ lives. Ready to create a brighter future together? https://www.novartis.com/about/strategy/people-and-culture
Benefits and Rewards: Learn about all the ways we’ll help you thrive personally and professionally.
Read our handbook (PDF 30 MB)
Accessibility and accommodation
Novartis is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the recruitment process, or in order to perform the essential functions of a position, please send an e-mail to [email protected] and let us know the nature of your request and your contact information. Please include the job requisition number in your message.
