Applied Successfully!
Thank you for applying on this job post, We will get back to you shortly, Meanwhile start browsing our other jobs
Job id : 163749

Associate Director – Data Engineering

Associate Director – Data Engineering

  Bangalore
   Elanco Innovation and Alliance Centre        Bangalore
  4 hours ago      27 Applied

JOB ID:163749

Job details

Job Type

  Full Time

Functional Area

IT/Software Development - DBA/Datawarehousing

Industry

Pharma/Biotech/Clinical Research

Education

Not Specified

Experience Required

  10 - 15 Yrs

Key Skills Required

  data pipeline, data product design, etl/elt solutions, cloud platforms, leadership, cloud, big data technologies

Other Skills Required

 

Job Description

Purpose:

The Senior Team Leader – Data Engineering and Support role has a dual focus, covering direct team leadership for the Elanco IT DataOps Data Engineering team located at IAC and the Enterprise Data Platforms and Data Products Support team through that team’s leader, which will report to this role. As part of the Data Engineering team, this individual is accountable for the delivery of data foundations, pipelines, and products supporting our enterprise data objectives. As part of the Enterprise Data Platforms and Data Products Support team, this individual is accountable for the operational support of the services covering key data platforms, such as Azure Databricks, Azure Synapse Analytics, Azure Data Lake, and the Enterprise Data Products, such as Workforce, Material, Customer and Consumer. Leadership responsibilities will include providing direct HR line support for ~4 people at IAC and indirect support for a further ~7. This includes alignment on annual and quarterly goal

...  See More

Purpose:

The Senior Team Leader – Data Engineering and Support role has a dual focus, covering direct team leadership for the Elanco IT DataOps Data Engineering team located at IAC and the Enterprise Data Platforms and Data Products Support team through that team’s leader, which will report to this role. As part of the Data Engineering team, this individual is accountable for the delivery of data foundations, pipelines, and products supporting our enterprise data objectives. As part of the Enterprise Data Platforms and Data Products Support team, this individual is accountable for the operational support of the services covering key data platforms, such as Azure Databricks, Azure Synapse Analytics, Azure Data Lake, and the Enterprise Data Products, such as Workforce, Material, Customer and Consumer. Leadership responsibilities will include providing direct HR line support for ~4 people at IAC and indirect support for a further ~7. This includes alignment on annual and quarterly goals, completing the performance management cycle in alignment with Elanco processes, and providing coaching, feedback, and career planning to enable a well engaged and high performing team. Other administrative responsibilities include input into the annual business plan cycle, enabling strong partnerships with third party organizations supporting our teams, and working across DataOps leadership to continue to build and mature our capabilities as an organization.

This position will also be focused on maturing data engineering capabilities and developing data pipelines and products for Elanco. The role requires sound understanding of animal health data from different domains – R&D, Sales & Marketing, Commercial, Regulatory and Supply Chain, and proven learning agility and ability to translate complex business problems and challenges into tangible data pipelines and data products of high value. The ideal candidate would be responsible for end-to-end development, delivery, and support highly performant, scalable (small- to big- data), robust and secure Azure cloud data pipelines enabling AI/ML/Deep-Learning, Advanced Analytics, Enterprise Collaboration, Micro-services, IoT and Server-less Compute.

Role & Responsibilities

Leadership – Supervisory Responsibilities (70%)

Leadership

· Partner with Engineering Community (Solution Ops, Tech Ops) Leadership to establish and scale engineering forum within Elanco.

· Partner with DataOps Leadership to establish and scale DataOps Engineering and Data Platform/Product Support as growing teams within Elanco.

· Collaborate within and across teams to define, embed and scale the DataOps engineering processes for delivering data products and pipelines to enable the business initiatives in Elanco.

· Partner with future Data Ops Delivery Leads for demand shaping, prioritization, and alignment.

· Guide the Data Platforms/Products Support Lead in staffing their team, setting priorities and objectives.

Role & Responsibilities

Leadership – Supervisory Responsibilities (70%)

Leadership

· Partner with Engineering Community (Solution Ops, Tech Ops) Leadership to establish and scale engineering forum within Elanco.

· Partner with DataOps Leadership to establish and scale DataOps Engineering and Data Platform/Product Support as growing teams within Elanco.

· Collaborate within and across teams to define, embed and scale the DataOps engineering processes for delivering data products and pipelines to enable the business initiatives in Elanco.

· Partner with future Data Ops Delivery Leads for demand shaping, prioritization, and alignment.

· Guide the Data Platforms/Products Support Lead in staffing their team, setting priorities and objectives.

· Identify and position new methodologies, techniques and concepts that drive data product delivery and operational efficiencies, including automation, etc.

· Establish a culture of operational excellence, with a focus on continuous improvement.

· Enable and foster strong working relationships with third party service providers for both development and support of data solutions.

· Own the establishment of required capabilities and skills, anticipate future needs, staff to needs, and continuously work to develop people and the organization.

· Recruit, develop, engage, and retain a diverse, high-performing team.

Coach the engineering and support staff to maximize everyone's contribution and to help them achieve their full potential.
Engage with the broader leadership at IAC, both to support the evolution of this organization within Elanco and to ensure that DataOps is represented appropriately in any organization-wide initiatives.
Mentor individuals across IT roles in IAC
· Demonstrate ownership in understanding Elanco’s strategic direction as it relates to your team and individual goals.

Data Engineering (30%)

· Provide data engineering subject matter expertise and hands-on development for data- capture, ingestion, curation, and pipeline development to deliver cloud optimized data solutions.

· Understand business requirements and design, deliver, and lead team in the building of reliable, efficient, scalable, and quality data pipelines.

· Work on complex data and analytics-centric problems to enable proof of concepts and build learnings into future production solutions.

· Provide expert data PaaS, IaaS, or SaaS consultancy on a range of topics, such as cloud storage; big data platform services; server-less architectures; SQL DB; NoSQL databases and secure, automated data pipelines.

· Develop and evolve new or existing data engineering methods and procedures to create alternative, agile solutions to moderately complex problems.

· Stay abreast with new and emerging data engineering technologies, tools, methodologies, and patterns on major public clouds, especially Azure and GCP.

· Ensure that the team delivers quality solutions in alignment with our enterprise Elanco quality policies and procedures.

· Work collaboratively and use sound judgment in developing robust solutions while seeking guidance on complex problems.

Basic Qualifications (Must have)

· Bachelors or higher degree in Computer Science or a related discipline.

· At least 8 years of data pipeline and data product design, development, delivery experience and deploying ETL/ELT solutions, ideally on Cloud Platforms (Azure/GCP preferred)

· At least 1 year of team leadership/team supervisory experience

Minimum of 5 years of hands-on experience in programming languages, Cloud and Big Data technologies such as Powershell, C#, Java, Python, Scala, SQL, ADLS/Blob, Hadoop, Spark/SparkSQL, Hive, and streaming technologies like Kafka, EventHub etc.

Good to Have Skills:

· Hands-on experience in implementing data migration and data processing using Azure services: Windows/Linux virtual machines, Docker Container and Kubernetes Cluster Management, AutoScaling, Azure Functions, Server-less Architecture, ARM Templates, Logic Apps and Data Factory, Azure network security group, Key management service, etc.

· Knowledge of Spark Framework 3.x version

· Experience working with Developer tools such as Visual Studio, GitLabs, Jenkins, etc.

· Familiarity with metadata management tools, techniques, and technologies such as Data Catalog & API Management

· DevOps on an Azure platform.

· Experience in Azure Machine Learning Services.

Great-to-Have Skills

· Azure Certifications – particularly with data platforms/services

Multi-cloud experience is a plus, especially GCP See Less

About Company

Elanco, a premier global leader in animal health, embarked on a new frontier with the inception of the Innovation and Alliance Centre (Elanco IAC). Launched in July 2019, Elanco IAC stands as a pioneering Global Capability Centre (GCC), a dynamic hub pulsating with innovation. Situated in Bengaluru, India, this center is the embodiment of cutting-edge technologies, research and development, advanced analytics, and invaluable customer insights, driving revolutionary progress in animal health offerings.

Within the vibrant knowledge pool of Elanco IAC, brilliance resonates across 40 centres of excellence, spanning diverse functions in research and development and beyond. In just four years, our organisation has flourished, witnessing an extraordinary 7-fold surge in size and an impressive quadruple increase in capabilities—an ode to our unwavering journey of advancement.

Our expertise spans diverse domains, including Analytics (Finance, Commercial, Supply Chain, and Project Manage

...  See More

Elanco, a premier global leader in animal health, embarked on a new frontier with the inception of the Innovation and Alliance Centre (Elanco IAC). Launched in July 2019, Elanco IAC stands as a pioneering Global Capability Centre (GCC), a dynamic hub pulsating with innovation. Situated in Bengaluru, India, this center is the embodiment of cutting-edge technologies, research and development, advanced analytics, and invaluable customer insights, driving revolutionary progress in animal health offerings.

Within the vibrant knowledge pool of Elanco IAC, brilliance resonates across 40 centres of excellence, spanning diverse functions in research and development and beyond. In just four years, our organisation has flourished, witnessing an extraordinary 7-fold surge in size and an impressive quadruple increase in capabilities—an ode to our unwavering journey of advancement.

Our expertise spans diverse domains, including Analytics (Finance, Commercial, Supply Chain, and Project Management), R&D (Global Safety, Global Pharmacovigilance, Clinical Operations, and Medical Writing), IT, and burgeoning into emerging fields like Bioinformatics and Automation.

IAC has received numerous internal and external recognitions for its DE&I foundation and inclusive culture. Our internal achievement culminate in the prestigious Maiden Global Elanco DE&I Site Award for 2023, demonstrating our commitment to diversity, equity, and inclusion within the organisation. Our external achievements include the HR Association of India's (HRAI) 2023 DE&I Award, the AccelHERate & DivHERsity Awards 2023, and our ranking as one of the Top 3 Companies by Industry in the Pharma/Biotech/Clinical Research sector Furthermore, we are honoured to be named one of the Top 5 Companies in DivHERsity as a startup, and our renowned MD (EIACI), Mukta Arora, is named one of the Top 20 DivHERsity Champions in the SME/Startups category.

Elanco IAC's constant dedication to excellence has been recognised via significant industry honours such as the 2023 Exemplary (Corporate) Supply Chain Award and the renowned "Best Use of Data Analytics in Predictive Modelling (Animal Healthcare)" Award at the 2nd Annual CX Excellence Awards.

Driven by a vision to Deliver, Innovate, and Lead, join us in charting an unwavering course towards the future. Our commitment to cultivating a work environment that fosters diversity, equity, and inclusion is the cornerstone of our identity, guiding us towards a brighter and more inclusive future See Less