Data Product Engineer

Job Summary 

At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our 39,000 employees work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We’re looking for people who are determined to make life better for people around theglobe. 

The Enterprise Data program is developing a fully integrated and intuitive data and analytics platform.  This platform will enable Lilly team members to quickly view, access, andanalyzedata sets in statistical environments, advanced analytics environments, and BI/visualization tools. Contributors can easily ingest, prepare, andanalyzenew data sets (cleanse, enhance, publish) for others to utilize.

Data engineers areresponsible for ensuring the availability and quality of data needed for analysis and business transactions. This includes data integration, acquisition, cleansing, harmonization and transforming raw data into curated datasets for data science, data discovery, and BI/analytics. Responsible for developing, constructing, testing and maintaining data sets and scalable data processing systems. 

Data engineers work closest with Data Architects and Data Scientists.  They also work with business and IT groups beyond the data sphere, understanding the enterprise infrastructure and the many source systems.

Competency Summary

Key capabilities in this role family include:

• Data Acquisition-isthe process of gatheringand storingdatain a location and format that it can be consumed for data preparation and/or downstream businessuses.

• Data Preparation- isan iterative process for exploring,integrating, cleaning, validatingand transforming raw data into curated datasets

• Data Publishing-  isthe act of releasing data in consumable form for (re)use by others.

Note:All data engineer roles should have a foundational set of knowledgein:  communication, leadership, teamwork, problem solving skills, solution / blueprint definition, business acumen, architectural processes (e.g.blueprinting, reference architecture, governance, etc.), technical standards, project delivery, and industry knowledge.

Key Objectives/Deliverables

• Partner with key business partners and work within team to identify, scope, anddeliverdata productsto answer business questions, solve business needs, and add business value

• Maintain a broad understanding of the pharmaceutical industry (from discovery to commercialization) and be fully engaged with teams, bringing an objective voice to the table, and facilitating decisions grounded in data

• Collaborate withdata scientists to review and provide feedback on the analytics work being done

• Streamline and prepare data for analysis through understanding of data flow and integration 

• Contribute to the evolution ofstandards for data capture, storage, and transformation.

• Data profiling?...

• Gather user requirements and translate them into business solutions.

• Work with data from multiple data sources to build integrated views that will drive decisions

• Consult with internal customers who own the data to develop information relationships that lead to actionable insights.

• Work in Agile Sprints with business facing project teams

Minimum Position Qualifications

• Bachelor’s degree in computer science, information technology, management information systems or equivalent work experience 

• 3-6 years of experience in the core tools used by the platform delivery team (e.g. SQL,Informatica, AWS, Python etc.)

• Ability to work with business owners to define key business requirements and convert to technical specifications

• Experience with security models and development on large data sets

• Expertise in the design, datamodelingcreation, and management of large datasets/data models

• Expertise with analytics and business intelligence solutions

• Experience with Agile Development, CI/CD, Jenkins,Github, Automation platforms

• ExperiencewithAWS database technologies( Redshift, Aurora,RDS,S3& other AWS DataService )

• Experience with Lambda, Python and Spark 

• Familiarity with S3, Kinesis, Glue and Athena. 

• Experience with ApacheAirflow,Ansible& other automation stack

• Experience withGitHub and Jenkins toolsets

• Excellent oral and written communication skills. 

• Strong analytical, problem solving and investigative skills

Additional Preferences

• Experience working in regulated environments and with internal systems quality policies and procedures 

• Knowledge of the data architectures associated with information integration, data visualization, & data warehousing 

• Pharmaceutical or healthcare industry experience 

Education Requirements:

Bachelor’s Degreeor relevant degree