Sr. Data Engineer

<h2><b>Career Category</b></h2>Information Systems<h2></h2><h2><b>Job Description</b></h2><div><div><p><u><span>Role Description:</span></u><span> </span></p></div><div><p><span><span>The Sr. Data Engineer designs, develops, and </span><span>maintains</span><span> scalable software solutions to address complex business needs, with a focus on building robust data foundations for data repositories, integrations, and reporting. This role ensures system performance and availability while minimizing downtime through automation and proactive incident management. </span></span><span> </span></p></div><div><p><span><span>The ideal candidate will collaborate with product owners, architects, and engineers to design a next-generation metrics engine and implement </span><span>a new</span><span> data governance capability, including metadata and reference data management for analytics. </span><span>Additional</span><span> responsibilities include designing interfaces, workflows, and data models, conducting data mapping across systems, </span><span>optimizing</span><span> data migration, and deploying integrations in development and production environments, ensuring compliance and operational excellence. </span></span><span> </span></p></div><div><p><span><span>This position is perfect for a collaborative, detail-oriented professional passionate about enhancing clinical operations through advanced data engineering and integrations.</span></span><span> </span></p></div><div><p><span> </span></p></div><div><p><u><span>Roles &amp; Responsibilities:</span></u><span><span> </span></span><span> </span></p></div><div><ul><li><p><span><span>Collaborate closely with product owners, </span><span>data </span><span>architects, </span><span>business </span><span>SMEs</span><span> </span><span>and engineers to </span><span>develop and </span><span>deliver high-quality solutions, enhancing and </span><span>maintaining</span><span> integrations across clinical systems.</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Design and architect the next-generation metrics engine on modern infrastructure to support operational analytics </span><span>leveraging</span><span> cloud technologies.</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Design and implement a new data governance capability incorporating essential features like metadata and reference data management for analytics.</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>T</span><span>ake ownership of complex software projects from conception to deployment, managing scope, risk, and timelines.</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Utilize rapid prototyping skills to quickly translate concepts into working solutions and code.</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Leverage modern AI/ML technologies to enable predictive analytics, NLP/NLQ capabilities, and enhance the overall data analytics process.</span></span><span> </span></p></li></ul></div></div><div><div><ul><li><p><span><span>Analyze</span><span> functional and technical requirements of applications, translating them into software architecture and design specifications.</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Develop and execute unit tests, integration tests, and other testing strategies to ensure software quality and reliability.</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Integrate systems and platforms to ensure seamless data flow, functionality, and interoperability.</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Provide ongoing support and maintenance for applications, ensuring smooth and efficient operation.</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Collaborate on building advanced analytics capabilities to empower data-driven decision-making and operational insights.</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Provide technical guidance and mentorship to junior developers, fostering team growth and skill development.</span></span><span> </span></p></li></ul></div><div><p><u><span>Basic Qualifications and Experience:</span></u><span> </span></p></div><div><ul><li><p><span><span>Doctorate Degree OR</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Master’s degree with 6- 11 years of experience in Computer Science, </span><span>IT</span><span> or related </span><span>field  OR</span><span> </span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Bachelor’s degree with 8 - 13 years of experience in Computer Science, </span><span>IT</span><span> or related </span><span>field  OR</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Diploma with 10 - 12 years of experience in Computer Science, </span><span>IT</span><span> or related field </span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Diploma with 14 - 18 years of experience in Computer Science, </span><span>IT</span><span> or related field </span></span><span> </span></p></li></ul></div><div><p><u><span>Functional Skills:</span></u><span> </span></p></div><div><p><b><span>Must-Have Skills</span></b><span> </span></p></div><div><ul><li><p><span><span>Strong understanding of cloud platforms (e.g., AWS, GCP, Azure) and containerization technologies (e.g., Docker, Kubernetes)</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Hands on experience writing SQL using any RDBMS (Redshift, Postgres, MySQL, Teradata, Oracle, etc.) </span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Experience with Schema Design &amp; Dimensional data modeling </span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Hands on experience with big data technologies and platforms, such as Databricks, Apache Spark (</span><span>PySpark</span><span>, </span><span>SparkSQL</span><span>), workflow orchestration, performance tuning on big data processing</span><span> </span></span><span> </span></p></li></ul></div><div><p><b><span>Good-to-Have Skills:</span></b><span> </span></p></div><div><ul><li><p><span><span>Experience with software DevOps CI/CD tools, such Git, Jenkins, Linux, and Shell Script  </span></span><span> </span></p></li></ul></div></div><div><div><ul><li><p><span><span>Experience with Spark, Hive, Kafka, Kinesis, Spark Streaming, and Airflow </span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Experience with </span><span>data flow pipelines to extract, transform, and load data from various data sources in various forms, including custom ETL pipelines  </span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Experience working in an agile environment (</span><span>i.e.</span><span> user stories, iterative development, etc.) </span></span><span> </span></p></li></ul></div><div><p><u><span>Soft Skills:</span></u><span> </span></p></div><div><ul><li><p><span><span>Excellent analytical and troubleshooting skills</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Strong verbal and written communication skills</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Ability to work effectively with global, virtual teams</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>High degree of initiative and self-motivation</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Ability to manage multiple priorities successfully</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Team-oriented, with a focus on achieving team goals</span></span><span> </span></p></li></ul></div><div><ul><li><p><span><span>Strong presentation and public speaking skills</span></span><span> </span></p></li></ul></div></div><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p>.