Principal Data and Integration Engineer - Fully Remote

Related keywords: data analytics remote jobdata engineer remote jobprogramming remote job

This page contains product affiliate links.

Overview of the Role

Magellan Health is seeking a Principal Data and Integration Engineer to join their Data Engineering department, which is essential for data ingestion and integration within the organization. This position plays a crucial role in implementing standardized data models and metrics into the company's enterprise data warehouse, facilitating analytics reporting for stakeholders and clients.
This is a fully remote opportunity for candidates located in the United States, allowing for flexible work from home arrangements.

Key Responsibilities

The Principal Data and Integration Engineer will report to the Manager of Data Engineering & Integration and will oversee a team of junior to mid-level data engineers. Key responsibilities include:

• Architectural Solutioning: Designing and developing scalable, high-performance data processing frameworks on the AWS Cloud platform, aligning with business requirements and best practices.
• Data Integration: Collaborating with data engineers to craft and implement automated data pipelines for ingesting, transforming, and loading data from various sources.
• Performance Optimization: Continuously assessing and enhancing the performance and cost-efficiency of AWS infrastructure and data processing frameworks.
• Automation: Creating scalable automation processes to reduce manual efforts and technical debts.
• Technical Leadership: Leading and mentoring other data engineers, providing guidance to development teams in cloud best practices.
• Collaboration: Working closely with cross-functional teams and stakeholders to understand requirements, translating them into technical solutions.
• Innovation: Staying current with the latest AWS developments and industry trends to upgrade existing architecture and ensure future-proofing.

Qualifications

Candidates for this role should possess the following qualifications:

• Strong experience in architecting and developing large-scale data solutions on the AWS platform, particularly in ETL (Extract, Transform, Load) processes.
• Proficiency with AWS Redshift, advanced SQL transformation, and designing data warehousing solutions.
• Proficient programming skills in Python and PySpark for developing AWS Lambda and Glue jobs.
• Experience leading and mentoring data engineering teams.
• Demonstrated project planning abilities and experience managing data engineering activities.
• Solid understanding of Agile methodology and experience with Scrum practices and ceremonies.
• Hands-on experience with Continuous Integration and Continuous Delivery (CI/CD) frameworks.
• Excellent communication skills for acting as a technical liaison between stakeholders.

Preferred Skills and Technologies

While not strictly necessary, familiarity with the following technologies is highly preferred:

• AWS services such as S3, IAM, Lambda, Glue Jobs, CloudFormation, and CodePipeline.
• Programming languages and tools like SQL, PL/SQL, REST API services, Git, and GitHub.
• Databases including AWS RDS MySQL, AWS DynamoDB, and traditional SQL databases.
• Experience with orchestration tools like Apache Airflow or DBT.
• Knowledge of data visualization tools like Tableau or Cognos is optional but a bonus.

Certifications and Experience

Candidates should ideally hold intermediate-level AWS certifications such as AWS Solution Architect Associate, along with strong experience in overall IT environments. A background that combines education and practical experience in the field is encouraged.

Salary Range

The salary for this position ranges from $105,230 to $178,890. This reflects the anticipated base salary for the role and can vary based on experience and qualifications.

Position Importance

The role of the Principal Data and Integration Engineer is critical as Magellan Health continues to leverage data for enhanced analytics and reporting capabilities. This position involves not just technical skills but also collaboration and leadership, positioning the successful candidate as a key player in the company's ability to respond to data-driven challenges and opportunities.

In summary, this role represents an excellent opportunity for an ambitious individual looking to make a significant impact in data engineering while enjoying the flexibility of a remote work structure. Candidates who meet the qualifications and are interested in leading a team and implementing innovative data solutions are encouraged to apply.

This job offer was originally published on himalayas.app