Data Engineer AWS + Databricks

Related keywords: entry level remote jobremote job entry leveldata entry remote job part time

Overview

Keyrus is a company that values diversity and inclusion in its workforce, encouraging individuals from various backgrounds to participate in its hiring process, irrespective of gender, age, race, or religion. This ethos is reinforced throughout the recruitment process and is an integral part of the company's culture. By fostering a diverse team, Keyrus aims to maximize team potential and achieve remarkable results.

Position Summary

The job opening is for a Data Engineer at Keyrus, focusing specifically on AWS and Databricks. This role is categorized as full-time and is based in the United States. The company is looking for candidates at a Pleno (mid) to Sênior (senior) level, with experience in Business Intelligence (BI), data modeling, and comprehensive knowledge of Big Data technologies. The primary responsibilities of this position encompass the development and maintenance of data pipelines, ensuring quality, performance, and scalability throughout the data processing workflow.

Key Responsibilities

The main responsibilities of the Data Engineer include:

• Developing and optimizing processes for data integration, ingestion, and transformation for both structured and unstructured data (covering both batch and streaming).
• Ensuring the quality, performance, and reliability of data execution across various requests.
• Collaborating with relational and non-relational database systems.
• Designing and implementing Data Warehouse (DW) and Data Lake architectures.
• Participating in the definition of standards, procedures, and data layers in conjunction with solution architects.
• Supporting analysts and business teams in data specification and integration.
• Designing solutions for the integration of complex and voluminous data.
• Maintaining updated technical metadata and repositories.
• Staying abreast of new trends and technologies relevant to the client’s environment.

Essential Qualifications

To be successful in this role, candidates are expected to have the following qualifications:

• Proven experience with Databricks.
• Solid familiarity with AWS (Amazon Web Services).
• Proficient in data modeling techniques.
• Hands-on experience in BI projects and Big Data architectures.
• Knowledge of messaging systems and distributed processing.
• Experience with ETL/ ELT technologies.
• Proficiency in relational databases like SQL Server, Oracle, PostgreSQL, as well as non-relational databases such as MongoDB and Cassandra.
• Experience in working with DW and Data Lake architectures.

Additional Differentiators

Apart from the essential qualifications, the following attributes may enhance a candidate's application:

• Experience with tools like DBT, Apache Spark, or Kafka.
• Proficient in Python or Scala programming.
• Relevant certifications in AWS, Databricks, or equivalent topics.

Company Overview

Keyrus is dedicated to helping companies unlock the full potential of their data and digital systems, with the goal of enhancing performance, driving transformation, and generating new growth avenues. Keyrus invites interested candidates to become a part of their team and contribute to their mission.

Conclusion

If you are an aspiring Data Engineer with the required skills and a passion for working with data technologies, Keyrus presents a promising opportunity for you to further your career in a supportive environment that champions diversity. Interested individuals are encouraged to learn more about the company and the role by visiting Keyrus's website or directly checking their job openings.

This job offer was originally published on himalayas.app