Data engineer python

Related keywords: data science remote jobdata engineer remote jobremote job python

Job Overview

VTRAC Consulting Corporation is seeking to fill an urgent position for a Data Engineer. The role is full-time and offers a fully remote work environment primarily for candidates located in Brazil, adhering to the Eastern Time Zone of Canada. The company is known for its commitment to intelligent solutions in the consulting space.

Key Responsibilities

The successful candidate will be responsible for diverse key tasks which include:

• Designing, building, and maintaining large-scale data systems that are essential for company operations.

• Implementing data warehouses utilizing tools like Amazon Redshift, Google BigQuery, and Snowflake.

• Developing scalable automated testing solutions via Ruby/Selenium-based frameworks.

• Creating and maintaining data pipelines, employing tools such as Apache Beam, Apache Spark, and AWS Glue.

• Building and managing data lakes with technologies like Apache Hadoop, Apache Spark, and Amazon S3.

• Working collaboratively with data architects to implement robust data models and data architectures.

• Partnering with data scientists to create and deploy machine learning models and data products.

• Ensuring high data quality and integrity through the development of validation and cleansing processes.

• Staying abreast of new technologies and trends within the data engineering realm and advocating for their adoption.

Required Skills and Qualifications

Candidates interested in this opportunity should meet the following requirements:

• 5+ years of experience in data engineering or a comparable field.

• A minimum of 2 to 4 years of experience in Ruby products, including proficiency with the Ruby on Rails framework.

• 5+ years of experience in programming languages such as Python, Java, and Scala.

• 3+ years of experience in data modeling and architecture practices.

• 3+ years of experience with essential data engineering tools like Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.

  

• Established expertise in data warehousing and data lakes.

• Proficient in data validation and data cleansing methodologies.

• Strong collaboration and communication skills, enabling effective teamwork.

• A Bachelor's degree in Computer Science, Engineering, or a related discipline is required.

Nice to Have

While not mandatory, the following skills would be considered an asset:

• Familiarity with machine learning and data science methodologies.

• Experience with cloud-based platforms such as AWS, GCP, or Azure.

• Competency in containerization using Docker and Kubernetes.

• Knowledge of agile development methodologies like Scrum or Kanban.

• Experience regarding data governance and security protocols.

Application Process

Interested candidates are encouraged to act swiftly due to the urgent nature of this position. To apply, you should e-mail your resume formatted as an MS-WORD document. Use the subject line: URGENT - Data Engineer (Ruby, AWS, Python, Apache Spark), and address your application to samz@vtrac.com. Additionally, potential candidates can call at (647) 254-0904 for further inquiries.

Considerations and Closing Remarks

VTRAC Consulting Corporation is an equal-opportunity employer, welcoming a diverse pool of applicants. Due to the volume of applications, only candidates selected for interviews will be contacted. For those who are keen on other opportunities, they are encouraged to explore additional openings at VTRAC. This position not only promises an exciting work environment but also the chance to grow significantly in the field of data engineering. This role seems to offer long-term potential as it may evolve into a permanent position based on performance.

This job offer was originally published on jooble.com