Senior Software Engineer, Data & AI Engineering (US)

Related keywords: data analytics remote jobremote job in new yorkdata engineer remote job

Overview of the Role

The position available is for a Senior Software Engineer specializing in Data & AI Engineering at Scrunch AI. This role emphasizes building and processing extensive amounts of data through advanced methodologies, including large language models (LLMs) and traditional analytics techniques.

Key Responsibilities

As a Senior Software Engineer, the candidate will be integral to delivering the product roadmap, contributing to customer success in the evolving AI landscape. Responsibilities include:

• Developing features that enhance data pipelines and analytics APIs.
• Engaging in frontend tasks using React when necessary.
• Implementing notifications, alert emails, scheduled reports, and creating connections to third-party systems.
• Ensuring delivery reflects organizational goals and customer value.

Work Environment

Scrunch AI is a remote organization, which means that employees can work from various locations, specifically within the United States. However, hybrid or in-office work arrangements are available for candidates located in the New York City or Salt Lake City metropolitan areas, allowing for occasional in-person collaboration.

Required Skills and Qualifications

Candidates for this role must possess a diverse skill set relevant to software development and data engineering, including:

• Extensive experience in building and using web APIs.
• Competence in managing aspects such as authentication, authorization, caching, and rate limiting.
• Familiarity with relational databases, particularly PostgreSQL.
• Proficiency in analytics technologies, including tools like Snowflake, Google BigQuery, or Spark SQL.
• Knowledge of analytical SQL and experience in using analytics packages such as Pandas or Polars.
• Experience in writing batch and streaming data processing pipelines using big data tools like Flink or Spark.
• Competence in handling job queues and task processing frameworks like Celery.

Additionally, experience in using LLMs and traditional machine learning techniques for building classifiers and data extractors is advantageous but not mandatory. Awareness of methodologies for evaluating LLM-based tools is a plus.

Personality Traits

Candidates should be able to quickly understand source data and validate the quality of output data. A collaborative spirit and eagerness to contribute to the overall team dynamics are essential. Scrunch AI values individuals who foster a rich company culture with their unique perspectives and experiences.

Equal Opportunity Employer

Scrunch AI prides itself on being an equal opportunity employer. The company embraces diversity and inclusion, encouraging individuals from all backgrounds, regardless of race, religion, national origin, gender, sexual orientation, age, or any other identity, to apply for this role.

Key Takeaways

This role is a significant opportunity for candidates with strong software engineering and analytical skills to contribute to a thriving organization in the rapidly expanding field of AI. Successful candidates will be rewarded with the chance to work on impactful projects while enjoying the flexibility of a full-time remote position. Scrunch AI encourages applicants who are eager to innovate within a diverse and forward-thinking work environment.

This job offer was originally published on himalayas.app