Role: Data Architect - Databricks Machine Learning

Full time Professional

Remote - Nationwide

About Onix: Onix is a leading cloud consulting company that helps customers get the most out of their technology with innovative, cloud-powered solutions and best-in-class services. We offer cloud solutions across various use cases and industries, from migration to advanced analytics and innovative AI solutions. With our global team of accomplished cloud experts, we are the most trusted cloud partner in the industry.

Summary: Onix seeks an experienced Data Architect specialized in Machine Learning who will be vital in designing and implementing solutions that meet client business needs and support the overall cloud architecture. As a Machine Learning Architect, you will be critical in defining the technical architecture, selecting appropriate technologies, and developing machine learning models and systems.

You will work closely with cross-functional teams, including data scientists, engineers, and business stakeholders, to deliver innovative and scalable machine-learning solutions that address complex business challenges.

This role required being a self-starter and may include overseeing other engineers' work.

Location: Remote - US, Support EST business hours

Scope/Level of Decision-Making: This exempt position operates under limited decision-making and supervision. Position performs various assigned activities, referring more complex issues to the manager.

Primary Responsibilities:

• Lead the design, development, and implementation of enterprise-level machine learning solutions, from data collection and preprocessing to model training, evaluation, and deployment that integrate into the overall data architecture.

• Provide thought leadership and technical expertise in designing, building, and optimizing end-to-end data pipelines, from data extraction and transformation to loading and visualization.

• Collaborate with business stakeholders, data engineers, data scientists, and other teams to understand data requirements, use cases, and business objectives.

• Architect scalable and efficient machine learning pipelines and workflows, leveraging best practices and cutting-edge technologies that incorporate into Databricks.

• Design and implement data processing and feature engineering pipelines to extract relevant information from diverse, large-scale datasets.

• Ensure data quality, integrity, and governance standards are met throughout the data engineering lifecycle.

• Create and maintain technical documentation, run books, code, and best practices for data and machine learning engineering on the Databricks platform.

• Collaborate with infrastructure and DevOps teams to deploy and operationalize machine learning models in production environments, ensuring reliability, scalability, and performance.

• Stay up-to-date with the latest advancements in machine learning research, algorithms, tools, Databricks, and related technologies, and propose innovative solutions to enhance our capabilities.

• Consult on Professional Services Engagements to help our customers design and implement data warehouse solutions. Lead and develop best practices for the larger data analytics delivery team.

• Provide client presentations to review project design, outcomes, and recommendations.

Minimum Qualifications & Skills

.

• 5+ years or more consulting experience working with external clients across a variety of industry markets

• 7+ years experience in Data Architecture, data engineering & analytics in areas such as performance tuning, pipeline integration & infrastructure configuration

• In-depth knowledge of AWS data services and related technologies, including but not limited to: Redshift, Glue, S3, AuroraDB, MWAA, Lambda, and SageMaker

• Deep knowledge and expertise in Databricks and its components, such as Unity Catalog, Delta Lake, Delta Live Tables, Apache Spark, and related technologies such as dbt.

• Production-level experience with data ingestion, streaming technologies (i.e., Kafka), performance tuning, troubleshooting, and debugging

• Deep understanding of machine learning algorithms, techniques, and methodologies, with hands-on experience in applying supervised, unsupervised, and deep learning techniques to real-world problems.

• Proficiency in programming languages such as Python, R, Spark, or Scala, including expertise in data manipulation and analysis libraries (e.g., NumPy, pandas).

• Possess deep knowledge and hands-on experience with data streaming technologies, such as Apache Kafka, Apache Flink, or similar platforms.

• Experience implementing real-time data processing pipelines for streaming analytics.

• Experience with Terraform, Git, CI/CD tools, as well as Automation and Integration testing

• Experience with cloud computing platforms (e.g., AWS, Azure, GCP) and their machine learning services - preferred AWS

• Possess strong problem-solving and analytical skills, with the ability to identify and resolve complex data engineering challenges.

• Has excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.

• Has the ability to adapt to changing project requirements and manage multiple tasks simultaneously.

Certifications:

• Databricks Certified Machine Learning Professional

  • Preferred to have current credentials or ability to obtain within first 60 days of employment

Education: Bachelor's Degree or equivalent experience required.

Travel Expectation: Up to 25%

It is the policy of Onix to ensure equal employment opportunity in accordance with the Ohio Revised Code 125.111 and all applicable federal regulations and guidelines. Employment discrimination against employees and applicants due to race, color, religion, sex, (including sexual harassment), national origin, disability, age (40 years old or more), military status, or veteran status is illegal. Onix will only employ those who are legally authorized to work in the United States or Canada. This is not a position for which sponsorship will be provided.

Individuals with temporary visas such as E, F-1, H-1, H-2, L, B, J, or TN or who need sponsorship for work authorization now or in the future, are not eligible for hire.