|
Responsible for providing support with the design and implementation of data pipelines in a cloud environment; utilize knowledge of reliability, scalability, performance, security, enterprise system architecture, toil reduction, and other site reliability best practices, implementing the practices within business applications and platforms; build and implement data pipelines using AWS and similar cloud database; apply knowledge of Big Data development tool stacks including Hortonworks, AWS, Spark, and Scala in order to support ETL data pipelines implementation; setup monitoring and alerting using logging and monitoring tools including Kibana, Splunk, Elastic Search, Dynatrace, AppDynamics, Kibana, Grafana, CloudWatch, and Datadog; apply continuous integration and continuous delivery tools including Jenkins, GitLab, Terraform, and Spinnaker to complete assigned tasks; build end-to-end monitoring and alerting solutions for applications and data platforms enabling faster incident detection and improving production reliability; engineer Kubernetes-based deployment workflows for real-time model scoring applications, ensuring seamless scaling, high uptime, operational stability, and strong reliability through autoscaling, observability, and production performance optimization; support the migration of ETL and data processing workloads from AWS EMR to Databricks, enabling a more scalable, efficient, and modern cloud data platform; maintain Apache Airflow DAGs to orchestrate production data pipelines, ensuring reliable scheduling, dependency management, automated retries, monitoring, and operational stability; utilize Java and Python to complete assigned tasks; engineer EMR and pipelines for large-scale data aggregation and transformation, loading processed data into Cassandra to power machine learning models; and write complex, highly optimized queries across large volumes of data using SQL.
Location: Troy, Michigan and multiple undetermined worksites throughout the US;
Salary: $104,000 per year (Benefits include medical, dental, vision, 401(k), STD/LTD, life insurance, and EAP)
|
|
Education: Bachelors – Computer Science, Computer Engineering, Analytics, Statistics, or in a related field of study (will accept equivalent foreign degree).
Training: None
Experience: Two (2) years in the position above, as a Data Analyst, as a Software Engineer, as a Senior Software Engineer, or in a related occupation.
Populus Group is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law. If you would like to request a reasonable accommodation, such as the modification or adjustment of the job application process or interviewing process due to a disability, please email [email protected] for other accommodation options.
|
