Senior Software Engineer ( Big Data)
30598BR
USA - Arizona - Chandler, USA - Arizona - Tucson, USA - California - California, USA - California - Irvine, USA - California - Los Angeles, USA - California - Mountain View/Sunnyvale, USA - California - San Francisco, USA - California - San Jose, USA - Colorado - Longmont, USA - Florida - Oviedo, USA - Maryland - Columbia, USA - Massachusetts - Boston, USA - Massachusetts - Boxborough, USA - Massachusetts - Burlington, USA - Michigan - Detroit, USA - New Jersey - Newark, USA - New York - New York City, USA - Ohio - Columbus, USA - Texas - Austin, USA - USA
Job Description and Requirements
Big Data Engineer:
Are you passionate about Big Data? Do you deal with data set in the Size of Peta Bytes (PB) with large scale Hadoop cluster? In this role we are looking for experienced Big Data engineer to work as part of Knowledgebase Team. You would be working on developing big data solutions for array of structured and unstructured data sets and deployed on cloud. The ideal candidate will be a seasoned hands-on Big data developer who enjoys fast-paced environment, is a self-starter and have excellent track record of delivering enterprise scale big data solutions.
We are seeking a, senior level, big data engineer to help us reimagine and modernize the back-end processing factory that fuels the data pipeline for the Black Duck Hub. As a technical star, you will collaborate with other senior members of the team to propose designs, define epics, groom backlog stories, and develop microservices that handle big data. Your hands-on background with Scala, Apache Spark, and Kafka will help us modernize existing batch processes to new, efficient, maintainable, microservices. As a quality minded person, you will be responsible for authoring repeatable automated tests for your solutions and integrating them with CI. You will become a domain professional in open source, vulnerability detection, and license compliance.
You will be responsible for:
Development of mid-sized and large projects, data pipelines and streaming data processing
Develop new Features, algorithms, and data manipulation capabilities
Develop next generation data processing engine using batching or streaming mechanism
Documents and demonstrates solutions by developing documentation, flowcharts, layouts, diagrams, code comments
Delivering incremental features in agile SDLC
Debug existing source code and enhance current feature sets.
Apply mathematics and statistics to problem-solving skills
You will need:
Bachelor's degree (BSCS or equivalent)
3+ years of big data engineering experience
3+ years of general programming experience (Java, Python, Scala)
3+ years of experience with Relational Database & Big Data: SQL, Hadoop, Big Table, Big Query
Cloud Experience with GCP or AWS
Exposure to Apache beam, Airflow, Postgres SQL
Understanding of software design patterns and Excellent aptitudes in data-structures and algorithms
Experience working with extremely large datasets and data processing at significant scale
Experience building and traversing graphs
Skill sets:
Python, Kafka, Postgres, Solr, Avro, Machine Learning, Hadoop (Hortonworks), Google Cloud
#LI-SR2About the Synopsys Software Integrity Group
Synopsys, Software Integrity Group, is named a leader for 2020 in the Gartner Magic Quadrant for Application Security Testing (AST), in recognition of our vision and ability to execute. Security and risk management leaders will need to meet tighter deadlines and test more-complex applications by integrating and automating AST in the software life cycle eliminating risk before it puts them at risk. Every business runs on software, and defects in software create risk. We've curated the most powerful products and services to create one comprehensive platform that enables our customers to detect and remediate defects across their entire SDLC. To find out more about Synopsys SIG, check out .
Inclusion and Diversity are important to us. Synopsys considers all applicants for employment without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, age, military veteran status, or disability.
Job Category
Engineering
Country
United States
Job Subcategory
Software Engineering
Hire Type
Employee
Synopsys maintains a workplace where all personnel, customers, and vendors are treated with dignity, fairness, and respect. We maintain worldwide policies in our Work Rules Policy, which is applicable to all employees in furtherance of these principles. We pride ourselves on providing a healthy and productive work environment that is free from discrimination and harassment based on race, color, religion, gender, gender identity, sexual orientation, marital status, veteran status, age, national origin, citizenship, ancestry, physical or mental disability, pregnancy, medical condition, and any other characteristic protected by law. For applicants and employees with disabilities, we also make reasonable accommodations consistent with applicable laws and regulations. We are each expected to do our part to create a healthy and productive work environment for everyone. This includes bringing issues to management’s attention when you believe certain conditions are distracting from a good work environment. Our Work Rules Policy also allows you to raise concerns with other Synopsys managers. If employees are still unable to resolve their concerns, their disputes may be resolved through our Internal Issue Resolution Process Policy. In addition, all managers and employees in positions of authority have a special obligation to maintain and support a healthy and productive work environment.
