Apple Senior Software Engineer - Big Data Platform in Cupertino, California
Senior Software Engineer - Big Data Platform
Santa Clara Valley (Cupertino),California,United States
Software and Services
Strong Experience in architecting, designing and writing platform software management of big data platform.
Strong experience in large big data environments running thousands of nodes and jobs
Strong java and python expertise with focus on writing scalable , secure and highly available software application.
Strong understanding of containerizartion technologies and writing software running in them.
Strong expertise in troubleshooting complex production issues.
Strong expertise in troubleshooting someone else’s code.
Expert understanding of Unix/Linux based operating system
Excellent problem solving, critical thinking, and communication skills
Experience automating CI/CD pipelines.
Expertise in configuration management for deploying, configuring, and managing servers and systems
The candidate should be adapt at prioritizing multiple issues in a high pressure environment
Should be able to understand complex architectures and be comfortable working with multiple teams
Ability to conduct performance analysis, capacity management and troubleshoot large scale distributed systems
Comfortable working in a fast paced environment while continuously evaluating emerging technologies while mentoring junior engineers
The position requires solid knowledge of secure coding practices and experience with the open source technologies.
You are a software engineer architecting and building high performant software platform and applications in big data ecosystem. You have solid understanding and experience on HDFS, YARN, spark, and related and emerging big data technologies. You will help architect and build big data solutions around big data platfrom orchestration, capacity management , job orchestration tools like airflow ,to provide visibility and ease of management of our large big data platform. You will also help shape the direction of platform around how we do capacity allocation and show back, data sharing, data lineage and orchestration in our machine learning platform.
Education & Experience
BS in computer science with 7-10 years or MS plus 5-7 years experience or related experience.
- Experience with Kubernetes, Docker Swarm, or other container orchestration framework
- Experience building and operating large scale hadoop/spark data infrastructure used for machine learning in a production environment
- Experience in tuning complex database queries
- Basic understanding of Hadoop/hdfs/yarn
- Experience in Workflow and data pipeline orchestration (Oozie, Jenkins etc.)
- Experience in jupyter based notebook infrastructure.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant at http://www1.eeoc.gov/employers/upload/eeocselfprintposter.pdf (Opens in a new window) at http://www1.eeoc.gov/employers/upload/eeocselfprintposter.pdf .
Apple will not discriminate or retaliate against applicants who inquire about, disclose, or discuss their compensation or that of other applicants. United States Department of Labor. at https://www.dol.gov/ofccp/PayTransparencyNondiscrimination.html Learn more at https://www.dol.gov/ofccp/PayTransparencyNondiscrimination.html (Opens in a new window) at https://www.dol.gov/ofccp/PayTransparencyNondiscrimination.html .
Apple will consider for employment all qualified applicants with criminal histories in a manner consistent with applicable law. If you’re applying for a position in San Francisco, review the San Francisco Fair Chance Ordinance at https://sfgov.org/olse/sites/default/files/Document/FCO%20Poster%20Set%20All%20Languages%2010%2001%2018.pdf guidelines at https://sfgov.org/olse/sites/default/files/Document/FCO%20Poster%20Set%20All%20Languages%2010%2001%2018.pdf (opens in a new window) at https://sfgov.org/olse/sites/default/files/Document/FCO%20Poster%20Set%20All%20Languages%2010%2001%2018.pdf applicable in your area.
Apple participates in the E-Verify program in certain locations as required by law. Learn more about the E-Verify program at https://www.apple.com/jobs/pdf/EverifyPosterEnglish.pdf (Opens in a new window) at https://www.apple.com/jobs/pdf/EverifyPosterEnglish.pdf .
Apple is committed to working with and providing reasonable accommodation to applicants with physical and mental disabilities. Apple is a drug-free workplace. Reasonable Accommodation and Drug Free Workplace policy at https://www.apple.com/jobs/us/accommodationdrugfree.html Learn more at https://www.apple.com/jobs/us/accommodationdrugfree.html (Opens in a new window) at https://www.apple.com/jobs/us/accommodation_drugfree.html .
- Apple Jobs