Big Data Engineer
700 First Avenue Sunnyvale, CA 94089
ektello is working with a world leader in media to find 2 Big Data Engineers who has expertise level experience in Scala, Spark, Java and Machine Learning. You will be part of the team, building one of the largest Big Data Platforms.
All candidates must be able to work on W2 without sponsorship.
- Real-time/Batch Ingestion and Processing pipelines built using Apache Spark / Storm.
- Machine Learning & Offstage analytics pipelines built using Apache Spark
- Data platform & Search Systems built using HBase, Solr and Elasticsearch.
- Present solutions to teams and stakeholders and document design decisions
- Interface with DBAs, Security, Storage, and Networking to meet requirements
- Support and Troubleshoot as required during UAT and Production
- Participate in Performance Engineering activities for optimizations
- Solid knowledge of Scala or Java with Spark including modern language features
- Advanced skills in Databases like MySQL, Postgres, HBase, Cassandra
- Strong knowledge of OO design paradigms.
- Development experience in Linux/Unix environment.
- Experience developing apps at scale on AWS or Azure
- Exposure to AI/ML stacks like MXNet, PyTorch, Keras, Tensor