Develop big data solutions for near real-time stream processing, as well as batch processing on the Big Data platform
Work with business domain experts, data scientists and application developers to identify data that is relevant for analysis and develop a scalable solution
Keep up to date with new developments in the big data ecosystem and learn new technologies
Ensure on-time quality deliverable with ability to coordinate effectively with the rest of the team
Good understanding of (one or more): system design, distributed systems, database systems, cloud infrastructure, security, performance optimizations
Ability to create simple, elegant design
Able to pick up a new language or framework in very short time
Love data and care about data security, correctness, and completeness
Excellent problem analysis and solving skills
Excellent communication skills and team player
Strong foundation in algorithms and data structures and their real world use cases
Production quality coding standards and patterns
Passion for developing amazing customer experiences
4+ years of general software programming experience; at least one year of industry experience
Bachelor degree in Computer Science, Math, related technical field or equivalent practical experience
4+ years of modern, production level Python/Scala/JavaScript
Experience with large scale distributed computing, API design for distributed services
Experience with developing and maintaining production data pipelines, Kafka, Apache Spark, etc.
Experience with Spark Streaming, Spark SQL, Pyspark in a production setting
Knowledge of SQL and conventional databases
Experience in NOSQL technologies like Hbase, Cassandra, MongoDB
Experience with data preparation, transformation and analytical model development
Understanding of cloud, and distributed systems principles, including load balancing, networks, scaling, in-memory vs. Disk
Experience with cloud services like Lambda and Kinesis
Bash/Shell scripting
Continuous Integration / Continuous Deployment