Technical Skills:

Minimum experience required: 4+ years

Big Data Engineer Responsibilities

As a Big Data Engineer, you’ll be responsible for designing and building high performance, scalable solutions for large volume data ingestion, clean-up, and processing that meet the needs of our enterprise customers. You’ll design, develop, and test robust, scalable data pipelines, microservices, Spark Streaming Applications, and RESTful web services. You’ll work with a variety of teams and individuals to come up with innovative solutions. You’ll be a self-organized member of a team of talented engineer and should be able to collaborate with product managers and designers to help implement and execute new products and features.

Big Data Engineer Requirements

• Experience working on High Availability distributed systems
• 4+ years of experience: building business logic layers and back-end systems for high-volume data pipelines and backend applications.
• Experienced in evaluating and benchmarking new technologies/products.
• Experienced in java/scala/python
• Current experience using SQL/no SQL platforms, and Apache products (kafka, Spark, Hadoop, Cassandra, Druid, HBase)
• Experience developing and deploying on linux/unix platforms
• Experience with DevOps tools (GitHub, Jira) and methodologies (Agile, Scrum, Kanban, Test Driven Development)
• Basic understanding of Security (Kerberos, LDAP, TLS)
• Exposure to any public cloud (AWS, GCP) will be a plus.