Thoughtworks Hiring Hadoop Developer

Job Location: Hyderabad

Experience: 1-3 Years

Data Engineering role at ThoughtWorks

ThoughtWorks India is looking for talented data engineers passionate about building large scale data processing systems to help manage the ever-growing information needs of our clients.

Our developers have been contributing code to major organizations and open source projects for over 25 years now. They’ve also been writing books, speaking at conferences, and helping push software development forward — changing companies and even industries along the way. As Consultants, we work with our clients to ensure we’re delivering the best possible solution. Our Lead Dev plays an important role in leading these projects to success.

Curious what makes a developer a Lead around these parts? A Lead is responsible for:

Creating complex data processing pipelines, as part of diverse, high energy teams
Designing scalable implementations of the models developed by our Data Scientists
Hands-on programming based on TDD, usually in a pair programming environment
Deploying data pipelines in production based on Continuous Delivery practices
Advising clients on the usage of different distributed storage and computing technologies from the plethora of options available in the ecosystem

We believe that to flourish in this role, you need to have:

9+ years of overall industry experience and minimum of 4- 5 years of experience building and deploying large scale data processing pipelines in a production environment
Technical Expertise: Experience building data pipelines and data centric applications using distributed storage platforms like HDFS, S3, NoSql databases (Hbase, Cassandra, etc) and distributed processing platforms like Hadoop, Spark, Hive, Oozie, Airflow, etc in a production setting
Hands on experience in MapR, Cloudera, Hortonworks and/or Cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions.
Focus on excellence: Has practical experience of Data-Driven Approaches, Is familiar with the application of Data Security strategy, Is familiar with well know data engineering tools and platforms e.g Kafka, Spark, Hadoop, Experience creating and building Big Data Architecture
Technical depth and breadth : Able to build and operate Data Pipelines, Build and operate Data Storage, Has worked on big data architecture within Distributed Systems. Is familiar with Infrastructure definition and automation in this context. Is aware of adjacent technologies to the ones they have worked on. Can speak to the alternative tech choices to that made on their projects. Understanding of Data Modelling
Learning ability : Is self-reflective, Has a hunger to improve, Has a keen interest to drive their own learning. Applies theoretical knowledge to practice
Nice to have: Attends and participates in conferences/meetups/user groups, Contributes to open source projects

And here’s some of the perks of being part of a unique organization like ThoughtWorks:

A real commitment to “changing the face of IT” — our way of thinking about diversity and inclusion. Over the past ten years, we’ve implemented a lot of initiatives to make ThoughtWorks a place that reflects the world around us, and to make this a welcoming home to technologists of all stripes. We’re not perfect, but we’re actively working towards true gender balance for our business and our industry, and you’ll see that diversity reflected on our project teams and in offices.
Continuous learning. You’ll be constantly exposed to new languages, frameworks and ideas from your peers and as you work on different projects — challenging you to stay at the top of your game.
Support to grow as a technologist outside of your role at ThoughtWorks. This is why ThoughtWorkers have written over 100 books and can be found speaking at (and, ahem, keynoting) tech conferences all over the world. We love to learn and share knowledge, and you’ll find a community of passionate technologists eager to back your endeavors, whatever they may be. You’ll also receive financial support to attend conferences every year.
An organizational commitment to social responsibility. ThoughtWorkers challenge each other to be just a little more thoughtful about the world around us, and we believe in using our profits for good. All around the world, you’ll find ThoughtWorks supporting great causes and organizations in both official and unofficial capacities.

Categories:

Tags: