Hadoop Developer

Airtel X Labs
Gurgaon
1 - 6 yrs exp
1 - 6 yrs exp
About opportunityAbout opportunity

Job Responsibilities:

We expect our data engineers to build durable data pipelines with the ability to scale elegantly with data volume growth. The code you write will enable our users to get data in a timely manner. You'll work on a variety of tools and systems, most of which are Cloud-based applications or data-platform components (e.g., data pipelines, processing, Visualization, reporting, etc.). In this role, you will be working in Agile development method for faster, quick-wins with the quality of design, development and operating BI components you develop.

  • Design, architect, implement, and support key datasets that provide structured and timely access to actionable business information with the needs of the end customer always in view
  • Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
  • Retrieve and analyze data using SQL, Excel, and other data management systems
  • Create ETLs/ELTs to take data from various operational systems and craft a unified dimensional or star schema data model for analytics and reporting
  • Develop a deep understanding of vast data sources (existing on the cloud) and know exactly how, when, and which data to use to solve particular business problems
  • Loading from disparate complex data sets.
  • Designing, building, installing, configuring and supporting Hadoop.
  • Translate complex functional and technical requirements into detailed design.
  • Perform analysis of vast data stores and uncover insights.
  • Maintain security and data privacy..
  • Being a part of a POC effort to help build new Hadoop clusters.
  • Test prototypes and oversee handover to operational teams.
  • Propose best practices/standards.
  • Writing high-performance, reliable and maintainable code.

Skills Required:

  • Expertise with the tools in Hadoop Ecosystem including Pig, Hive, HDFS, MapReduce, Sqoop, Storm, Spark, Kafka, Yarn, Oozie, and Zookeeper.
  • Solid experience building APIs (REST), Java services, or Docker Microservices
  • Experience with data pipe
  • Good knowledge of database structures, theories, principles, and practices.
  • Familiarity with data loading tools like Flume, Sqoop.
  • Knowledge of workflow/schedulers like Oozie.
  • Analytical and problem solving skills, applied to Big Data domai
  • Proven understanding with Hadoop, Hive, Pig, and HBase.
  • Good aptitude in multi-threading and concurrency concepts
Read more
Interview RoundsInterview roundsUnavailable
SIGN UP TO REQUEST FOR INTERVIEW ROUNDS
Hiring Team
company
About Airtel X Labs

A true Indian MNC, operating out of 17 countries across Asia and Africa, we serve one in every 25 people on this planet. We aim to work towards our vision, driven by our values of AIR - Alive, Inclusive and Respectful. Being the world’s 3rd largest telecom service provider, we believe in providing our employees with an inspiring and motivating environment, and here is what our employees have to say about it!

All work and no play isn’t how we do things at Airtel X-Labs. Here, innovation is a way of life and we believe that a dynamic and friendly environment helps our employees strike a healthy work-life balance. In fact, a defining characteristic of life at Airtel X-Labs is fun, youthful and vibrant work culture.

Airtel X Labs is transforming from a telecom giant to a digital force and changing how cities use energy, to how people consume entertainment, to how companies manage their assets. There could not be a better time to join us and be a part of this incredible journey. Our mission is “Hunger to win customers for life” through exceptional customer experience and by building, world class digital products.

company
Thank you!
You will get the call soon.
success tick
Thanks much!
Appreciate your feedback.