Posted:3 days ago|
Platform:
On-site
Full Time
We are looking for a Data Engineer to join the Data Platform team who can help develop and deploy data pipelines at a huge scale of ~5B daily events and concurrency of 500K users. The platform is built on AWS based modern data stack enabling real-time reporting and performing data exploration from first principles.
Experience: 2-5 Years
Job Location: Gurgaon
Responsibilities:
➔ Create and maintain a robust, scalable, and optimized data pipeline.
➔ Handle TBs of data volume daily on Wynk Music/Xstream(Vod & live tv) Data platform
➔ Extract and consume data from our live systems to analyze and produce robust 99.999% SLA Big-data environment
➔ Build and execute data mining and modeling activities using agile development techniques
➔ Solve problems in robust and creative ways and demonstrate solid verbal, interpersonal and written communication skills
➔ Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
➔ Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
➔ Handle multiple kinds of SQL And NoSQL databases for both structured and unstructured datasets.
➔ Appreciate and understand the cloud computation model and how that affects application solutions – both delivery and deployment.
➔ The incumbent will be in the driving seat for innovation and delivery in various exciting tech opportunities, from powering business analytics pipelines to machine learning applications.
Desired Profile:
➔ B.E / B.Tech / M.E / M.Tech / M.S in Computer Science or software engineering from a premier institute
➔ 2+ years of experience in Spark and Scala
➔ Should be very strong with data structures and algorithm.
➔ Fluent with Hadoop/Pig/Hive/Storm/SQL
➔ Good to have knowledge: NoSQL solutions like Cassandra/MongoDB/CouchDB, Postgres, Kafka, Redis, ElasticSearch, Spark Streaming, or you really want to learn about them.
➔ Own end to end product modules/features (from the requirement to going live)
➔ Knowledge in at least one of the programming or scripting languages like Java, Scala, Python.
➔ Hands-on in big data infrastructure, distributed systems, dimensional modeling, query processing & optimization and relational databases
Airtel Digital
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Java coding challenges to boost your skills
Start Practicing Java Now
Hyderabad
30.0 - 45.0 Lacs P.A.
Bengaluru
40.0 - 45.0 Lacs P.A.
20.0 - 25.0 Lacs P.A.
25.0 - 37.5 Lacs P.A.
Hyderābād
Salary: Not disclosed
Hyderābād
Salary: Not disclosed
Hyderābād
Experience: Not specified
Salary: Not disclosed
Bengaluru
Salary: Not disclosed
6.5 - 9.375 Lacs P.A.
India
Salary: Not disclosed
