Software Senior Engineer - Bigdata

#Li-VC1

About Boomi And What Makes Us Special

Are you ready to work at a fast-growing company where you can make a difference? Boomi aims to make the world a better place by connecting everyone to everything, anywhere. Our award-winning, intelligent integration and automation platform helps organizations power the future of business. At Boomi, you’ll work with world-class people and industry-leading technology. We hire trailblazers with an entrepreneurial spirit who can solve challenging problems, make a real impact, and want to be part of building something big. If this sounds like a good fit for you, check out boomi.com or visit our Boomi Careers page to learn more.

Join us as a Software Sr. Engineer on our Software Engineering team in Pune to do the best work of your career and make a profound social impact.

About Us

Boomi’s Cloud API Management, the pioneer in the API management space, was born out of key business needs in the market to enable faster app development and partner growth, provide better, secure API performance, and deliver data-powered insights. We help customers launch their API programs quickly to get new products and services to market faster and connect with business partners more easily to foster innovation and expand routes to market. We can also deliver successful API performance with integrated security, and ensure that analytics and a performance dashboard help users understand what works, what doesn’t, and how to improve governance for the API program.

We are looking for a skilled Big Data Engineer with 5-8 years of experience in managing and processing large datasets, particularly using Big Data technologies. The ideal candidate should have proficiency in tools like PySpark, Kafka, and Airflow, alongside a strong programming background in Python or Java. Additionally, experience with relational databases (e.g., MySQL) and NoSQL databases (e.g., Cassandra, MongoDB, Time-series DB) is essential. Familiarity with cloud platforms like AWS or GCP will be a plus.

Key Responsibilities:

• Big Data Processing: Design, develop, and optimize distributed data processing pipelines using technologies like PySpark and Kafka.
• Data Integration: Implement solutions to process streaming and batch data efficiently, ensuring real-time and historical data are accessible.
• Workflow Automation: Utilize Apache Airflow to orchestrate complex workflows and scheduling of data pipeline tasks.
• Database Management: Work with both relational databases (MySQL) and NoSQL databases (e.g., Cassandra, MongoDB, Time-series DB) to design, maintain, and optimize database solutions for large datasets. Optimize database performance and ensure data integrity and security.
• Programming: Write robust, efficient, and scalable code in Python or Java for data processing, manipulation, and transformation.
• Cloud Platforms: Leverage AWS or GCP to build scalable cloud-based data architectures.
• Debugging: Troubleshoot and resolve data-related issues in a timely manner.

Qualifications:

• 5-8 years of hands-on experience as a Big Data Engineer, Data Engineer, or similar role.
• Expertise in Big Data technologies like PySpark, Kafka, and Apache Airflow.
• Strong programming skills in Python or Java.
• Experience working with both relational databases (MySQL) and NoSQL databases (Cassandra, MongoDB, etc.).
• Solid understanding of data pipeline development, ETL processes, and data warehousing concepts.
• Familiarity with time-series databases is a plus. (Druid, InfluxDB, Prometheus)
• Familiarity with Cloud platforms such as AWS (e.g., S3, EC2, EMR) or Google Cloud Platform (GCP).
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Be Bold. Be You. Be Boomi.

All employment decisions are based on business needs, job requirements, and individual qualifications.

Boomi strives to create an inclusive and accessible environment for candidates and employees. If you need accommodation during the application or interview process, please submit a request to talent@boomi.com. This inbox is strictly for accommodations, please do not send resumes or general inquiries.