Hadoop Architect

Role: Hadoop Architect (Spark, PySpark & CDP)

Location: Pune

Work Mode: Onsite

Experience: 10+ years

Company: Smart Analytica Private limited is niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PB’s in a single implementation, delivering many successful data and AI projects across major industries, including retail, finance, telecom, manufacturing, insurance, and capital markets. We are leaders in Big Data, Cloud and Analytics projects with super specialization in very large Data Platforms.

https://smart-analytica.com

Empowering Your Digital Transformation with Data Modernization and AI

Mandatory Skills: Cloudera data platform, Pyspark, Hive, SQL, Iceberg and Open Data Contract Standard (ODCS)

Job Description

• Deep understanding and experience with modern Data Platforms – Cloudera Data Platform (CDP)
• Strong hands-on experience with PySpark.
• Experience with Cloudera Data Platform (CDE, CDW, Ozone, Airflow, SDX), Apache Ranger
• Deep understanding of distributed data systems and Hive Metastore
• Experience and understanding of cataloging, lineage, and governance
• Experience / understanding Open Data Contract Standard (ODCS) and its implementation
• Experience working with SQL, file formats (Iceberg/Parquet), and partitioning/bucketing strategies.

Nice to have

• Experience modernizing enterprise finance systems or regulated environments
• Knowledge of CI/CD, data engineering best practices
• Understanding of financial data structures, accounting processes, or reconciliation workflows.