Urgent! Softpath Technologies - Senior Big Data Engineer - Hive & Unix Scripting Job | Softpath Technologies LLC
<p><p><b>Description : </b></p><br/><p><b>Job Title : </b>Senior Big Data Engineer Hive & Unix Scripting</p><br/><p><b>Location : </b>Pune / Hyderabad, India</p><br/><p><b>Experience :</b>6 - 8 Years</p><br/><p><b>Job Summary : </b><br/><br/>We are looking for an experienced Big Data Engineer with strong expertise in Hive, Unix/Linux scripting, and data pipeline development.
The ideal candidate will be responsible for designing, developing, and maintaining large-scale data solutions on Hadoop ecosystems, optimizing Hive queries, automating workflows, and ensuring the reliability and scalability of data systems.</p><br/><p>This role requires deep technical knowledge of Big Data technologies, strong analytical and scripting skills, and the ability to work closely with cross-functional teams including Data Architects, Analysts, and Business Stakeholders.</p><br/><p><b>Key Responsibilities : </b></p><br/><p>- Design, develop, and optimize Hive-based data models, queries, and tables for analytical and reporting use cases.</p><br/><p>- Develop and maintain Unix/Linux shell scripts for workflow automation, data ingestion, and monitoring.</p><br/><p>- Manage and enhance ETL pipelines across various data sources and sinks (HDFS, Hive, Sqoop, Spark, etc.).</p><br/><p>- Implement data quality checks, validations, and performance tuning for efficient data processing.</p><br/><p>- Work closely with Data Architects to design scalable data lake and warehouse architectures.</p><br/><p>- Monitor data jobs, troubleshoot failures, and ensure SLA adherence for data availability.</p><br/><p>- Collaborate with Analytics and BI teams to deliver clean, reliable datasets.</p><br/><p>- Contribute to migration or modernization projects, including moving on-prem Big Data workloads to cloud platforms (AWS/Azure/GCP).</p><br/><p>- Document design specifications, job flows, and operational procedures.</p><br/><p>- Stay up to date with the latest Big Data tools and best practices, recommending process improvements.</p><br/><p><b>Required Technical Skills : </b></p><br/><p>- <b>Big Data Ecosystem : </b> Strong experience with Hive, Hadoop (HDFS, YARN), and MapReduce.</p><br/><p>- <b>Scripting : </b> Advanced hands-on experience with Unix/Linux shell scripting (bash, ksh, etc.) for automation.</p><br/><p>- <b>Data Processing Tools : </b> Experience with Spark, Sqoop, Impala, or Pig is an added advantage.</p><br/><p>- <b>ETL Development : </b> Solid understanding of data ingestion, transformation, and orchestration frameworks.</p><br/><p>- <b>Performance Optimization : </b> Proven ability to tune Hive queries, partition strategies, and optimize joins and aggregations.</p><br/><p>- <b>Version Control : </b> Familiarity with Git, Bitbucket, or similar tools.</p><br/><p>- <b>Scheduling Tools : </b> Experience with Oozie, Airflow, or Control-M.</p><br/><p>- <b>Cloud Platforms (Optional) : </b> Exposure to AWS EMR, Azure Data Lake, or GCP Dataproc is a plus.</p><br/><p><b>Preferred Qualifications : </b></p><br/><p>- Bachelors or Masters degree in Computer Science, Information Technology, or related field.</p><br/><p>- Strong understanding of data warehousing concepts, data modeling, and SQL optimization.</p><br/><p>- Experience in data security, lineage, and governance practices.</p><br/><p>- Familiarity with Python or PySpark scripting for data manipulation.</p><br/><p>- Excellent problem-solving and analytical skills.</p><br/><p>- Strong communication skills and ability to work in an agile, team-oriented environment.</p><br/><p><b>Soft Skills : </b></p><br/><p>- Strong analytical and debugging mindset.</p><br/><p>- Excellent verbal and written communication.</p><br/><p>- Ability to work independently with minimal supervision.</p><br/><p>- Collaborative attitude and eagerness to learn emerging technologies.</p><br/></p> (ref:hirist.tech)
✨ Smart • Intelligent • Private • Secure
Practice for Any Interview Q&A (AI Enabled)
Predict interview Q&A (AI Supported)
Mock interview trainer (AI Supported)
Ace behavioral interviews (AI Powered)
Record interview questions (Confidential)
Master your interviews
Track your answers (Confidential)
Schedule your applications (Confidential)
Create perfect cover letters (AI Supported)
Analyze your resume (NLP Supported)
ATS compatibility check (AI Supported)
Optimize your applications (AI Supported)
O*NET Supported
O*NET Supported
O*NET Supported
O*NET Supported
O*NET Supported
European Union Recommended
Institution Recommended
Institution Recommended
Researcher Recommended
IT Savvy Recommended
Trades Recommended
O*NET Supported
Artist Recommended
Researchers Recommended
Create your account
Access your account
Create your professional profile
Preview your profile
Your saved opportunities
Reviews you've given
Companies you follow
Discover employers
O*NET Supported
Common questions answered
Help for job seekers
How matching works
Customized job suggestions
Fast application process
Manage alert settings
Understanding alerts
How we match resumes
Professional branding guide
Increase your visibility
Get verified status
Learn about our AI
How ATS ranks you
AI-powered matching
Join thousands of professionals who've advanced their careers with our platform
Unlock Your Softpath Technologies Potential: Insight & Career Growth Guide
Real-time Softpath Technologies Jobs Trends in Pune, India (Graphical Representation)
Explore profound insights with Expertini's real-time, in-depth analysis, showcased through the graph below. This graph displays the job market trends for Softpath Technologies in Pune, India using a bar chart to represent the number of jobs available and a trend line to illustrate the trend over time. Specifically, the graph shows 3219 jobs in India and 307 jobs in Pune. This comprehensive analysis highlights market share and opportunities for professionals in Softpath Technologies roles. These dynamic trends provide a better understanding of the job market landscape in these regions.
Great news! Softpath Technologies LLC is currently hiring and seeking a Softpath Technologies Senior Big Data Engineer Hive & Unix Scripting to join their team. Feel free to download the job details.
Wait no longer! Are you also interested in exploring similar jobs? Search now: Softpath Technologies Senior Big Data Engineer Hive & Unix Scripting Jobs Pune.
An organization's rules and standards set how people should be treated in the office and how different situations should be handled. The work culture at Softpath Technologies LLC adheres to the cultural norms as outlined by Expertini.
The fundamental ethical values are:The average salary range for a Softpath Technologies Senior Big Data Engineer Hive & Unix Scripting Jobs India varies, but the pay scale is rated "Standard" in Pune. Salary levels may vary depending on your industry, experience, and skills. It's essential to research and negotiate effectively. We advise reading the full job specification before proceeding with the application to understand the salary package.
Key qualifications for Softpath Technologies Senior Big Data Engineer Hive & Unix Scripting typically include Computer Occupations and a list of qualifications and expertise as mentioned in the job specification. Be sure to check the specific job listing for detailed requirements and qualifications.
To improve your chances of getting hired for Softpath Technologies Senior Big Data Engineer Hive & Unix Scripting, consider enhancing your skills. Check your CV/Résumé Score with our free Resume Scoring Tool. We have an in-built Resume Scoring tool that gives you the matching score for each job based on your CV/Résumé once it is uploaded. This can help you align your CV/Résumé according to the job requirements and enhance your skills if needed.
Here are some tips to help you prepare for and ace your job interview:
Before the Interview:To prepare for your Softpath Technologies Senior Big Data Engineer Hive & Unix Scripting interview at Softpath Technologies LLC, research the company, understand the job requirements, and practice common interview questions.
Highlight your leadership skills, achievements, and strategic thinking abilities. Be prepared to discuss your experience with HR, including your approach to meeting targets as a team player. Additionally, review the Softpath Technologies LLC's products or services and be prepared to discuss how you can contribute to their success.
By following these tips, you can increase your chances of making a positive impression and landing the job!
Setting up job alerts for Softpath Technologies Senior Big Data Engineer Hive & Unix Scripting is easy with Expertini. Simply visit our job alerts page here, enter your preferred job title and location, and choose how often you want to receive notifications. You'll get the latest job openings sent directly to your email for FREE!
