As a Python Data Engineer, you will play a pivotal role in constructing our robust data infrastructure to support the business intelligence, data analysis, and data science teams. You will utilize your expertise in Python to build and automate data pipelines, create and maintain optimal data pipeline architecture, and implement data flow and data collection. This role requires close collaboration with data architects, data analysts, and data scientists to meet the functional and non-functional business requirements.
Location: Bangalore
Main responsibilities:
- Design and build data ingestion pipelines using Python and other big data technologies.
- Work closely with data architects to implement an effective and scalable ETL design.
- Develop and maintain optimal data pipeline architecture and database systems.
- Perform data analysis and implement complex business logics.
- Ensure system compliance with company policies, procedures, and regulatory requirements.
- Contribute to project deliverables including solution design documentation and risk assessments.
- Perform routine and ad hoc performance tuning and data optimization activities.
- Collaborate with stakeholders and optimize data delivery for cross-functional projects.
Must-have:
- Minimum of 5 years of experience in Python, SQL and big data technologies.
- Familiarity with data pipeline and workflow management tools.
- Experience with Snowflake architecture and warehouse implementation and management.
- Extensive experience with data architecture, data modeling, and data warehousing concepts.
- Working experience of cloud computing architecture.
- Knowledge of the software development life cycle (SDLC) from analysis to deployment.
- Excellent project management and organizational skills.
Desired Qualifications:
- Reside in India
- Exceptional problem-solving skills and result-oriented approach.
- Experience in data structure design, data flow planning and ETL generation.
- Knowledge on implementing data governance strategy.
- Experience with data visualization tools.
- Demonstrated ability to manage multiple projects simultaneously.
- Excellent teamwork and interpersonal skills.
- Ability to act autonomously, bringing structure and organization to work.
Salary range for this role: 30,00,000-35,00,000 INR