Data Engineer | 2+ yrs | Epsilon

Updated

19/09/2024

Reading time

5 min

Views

Epsilon Recruitment | 2+ years | Data Engineer | Bengaluru

Epsilon Technologies seeks a skilled Data Engineer 2 to join our dynamic team. Responsibilities include designing and implementing scalable data pipelines, optimizing data workflows, and collaborating with cross-functional teams to drive innovation. The ideal candidate has a strong background in data engineering, proficiency in SQL and Python, and a passion for solving complex data challenges. Apply now unleash your potential!

Website…

Published on : XX XX XXXX

Data Engineer 2 (2+ years)

Epsilon Technologies is hiring for the post of Data Engineer 2. Interested and eligible candidates can read more details below.

Company Name : Epsilon Technologies

Job Location : Bangalore, KA, India

Job Title : Data Engineer 2

Education : B.E./ B.Tech

Experience : 2+ year

Business Unit : Data Sciences

Epsilon Recruitment 2024

Job Description :

This position in the Engineering team under the CIS organization. We drive the first mile of the customer experience through personalization of offers and content. We are currently on the lookout for a smart, highly driven software engineer.

You will be part of a team that is focused on building solutions, pipelines using latest software engineering design principles and tech stacks. You will also be expected to Identify, design, and implement improvements including re-designing infrastructure for greater scalability, optimizing data delivery and automate continuous integration and deployment processes/pipelines.

The incumbent is also expected to partner with various stakeholders, bring scientific rigor to design and develop high quality software.

She / He also must have excellent verbal and written communication skills and be comfortable working in an entrepreneurial, ‘startup’ environment within a larger company.

Role :

» Develop solutions for Epsilon that will deliver high quality personalized recommendations across different channels to our customers
» Working with Data science team to ensure seamless integration and support of machine learning models.
» Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
» Develop end-to-end (Data/Dev/MLOps) pipelines based on in-depth understanding of cloud platforms, AI/ML lifecycle, and business problems to ensure solutions are delivered efficiently and sustainably.
» Collaborate with other members of the team to ensure high quality deliverables
» Learning and implementing the latest design patterns in software engineering

Qualifications :

» Bachelor’s Degree in Engineering and related field with 2+ years of similar experience
» Tech Stack: Python, PySpark, Micro services, Docker, Serverless Frameworks & Databricks.
» Hands on experience building ETL workflows/pipelines
» Experience in relational and non-relational databases and SQL (NoSQL is a plus).
» Experience with Cloud technologies (AWS or Azure)
» Experience building Data and CI/CD/MLOps pipelines
» Familiarity with Airflow and MLFlow tools
» Familiarity with automated unit/integration test frameworks
» Experience working on AdTech or MarTech technologies is added advantage
» Knowledge of machine learning algorithms and concepts and implementation will be a plus
» Good written and spoken communication skills, team player.
» Strong analytic thought process and ability to interpret findings

Data Management –

» Experience with both structured and unstructured data, and Hadoop, Apache Spark, or similar technologies
» Good understanding of Data Modeling, Data Warehouse, Data Catalog concepts and tools
» Experience with Data Lake architectures, and with combining structured and unstructured data into unified representations
» Able to identify, join, explore, and examine data from multiple disparate sources and formats
» Ability to reduce large quantities of unstructured or formless data and get it into a form in which it can be analyzed
» Ability to deal with data imperfections such as missing values, outliers, inconsistent formatting, etc.
» Ability to manipulate large datasets, (millions of rows, thousands of variables)

Software Development –

» Ability to write code in programming languages such as Python, PySpark and shell script on Linux
» Familiarity with software development methodology such as Agile/ Scrum
» Love to learn new technologies, keep abreast of the latest technologies within the cloud architecture, and drive your organization to adapt to emerging best practices

Architecture and Infrastructure –

» Architectural design experience on AWS.
» Experience in delivering software with AWS EC2, S3, EMR/Glue, Lambda, Data Pipeline, CloudFormation, Redshift etc.
» Good knowledge of working in UNIX/ LINUX systems.

‹‹‹ more details ›››

How to Apply :

All interested and eligible candidates can apply in online mode for Data Engineer 2 position.

Apply for this Job..

Join our Telegram group: Click here

Join our WhatsApp group: Click here

Salary : The salary for this role is upto ₹15.0 LPA *

Software Quality Engineer | 2+ yrs | Red Hat

— Back —

About Epsilon Technologies

Epsilon Technologies pioneers cutting-edge AI solutions, revolutionizing industries worldwide. Their flagship product, the E Quantum Processor, boasts unparalleled processing power and efficiency. From healthcare to finance, Epsilon’s innovations redefine possibilities. With a commitment to excellence and innovation, Epsilon continues to push boundaries in the tech landscape, shaping the future of artificial intelligence and machine learning.