We are looking for a data engineer to join our team. You will use various methods to ingest, transform raw data into useful data systems and strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to extract, load and transform data from various sources. Data engineer skills also include familiarity with several programming languages (preferably Python or R), SQL, other cloud or on-premise ETL tools/services. If you are detail-oriented, with excellent organizational skills and experience in this field or have an interest in pursuing it, we would like to hear from you.
Duties/Responsibilities:
- Extract data from multiple sources.
- Data cleaning, cleansing and transformation.
- Build data systems and pipelines.
- Conduct complex data analysis and report on results.
- Load data into data lakes and Datawarehouse.
- Explore ways to enhance data quality and reliability.
- Data Cataloging.
- Evaluate business needs and objectives.
- Interpret trends and patterns.
- Work with software engineers to define data fields for SaaS products.
Required Skills/Abilities:
- Previous experience as a data engineer or in a similar role.
- Technical expertise with data models, data scrapping, data cleansing and segmentation techniques.
- Knowledge and experience of Python programming language specifically Pandas, Numpy, and Connection libraries
- Knowledge and experience with SQL queries.
- Knowledge of MS excel and ability to build various views using pivot tables and data models.
- Great numerical, statistical and analytical skills.
- Candidate must be able to extract data from multiple sources, clean, transform and build analytics on that data.
- Defining ETL Processes from On-Prem/Cloud data sources
- Data engineering certification will be a plus.
- Experience with PySpark, SparkSQL, AWS Glue, AWS Athena, and AWS lambda will be a plus.
- Selenium will be a plus.