Talent.com
This job offer is not available in your country.
Data Engineer II

Data Engineer II

RELXIloilo
19 days ago
Job description

Would you enjoy a Data Operations role that includes processing data, data analysis, data development and LINUX shell scripting work? You will be performing (ETL) Extraction Transformation and Load tasks, the timely processing and delivery of data builds with varying frequencies, data build automation and automation / monitoring the pulse of a deployment process.

The perfect candidate for this role will have the ability to work independently for various tasks, but they will also collaborate with various technical and non-technical audiences. The individual will support our data developers, software engineers, business analysts and data architects on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects

Responsibilities

  • Own a specific set or group of data transfers / builds in various capacities including transferring incoming data using sftp, unzip files, check files (correct name, correct number of files, not corrupt, matches layout, matches fixed length), create call in ECL to process files and enable movement through deployment process, review build statistics after processing.
  • Perform simultaneous execution of multiple tasks following and reacting, when necessary, throughout the day.
  • Produce code that is efficient, repeatable, without defects, and adherent to best practices and internal standards such as naming conventions, encapsulation, etc.
  • Contributes to design, coding and reviews of moderate processes.
  • Good level of intimacy within a specific data content area.
  • Complete data engineering bug fixes and issues, researching and identifying root causes as appropriate.
  • Identify opportunities to apply automation or other tools to improve effectiveness or efficiency.
  • Innovate process improvements that enable efficient delivery and maintenance.
  • Participate in the development processes, coding best practices, and code reviews.
  • Work with stakeholders including the Executive, Product, Data and Architecture teams to assist with data related technical issues, enhancements and to support their data infrastructure needs.
  • Complete simple data engineering bug fixes and resolve technical issues as necessary.

Qualifications :

  • Bachelor's degree holder.
  • 2-4 years of data or database management experience, skills, and competencies.
  • Strong LINUX ksh / bash scripting skills dealing manipulation of files and automation processes utilizing : crontab, awk, sed, cut, paste, variations of date, if / then / else, case / esac, while loops, for loops, functions, use of variables over hard coding, sourcing,…..)
  • Cloud Azure experience
  • Experience with file management.
  • Experience with ETL tasks (any tool would do).
  • Experience with SFTP.
  • Strong debugging / problem solving skills. Must enjoy digging deep into problems.
  • Attention to detail.
  • Strong organizational skills.
  • Ability to provide detail information and summarize to various levels of staff including management.
  • Ability to effectively resolve issues / problems to reach a workable and successful solution.
  • Ability to understand and develop systems of simple tomoderate complexity.
  • Ability to work in ambiguous situations.
  • Ability to deliver a quality code product as scheduled.

    • Nice-to-have :

  • Experience with a programming language (e.g. JAVA, PYTHON, C / C++, .net) for some development work.
  • Experience with process automation.
  • Familiarity with using GIT Hub.
  • Medium to strong database knowledge; modifying / designing and creating procedures to insert, update, query moderate MySQL DB used for tracking a deployment process
  • Ability and desire to learn new processes and technologies utilizing our HPCC systems and opensource code, ECL. (This is an opportunity to learn ECL our open source software language that maximizes the rapid utilization of our massive databases)

    • We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our or please contact 1-855-833-5120.

    Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams .

    Please read our .

    Create a job alert for this search

    Data Engineer • Iloilo