Timestamp Group aggregates several leading Portuguese IT solutions and services companies around the concepts of excellence and knowledge sharing. We are committed to technological leadership, based on the quality of our service and technological solutions, supported by continuous training and certification.

Role: Azure Data Engineer

Job Responsibilities:

·       As a Data Engineer, you are responsible for the data pipelines, all imaging data, metadata, and tools for interacting with such data and have experience in processing of big files (CSV, XML over 1 GB). You have hand-on experience with Azure, Databricks, Spark, Azure Synapse, Python, PySpark, and SQL.

·       Besides the technical experience, we are looking for data engineers that can corporate, have strong analytical skills, are result-driven & customer-focused, while still following & expanding the data architecture.

Technical Skills Required:

·       Azure Databricks, Azure Active Directory, Azure Data Lake Storage

·       Delta format, Spark, Structure Streaming

·       Python, PySpark, SQL, Parquet, Avro

·       Understanding of Data Lake and Data Lakehouse concepts

·       Knowledge about the processing of big files (CSV, XML over 1 GB)

·       Processing of unstructured log data

·       Productization of Spark Structure Streaming solution

·       Deployment and release (CI/CD) experience with data solutions

·       Performance of querying over Big Data

·       Orchestration of Spark processing

·       English is mandatory

Place: Remote

Start: ASAP