We are looking for a person for the position of Data Engineers/Big data
what we offer
- work in an international environment
- attractive salary
- possibility of remote work
your tasks
- You will be experienced in working with big data ingestion and large data sets in general. You will be responsible for creating and maintaining high quality ETLs.
- This is an exciting opportunity to build a new greenfield solution, working as part of a small team, to help the business improve their market making capabilities within the fixed income space.
- The platform itself is housed within the AWS ecosystem.
-
...
Job Responsibilities / Role
Take responsibility for the software delivery by ensuring quality and scope expectations are met.Contribute and take ownership of the technical design and ensure all aspects of the system architecture are well documented.Work closely with partner technology teams and to collaborate effectively.what we expect
- Experience Python, Pyspark, Pandas, JulyterLab (working with notebooks).
- Experience using AWS platform.
- Experience with continuous integration and continuous delivery tools like Git, Jenkins etc.
- Agile development/Software life cycle
- Knowledge around BI tools (Qlik, Tableau, Power BI,… )
Nice to have Skills:
- Experience with Kafka
- Experience in SQL, Hive, Hadoop.
- Specifically, experience using EMR (Elastic Map Reduce) in AWS to run Spark clusters.
- Knowledge of Terraform
- Experience with Ansible, Bash scripting, boto3
- Experience configuring continuous integration and continuous delivery tools.
Employment agency entry number 47
this job offer is intended for people over 18 years of age
