Visa & border information for those fleeing Ukraine.

Data Engineer – Web Scraper at Heni

Heni Heni Data Full-time

Job details

HENI is looking to increase its data-gathering capability and we are looking for Python Developers (Junior through to Senior) to help us do this. As a Python Developer/Web Scraper the role is split into three main areas:

  1. Maintenance of existing crawlers
  2. Setting up new crawlers
  3. Scraping the NFT/Blockchain market

Tooling

From a tooling perspective, we use Python (Scrapy) to set up the spiders. We have an AWS based infrastructure and data is stored in S3 buckets as well as SQL based databases (MySQL and PostgreSQL).

Requirements

  • Writing and maintaining software for digital data collection for hundreds of websites
  • Developing software to allow for scaling of data gathering across thousands of sources and across multiple team members
  • Working with and deploying data pipelines (e.g. Scrapy, written in Python), process and cleaning the data, and storing accurately into our database
  • Setting up scrapers, fixing any bugs or issues when websites changes

Benefits

  • Competitive salary + bonus
  • Work in a dynamic and fast-paced environment with new challenges
  • Work with a modern tech stack and the latest frameworks
  • Have your say – a real chance to influence the tech stack
  • Working with a company that uses the most up to date blockchain technology
  • Get involved in a variety of projects, see how they develop into polished products and services
  • Flexible & fully remote working options – you choose where you work
  • Competitive holiday allowance
  • Full private healthcare
  • Learning budget for personal development

 

Need to know information

  • This role can be fully remote, anywhere across the globe.
  • We are looking for people who can do this full time (40 hours per week).
  • We can offer a competitive salary or hourly rate. It’s almost impossible to put a figure on this as different countries have different living costs but we are very competitive.
  • If you are based in the UK, we can offer a permanent contract. If you are based overseas, we can offer a freelance contract.

By browsing this website
you accept our cookie policy
chat
Get help with Visa
Ready to take the first step in moving to another country? Let's start with the question below:

    Thanks for your message!
    We’ll contact you as soon as posible to help with your relocation situation!
    Want more hands on assistance?

    Book a consultation with our Co-Founder/ COO Tim?

    Book consulation
    Close
    back
    Book a 1 hour consultation visit.
    calendar
    Our Relocation specialist is ready to learn about your situation and help you find the best option!
    support-img
    Tim Marting
    Co-Founder & COO
    The €60 fee will go towards your relocation package once you’ve figured out where you want to go
    Book now for €60
    back