Data Engineer - Technical Intelligence

Reposted 6 Days Ago
Be an Early Applicant
Hiring Remotely in United Kingdom
Remote
Mid level
Blockchain • Software
The Role
You will be responsible for maintaining and setting up automated data ingestion pipelines, simplifying existing data pipelines, designing a cloud-native data warehouse, and collaborating with data scientists for ML model deployment. Key tasks include data storage, data manipulation, and cloud infrastructure management.
Summary Generated by Built In

Description

Who are we?

IOG, is a technology company focused on Blockchain research and development. We are renowned for our scientific approach to blockchain development, emphasizing peer-reviewed research and formal methods to ensure security, scalability, and sustainability. Our projects include decentralized finance (DeFi), governance, and identity management, aiming to advance the capabilities and adoption of blockchain technology globally.

We invest in the unknown, applying our curiosity and desire for positive change to everything we do. By fueling creativity, innovation, and progress within our teams, our products and services are designed for people to be fearless, to be changemakers.

What the role involves:

As a Data Engineer, you are part of the Technical Intelligence (TechInt) team. The team’s main function is to recon the blockchain industry and feed the company with new trends and projects. The TechInt team has automatized the recon process by utilizing a data lake and machine learning. The team currently harvests data from a variety of different sources. This data gets fed into different systems that then show this data as a report.

You are responsible for maintaining and setting up data solutions and services. A key part would be to aid in the maturation of the data ingestion pipeline and processes. Moreover, you would be expected to create a state-of-the-art data warehouse which would be cloud-native. In your daily job, you do a mix of data engineering, and cloud infrastructure management. 

  • Develop and maintain automated data ingestion (API or crawling) pipelines from source code repositories, social media, and on-chain analytics. 
  • Simplify existing data pipelines - re-architecting where necessary.
  • Research existing datasets to figure out their relevance - and remove irrelevant data pipelines and sources.
  • Design a data warehouse that can be queried by analysts and APIs, and that will serve as a data backend for a reporting web application.
  • Collaborate with data scientists to operationalize ML models and deploy them into production environments.
  • Work closely with leadership to understand and define requirements, ensuring alignment with the department’s strategy and roadmap.
  • Collaborate with a Data Scientist and an Intelligence Engineer to implement technical solutions that meet project goals.
  • Ensure systems are functional, available, and carefully monitored for continuous performance and reliability.
Requirements

Who you are:

  • Minimum 3–4 years of hands-on recent experience with AWS cloud services :
  • Knowledge of Infrastructure as code (such as Terraform, AWS CloudFormation, Python AWS CDK).
  • Knowledge of cloud services management in AWS (such as S3, Redshift, Lambda, Batch, Glue, Athena etc.).
  • Hands-on experience with Docker for containerizing data applications.
  • Knowledge of relational databases and writing highly optimized SQL, including data transformations, complex joins, and performance tuning.
  • Strong proficiency in Python programming, including PySpark for data transformation.
  • Ability to communicate well both verbally and in writing, with both technical and non-technical partners. Professional English.

It would be beneficial if you have the following:

  • BSc/MSc in a Computer Science field, or equivalent practical experience. 
  • Knowledge of big data processing platforms (such Databricks) and data manipulation libraries in Python (such as Pandas, Polars).
  • Knowledge of docker container orchestration (such as Kubernetes, ECS).
  • Knowledge of Continuous Integration and Continuous Delivery (CI/CD) pipelines (such as GitHub Actions, Travis, Jenkins).
  • Knowledge of blockchain on-chain data representation.

Are you an IOGer?

Do you find yourself questioning the status quo? Do you tinker with ideas and long to turn those ideas into solutions? Are you able to spark thoughtful debates, bringing out the inquisitiveness in others? Does the promise of continuously growing excite you? Then get ready to reimagine everything you thought wasn’t possible because that’s what it means to be an IOGer - we don’t set limits, we break them. 

Benefits
  • Remote work
  • Laptop reimbursement
  • New starter package to buy hardware essentials (headphones, monitor, etc)
  • Learning & Development opportunities
  • Competitive PTO 

At IOG, we value diversity and always treat all employees and job applicants based on merit, qualifications, competence, and talent. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
471 Employees
On-site Workplace
Year Founded: 2014

What We Do

Founded in 2015, IOHK is one of the world’s pre-eminent blockchain research and engineering companies, best known for the Cardano blockchain platform
We are a fully decentralized, remote-working organization committed to the highest principles of academic rigour and evidence-based software development. The company builds high-assurance blockchain products for public and private sector clients.
Our goal is simple – to fuel our drive to be best in class by giving you the opportunity, resources and support to deliver your finest work to date. You’ll work with some exceptionally talented and friendly individuals who are always open to new ideas and ways of working.
IOHK is an advocate of decentralized remote working, with over 300 people working in more than 50 countries. Everyone has a different skill set, a different culture, and is at a different stage in their life. We aim to make collaboration between diverse people fun, exciting, and always rewarding. Many companies say they ‘think outside the box’ – for IOHK it’s more, ‘we think outside the geography’.

Similar Jobs

Veeva Logo Veeva

Senior Safety Implementation Consultant - Signal Detection and Analytics (Remote)

Big Data • Cloud • Healthtech • Software • Big Data Analytics
Remote
London, Greater London, England, GBR
6000 Employees

Mondelēz International Logo Mondelēz International

Sr. Analyst, Category & Brand Insights

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote
Hybrid
12 Locations
90000 Employees
95K-131K Annually

Chainlink Labs Logo Chainlink Labs

Technical Data Analyst, Blockchain

Blockchain • Internet of Things • Payments • Cryptocurrency • Web3
Remote
5 Locations
680 Employees

Chainlink Labs Logo Chainlink Labs

Senior Data Analyst, Economics

Blockchain • Internet of Things • Payments • Cryptocurrency • Web3
Remote
7 Locations
680 Employees

Similar Companies Hiring

True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
53 Employees
Red 6 Thumbnail
Virtual Reality • Software • Hardware • Defense • Aerospace
Orlando, Florida
113 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account