Designing, implementing, and optimising data storage and transformation solutions. Work for the US client (crypto/blockchain area), working hours in NY time zone.
responsibilities :
Design and implement data processing systems for analysis of cryptocurrency investment products,
Optimize ETL processes for various data formats from exchanges, index providers, and web sources,
Develop and manage the database architecture for data analytics, focusing on performance and scalability,
Drive automation, continuous integration, deployment, and performance optimisation efforts while ensuring strict security compliance,
Design, implement, and optimise robust REST APIs and ensure data correctness through test suites and instrumentation.
requirements-expected :
3+ years of experience in data engineering and building data platforms,
Strong background in building scalable data pipelines, managing data ecosystems, and collaborating with cross-functional teams,
Proven track record of deploying cloud-based products and optimising processing pipelines for streaming analytics,
Proficiency with SQL and NoSQL databases (PostgreSQL, MongoDB, Redis),
Expertise in Kafka and Airflow,
Experience with AWS and cloud services,
Very good Python coding skills and experience with build automation and CI/CD tools,
