, algorithms, and serialization formats Experience with big-data technologies (e.g. Spark, Kafka, Hive) Advanced...
Factory, Databricks, Kafka) to automate data ingestion pipelines and enable real-time, scalable solutions. Oversee the... seamless integration of platforms and pipelines using Azure cloud, Kafka, with microservices written in Java and Python...
. Technical Skills: Experience with middleware technologies, message brokers (e.g., Kafka, RabbitMQ), and ESB (Enterprise...
open-source Flyte orchestration framework and are deployed to AWS. Pipeline code is written in Python. We use SQS and Kafka...
). Our Technology Stack 💻 Python and Scala Starburst and Athena Kafka and Kinesis DataHub ML Flow and Airflow Docker... and Terraform Kafka, Spark, Kafka Streams and KSQL DBT AWS, S3, Iceberg, Parquet, Glue and EMR for our Data Lake Elasticsearch...
- Data Factory, Event Hubs, Bicep, cognitive etc Message brokers - Kafka, RabbitMQ etc Please apply with an up...
handling of large-scale data flows. Leverage Kafka, Redshift and Oracle data warehouses to build performant data models..., including Redshift, S3, EC2, Lambda, and Kafka. Reporting Tools: Advanced skills in Power BI, including DAX, Power Query...
Job Description: Required Skills - T24, Datadog, Java – (Spring boot, Microservices), Snowflake, Kafka, Azure Devops, AWS, (IntelliJ tool)- Java...
integration, and data transformation. Implement automated data pipelines using tools like Apache Airflow, Spark, Kafka... such as Apache Airflow, Spark, Kafka, Hadoop, or similar. Strong SQL skills and experience with relational and NoSQL databases...
- Data Factory, Event Hubs, Bicep, cognitive etc Message brokers - Kafka, RabbitMQ etc Please apply with an up...